Data-intensive text processing with MapReduce

Data-intensive text processing with MapReduce

by Lin, Jimmy

Type Book
Rate 0.0 /5

Our world is being revolutionized by data-driven methods: access to large amounts of data has generated new insights and opened exciting new opportunities in commerce, science, and computing applications. Processing the enormous quantities of data necessary for these advances requires large clusters, making distributed computing paradigms more crucial than ever. MapReduce is a programming model for expressing distributed computations on massive datasets and an execution framework for large-scal…

Read More ↓
Details
Files
Reviews
Download

Title Statements

  • Full title :Data-intensive text processing with MapReduce / Jimmy Lin and Chris Dyer.

Summary

Our world is being revolutionized by data-driven methods: access to large amounts of data has generated new insights and opened exciting new opportunities in commerce, science, and computing applications. Processing the enormous quantities of data necessary for these advances requires large clusters, making distributed computing paradigms more crucial than ever. MapReduce is a programming model for expressing distributed computations on massive datasets and an execution framework for large-scale data processing on clusters of commodity servers. The programming model provides an easy-to-understand abstraction for designing scalable algorithms, while the execution framework transparently handles many system-level details, ranging from scheduling to synchronization to fault tolerance. This book focuses on MapReduce algorithm design, with an emphasis on text processing algorithms common in natural language processing, information retrieval, and machine learning. We introduce the notion of MapReduce design patterns, which represent general reusable solutions to commonly occurring problems across a variety of problem domains. This book not only intends to help the reader "think in MapReduce", but also discusses limitations of the programming model as well.

Read More ↓

Edition Statements

  • Publication Date:©2010.

Publication Statements

  • Publisher(s):Morgan & Claypool
  • Place of Publication:San Rafael
  • Language:eng
  • Publication Date:©2010.

The Physical Object

  • Description:ix, 165 pages : : illustrations ; : 24 cm.

Edition Identifiers

  • ISBN:1608453421, 9781608453429, 9781608453436, 160845343X
  • oclc:ocn603068955
  • LC Classification:QA76.9.D3
  • Dewey Decimal:004

Table of Contents

1. Introduction -- Computing in the clouds -- Big ideas -- Why is this different -- What this book is not.

2. MapReduce basics -- Functional programming roots -- Mappers and reducers -- The execution framework -- Partitioners and combiners -- The distributed file system -- Hadoop cluster architecture -- Summary.

3. MapReduce algorithm design -- Local aggregation -- Combiners and in-mapper combining -- Algorithmic correctness with local aggregation -- Pairs and stripes -- Computing relative frequencies -- Secondary sorting -- Relational joins -- Reduce-side join -- Map-side join -- Memory-backed join -- Summary.

4. Inverted indexing for text retrieval -- Web crawling -- Inverted indexes -- Inverted indexing: baseline implementation -- Inverted indexing: revised implementation -- Index compression -- Byte-aligned and word-aligned codes -- Bit-aligned codes -- Postings compression -- What about retrieval -- Summary and additional readings.

5. Graph algorithms -- Graph representations -- Parallel breadth-first search -- PageRank -- Issues with graph processing -- Summary and additional readings.

6. EM algorithms for text processing -- Expectation maximization -- Maximum likelihoo…

Read More ↓

Subjects

Bases de données -- Gestion Cloud computing -- Programming Database management Electronic Data Processing Electronic data processing -- Distribut… Infonuagique -- Programmation Informatique Parallel processing (Electronic compute… Parallélisme (Informatique) -- Programm… Traitement réparti -- Programmation

Writers

Lin, Jimmy Dyer, Chris, (Christopher James)

More from this Series

Rate & Review

0.0/5
(0 people Voted)

No reviews yet. Be the first to rate this work.

Files & Downloads

No downloadable files are registered for this work yet.