Cloud⁹

Getting Started

• Word count tutorial

Text Collections

• Guide to working with Wikipedia

Exercises

• Bigram counts
• Inverted indexing
• Boolean retrieval
• PageRank

Reference Implementations

Cloud⁹ provides reference implementations of many design patterns and algorithms introduced in the book Data-Intensive Text Processing with MapReduce by Lin and Dyer. Some of these examples are also solutions to exercises included with the library, which have been previously used in MapReduce courses at the University of Maryland.

• Order inversion design pattern for computing relative frequencies (Chapter 3)
• Pairs and stripes design pattern for computing term co-occurrences (Chapter 3)
• Inverted indexing is covered in this exercise (Chapter 4)
• Parallel breadth-first search (Chapter 5)
• PageRank and design patterns for efficient graph algorithms (partially covered in Chapter 5)