ivory.bloomir.data

Class CompressedPostingsIO

java.lang.Object

ivory.bloomir.data.CompressedPostingsIO

public class CompressedPostingsIO
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static String	LENGTH_FILE

Constructor Summary

Constructors

Constructor and Description
CompressedPostingsIO()

Method Summary

Methods

Modifier and Type	Method and Description
static void	loadPostings(String path, FileSystem fs, CompressedPostings[] postings, int[] dfs) Loads an entire collection of postings lists and initializes the given ranker with this collection.
static int	readNumberOfTerms(String path, FileSystem fs) Reads the number of terms from an index
static void	writePostings(String outputPath, FileSystem fs, RetrievalEnvironment env, String spamScoresPath) Converts the postings of a collection into CompressedPostings and writes them to disk.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LENGTH_FILE

public static final String LENGTH_FILE

See Also:

Constant Field Values

Constructor Detail

CompressedPostingsIO

public CompressedPostingsIO()

Method Detail

loadPostings

public static void loadPostings(String path,
                FileSystem fs,
                CompressedPostings[] postings,
                int[] dfs)
                         throws IOException,
                                ClassNotFoundException

Loads an entire collection of postings lists and initializes the given ranker with this collection.

Parameters:

path - Path to the root of the postings list

fs - File system

postings - Array of CompressedPostings to initialize

dfs - Array of integers to be initialized (this represents Document Frequencies)

Throws:

IOException

ClassNotFoundException

readNumberOfTerms

public static int readNumberOfTerms(String path,
                    FileSystem fs)
                             throws IOException,
                                    ClassNotFoundException

Reads the number of terms from an index

Parameters:

path - Path to the root of the postings list

fs - File system

Returns:

Number of terms in the index (i.e., number of postings lists)

Throws:

IOException

ClassNotFoundException

writePostings

public static void writePostings(String outputPath,
                 FileSystem fs,
                 RetrievalEnvironment env,
                 String spamScoresPath)
                          throws IOException

Converts the postings of a collection into CompressedPostings and writes them to disk.

Parameters:

outputPath - Root path to store the output in

fs - File system

env - A retrieval environment

spamScoresPath - Path to spam/quality scores

Throws:

IOException