ivory.core.tokenize

Class DocumentProcessingUtils

java.lang.Object

ivory.core.tokenize.DocumentProcessingUtils

public class DocumentProcessingUtils
extends Object

Author:

Tamer Elsayed, Jimmy Lin

Field Summary

Fields

Modifier and Type	Field and Description
static short	TF_CUT

Constructor Summary

Constructors

Constructor and Description
DocumentProcessingUtils()

Method Summary

Methods

Modifier and Type	Method and Description
static SortedMap<Integer,int[]>	integerizeTermDocVector(TermDocVector doc, Dictionary termIDMap)
static Map<String,ArrayListOfInts>	parseDocument(Indexable doc, Tokenizer tokenizer)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TF_CUT

public static short TF_CUT

Constructor Detail

DocumentProcessingUtils

public DocumentProcessingUtils()

Method Detail

integerizeTermDocVector

public static SortedMap<Integer,int[]> integerizeTermDocVector(TermDocVector doc,
                                               Dictionary termIDMap)

parseDocument

public static Map<String,ArrayListOfInts> parseDocument(Indexable doc,
                                        Tokenizer tokenizer)