ivory.lsh.projection

Class ComputeSignaturesSimhash.MyMapper

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

ivory.lsh.projection.ComputeSignaturesSimhash.MyMapper

All Implemented Interfaces:

Closeable, AutoCloseable, JobConfigurable, Mapper<IntWritable,HMapSFW,IntWritable,SixtyFourBitSignature>

Enclosing class:

ComputeSignaturesSimhash

public static class ComputeSignaturesSimhash.MyMapper
extends MapReduceBase
implements Mapper<IntWritable,HMapSFW,IntWritable,SixtyFourBitSignature>

Simhash implementation, as explained in Manku et al's Detecting near-duplicates for web crawling (WWW07)

Author:

ferhanture

Constructor Summary

Constructors

Constructor and Description
ComputeSignaturesSimhash.MyMapper()

Method Summary

Methods

Modifier and Type	Method and Description
void	configure(JobConf job)
void	map(IntWritable docno, HMapSFW docvector, OutputCollector<IntWritable,SixtyFourBitSignature> output, Reporter reporter)

Methods inherited from class org.apache.hadoop.mapred.MapReduceBase

close

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Constructor Detail

ComputeSignaturesSimhash.MyMapper

public ComputeSignaturesSimhash.MyMapper()

Method Detail

configure

public void configure(JobConf job)

Specified by:

configure in interface JobConfigurable

Overrides:

configure in class MapReduceBase

map

public void map(IntWritable docno,
       HMapSFW docvector,
       OutputCollector<IntWritable,SixtyFourBitSignature> output,
       Reporter reporter)
         throws IOException

Specified by:

map in interface Mapper<IntWritable,HMapSFW,IntWritable,SixtyFourBitSignature>

Throws:

IOException