com.senseidb.indexing.hadoop.reduce
Class SenseiCombiner

java.lang.Object
  org.apache.hadoop.mapred.MapReduceBase
      com.senseidb.indexing.hadoop.reduce.SenseiCombiner

All Implemented Interfaces:

Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Reducer<Shard,IntermediateForm,Shard,IntermediateForm>

public class SenseiCombiner
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Reducer<Shard,IntermediateForm,Shard,IntermediateForm>

This combiner combines multiple intermediate forms into one intermediate form. More specifically, the input intermediate forms are a single-document ram index and/or a single delete term. An output intermediate form contains a multi-document ram index and/or multiple delete terms.

Constructor Summary

SenseiCombiner()

Method Summary

void	close()
void	configure(org.apache.hadoop.mapred.JobConf job)
void	reduce(Shard key, Iterator<IntermediateForm> values, org.apache.hadoop.mapred.OutputCollector<Shard,IntermediateForm> output, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SenseiCombiner

public SenseiCombiner()

Method Detail

reduce

public void reduce(Shard key,
                   Iterator<IntermediateForm> values,
                   org.apache.hadoop.mapred.OutputCollector<Shard,IntermediateForm> output,
                   org.apache.hadoop.mapred.Reporter reporter)
            throws IOException

Specified by:

reduce in interface org.apache.hadoop.mapred.Reducer<Shard,IntermediateForm,Shard,IntermediateForm>

Throws:

IOException

configure

public void configure(org.apache.hadoop.mapred.JobConf job)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

Overrides:

configure in class org.apache.hadoop.mapred.MapReduceBase

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Overrides:

close in class org.apache.hadoop.mapred.MapReduceBase

Throws:

IOException