A C D E F G H I J K L M N O P Q R S T U W

A

accept(Path) - Method in class com.senseidb.indexing.hadoop.util.LuceneIndexFileNameFilter

C

CACHE_ARCHIVES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_ARCHIVES_SIZES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_ARCHIVES_TIMESTAMPS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_ARCHIVES_VISIBILITIES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_FILE_TIMESTAMPS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_FILE_VISIBILITIES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_FILES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_FILES_SIZES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_LOCALARCHIVES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_LOCALFILES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CACHE_SYMLINK - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

caculateShard(int, JSONObject) - Method in class com.senseidb.indexing.hadoop.map.DummyShardingStrategy

CLASSPATH_ARCHIVES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

CLASSPATH_FILES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

close() - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

close() - Method in class com.senseidb.indexing.hadoop.reduce.SenseiCombiner

close() - Method in class com.senseidb.indexing.hadoop.reduce.SenseiReducer

close() - Method in class com.senseidb.indexing.hadoop.reduce.ShardWriter

Close the shard writer.

closeWriter() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

Close the Lucene index writer associated with the intermediate form, if created.

com.senseidb.indexing.hadoop.job - package com.senseidb.indexing.hadoop.job

com.senseidb.indexing.hadoop.keyvalueformat - package com.senseidb.indexing.hadoop.keyvalueformat

com.senseidb.indexing.hadoop.map - package com.senseidb.indexing.hadoop.map

com.senseidb.indexing.hadoop.reduce - package com.senseidb.indexing.hadoop.reduce

com.senseidb.indexing.hadoop.util - package com.senseidb.indexing.hadoop.util

COMBINE_CLASS_ATTR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COMBINE_RECORDS_BEFORE_PROGRESS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

compareTo(Object) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

compareTo(Shard) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Compare to another shard.

COMPLETED_MAPS_FOR_REDUCE_SLOWSTART - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

configure(Configuration) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

Configure using an index update configuration.

configure(JobConf) - Method in class com.senseidb.indexing.hadoop.map.SenseiMapper

configure(JobConf) - Method in class com.senseidb.indexing.hadoop.reduce.SenseiCombiner

configure(JobConf) - Method in class com.senseidb.indexing.hadoop.reduce.SenseiReducer

COUNTER_GROUP_NAME_MAX_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTER_GROUP_NAME_MAX_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTER_GROUPS_MAX_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTER_GROUPS_MAX_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTER_NAME_MAX_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTER_NAME_MAX_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTERS_MAX_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

COUNTERS_MAX_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

createJob(Class) - Method in class com.senseidb.indexing.hadoop.job.MapReduceJob

createOutput(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

D

DELEGATION_KEY_UPDATE_INTERVAL_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

DELEGATION_KEY_UPDATE_INTERVAL_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

DELEGATION_TOKEN_MAX_LIFETIME_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

DELEGATION_TOKEN_RENEW_INTERVAL_DEFAULT - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

DELEGATION_TOKEN_RENEW_INTERVAL_KEY - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

deleteFile(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

DISTRIBUTION_POLICY - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

DOCUMENT_ANALYZER - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

DOCUMENT_ANALYZER_VERSION - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

doFilter(JSONObject) - Method in class com.senseidb.indexing.hadoop.map.DummyMapInputConverter

doFilter(JSONObject) - Method in class com.senseidb.indexing.hadoop.map.MapInputConverter

DummyMapInputConverter - Class in com.senseidb.indexing.hadoop.map

DummyMapInputConverter() - Constructor for class com.senseidb.indexing.hadoop.map.DummyMapInputConverter

DummyShardingStrategy - Class in com.senseidb.indexing.hadoop.map

DummyShardingStrategy() - Constructor for class com.senseidb.indexing.hadoop.map.DummyShardingStrategy

E

END_NOTIFICATION_RETRIE_INTERVAL - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

END_NOTIFICATION_RETRIES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

END_NOTIFICATION_URL - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

equals(Object) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

F

fileExists(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

fileLength(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

fileModified(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

FileSystemDirectory - Class in com.senseidb.indexing.hadoop.reduce

This class implements a Lucene Directory on top of a general FileSystem.

FileSystemDirectory(FileSystem, Path, boolean, Configuration) - Constructor for class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

Constructor

FORCE_OUTPUT_OVERWRITE - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

FRAMEWORK_NAME - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

fromBytes(byte[]) - Static method in class org.apache.lucene.store.RAMDirectorySerializer

fromDataInput(DataInput) - Static method in class org.apache.lucene.store.RAMDirectorySerializer

G

generationFromSegmentsFileName(String) - Static method in class com.senseidb.indexing.hadoop.util.LuceneUtil

Parse the generation off the segments file name and return it.

getCurrentSegmentGeneration(Directory) - Static method in class com.senseidb.indexing.hadoop.util.LuceneUtil

Get the generation (N) of the current segments_N file in the directory.

getCurrentSegmentGeneration(String[]) - Static method in class com.senseidb.indexing.hadoop.util.LuceneUtil

Get the generation (N) of the current segments_N file from a list of files.

getDirectory() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

Get the ram directory of the intermediate form.

getDirectory() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Get the directory where this shard resides.

getFilter() - Static method in class com.senseidb.indexing.hadoop.util.LuceneIndexFileNameFilter

Get a static instance.

getGeneration() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Get the generation of the Lucene instance.

getIndexShards(Configuration) - Static method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

getJsonInput(Object, Object, Configuration) - Method in class com.senseidb.indexing.hadoop.map.DummyMapInputConverter

getJsonInput(Object, Object, Configuration) - Method in class com.senseidb.indexing.hadoop.map.MapInputConverter

getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class com.senseidb.indexing.hadoop.reduce.IndexUpdateOutputFormat

getVersion() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Get the version number of the entire index.

GROUP_COMPARATOR_CLASS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

H

hashCode() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

I

ID - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

INDEX_CACHE_MEMORY_LIMIT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

INDEX_PATH - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

INDEX_SHARDS - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

IndexUpdateOutputFormat - Class in com.senseidb.indexing.hadoop.reduce

The record writer of this output format simply puts a message in an output path when a shard update is done.

IndexUpdateOutputFormat() - Constructor for class com.senseidb.indexing.hadoop.reduce.IndexUpdateOutputFormat

INPUT_DIRS - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

INPUT_FORMAT - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

INPUT_FORMAT_CLASS_ATTR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

IntermediateForm - Class in com.senseidb.indexing.hadoop.keyvalueformat

An intermediate form for one or more parsed Lucene documents and/or delete terms.

IntermediateForm() - Constructor for class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

Constructor

IO_SORT_FACTOR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

IO_SORT_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

isSegmentsFile(String) - Static method in class com.senseidb.indexing.hadoop.util.LuceneUtil

Check if the file is a segments_N file

isSegmentsGenFile(String) - Static method in class com.senseidb.indexing.hadoop.util.LuceneUtil

Check if the file is the segments.gen file

J

JAR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JAR_UNPACK_PATTERN - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_ACL_MODIFY_JOB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_ACL_VIEW_JOB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_CANCEL_DELEGATION_TOKEN - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_JOBTRACKER_ID - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_LOCAL_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_NAME - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_NAMENODES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_SUBMITHOST - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JOB_SUBMITHOSTADDR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

JVM_NUMTASKS_TORUN - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

K

KEY_COMPARATOR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

L

listAll() - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

loadProperties(Configuration, Properties) - Static method in class com.senseidb.indexing.hadoop.util.PropertiesLoader

loadProperties(String) - Static method in class com.senseidb.indexing.hadoop.util.PropertiesLoader

LOCAL_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

LuceneIndexFileNameFilter - Class in com.senseidb.indexing.hadoop.util

A wrapper class to convert an IndexFileNameFilter which implements java.io.FilenameFilter to an org.apache.hadoop.fs.PathFilter.

LuceneUtil - Class in com.senseidb.indexing.hadoop.util

This class copies some methods from Lucene's SegmentInfos since that class is not public.

LuceneUtil() - Constructor for class com.senseidb.indexing.hadoop.util.LuceneUtil

LuceneUtil.IndexFileNames - Class in com.senseidb.indexing.hadoop.util

LuceneUtil.IndexFileNames() - Constructor for class com.senseidb.indexing.hadoop.util.LuceneUtil.IndexFileNames

M

main(String[]) - Static method in class org.apache.lucene.store.RAMDirectorySerializer

main(String[]) - Static method in class org.apache.lucene.store.TestRAMDirectorySerializer

makeLock(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

map(Object, Object, OutputCollector<Shard, IntermediateForm>, Reporter) - Method in class com.senseidb.indexing.hadoop.map.SenseiMapper

MAP_CLASS_ATTR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_COMBINE_MIN_SPILLS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_DEBUG_SCRIPT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_ENV - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_FAILURES_MAX_PERCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_INPUT_FILE - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_INPUT_PATH - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_INPUT_START - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_JAVA_OPTS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_LOG_LEVEL - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_MAX_ATTEMPTS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_MEMORY_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_MEMORY_PHYSICAL_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_OUTPUT_COMPRESS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_OUTPUT_COMPRESS_CODEC - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_OUTPUT_KEY_CLASS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_OUTPUT_KEY_FIELD_SEPERATOR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_OUTPUT_VALUE_CLASS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_SKIP_INCR_PROC_COUNT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_SKIP_MAX_RECORDS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_SORT_SPILL_PERCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_SPECULATIVE - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAP_ULIMIT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

MAPINPUT_CONVERTER - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

MapInputConverter - Class in com.senseidb.indexing.hadoop.map

MapInputConverter() - Constructor for class com.senseidb.indexing.hadoop.map.MapInputConverter

MAPMEMORY_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

MapReduceJob - Class in com.senseidb.indexing.hadoop.job

MapReduceJob() - Constructor for class com.senseidb.indexing.hadoop.job.MapReduceJob

MAX_FIELD_LENGTH - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

MAX_NUM_SEGMENTS - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

MAX_RAMSIZE_BYTES - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

MAX_TASK_FAILURES_PER_TRACKER - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

moveToTrash(Configuration, Path) - Static method in class com.senseidb.indexing.hadoop.reduce.ShardWriter

MR_ACLS_ENABLED - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

MR_ADMINS - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

MR_SUPERGROUP - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

Deprecated.

MRConfig - Interface in com.senseidb.indexing.hadoop.util

MRJobConfig - Interface in com.senseidb.indexing.hadoop.util

N

normalizePath(String) - Static method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

NUM_MAP_PROFILES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

NUM_MAPS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

NUM_REDUCE_PROFILES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

NUM_REDUCES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

NUM_SHARDS - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

O

openInput(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

openInput(String, int) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

optimize() - Method in class com.senseidb.indexing.hadoop.reduce.ShardWriter

org.apache.lucene.store - package org.apache.lucene.store

OUTPUT_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

OUTPUT_FORMAT_CLASS_ATTR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

OUTPUT_KEY_CLASS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

OUTPUT_VALUE_CLASS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

P

PARTITIONER_CLASS_ATTR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

PRESERVE_FAILED_TASK_FILES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

PRESERVE_FILES_PATTERN - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

PRIORITY - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

process(Document, Analyzer) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

This method is used by the index update mapper and process a document operation into the current intermediate form.

process(IntermediateForm) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

This method is used by the index update combiner and process an intermediate form into the current intermediate form.

process(IntermediateForm) - Method in class com.senseidb.indexing.hadoop.reduce.ShardWriter

Process an intermediate form by carrying out, on the Lucene instance of the shard, the deletes and the inserts (a ram index) in the form.

PropertiesLoader - Class in com.senseidb.indexing.hadoop.util

PropertiesLoader() - Constructor for class com.senseidb.indexing.hadoop.util.PropertiesLoader

Q

QUEUE_NAME - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

R

RAMDirectorySerializer - Class in org.apache.lucene.store

RAMDirectorySerializer() - Constructor for class org.apache.lucene.store.RAMDirectorySerializer

RAMDirectoryUtil - Class in com.senseidb.indexing.hadoop.reduce

A utility class which writes an index in a ram dir into a DataOutput and read from a DataInput an index into a ram dir.

RAMDirectoryUtil() - Constructor for class com.senseidb.indexing.hadoop.reduce.RAMDirectoryUtil

readFields(DataInput) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

readFields(DataInput) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

readRAMFiles(DataInput, RAMDirectory) - Static method in class com.senseidb.indexing.hadoop.reduce.RAMDirectoryUtil

Read a number of files from a data input to a ram directory.

RECORDS_BEFORE_PROGRESS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

reduce(Shard, Iterator<IntermediateForm>, OutputCollector<Shard, IntermediateForm>, Reporter) - Method in class com.senseidb.indexing.hadoop.reduce.SenseiCombiner

reduce(Shard, Iterator<IntermediateForm>, OutputCollector<Shard, Text>, Reporter) - Method in class com.senseidb.indexing.hadoop.reduce.SenseiReducer

REDUCE_CLASS_ATTR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_DEBUG_SCRIPT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_ENV - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_FAILURES_MAXPERCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_INPUT_BUFFER_PERCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_JAVA_OPTS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_LOG_LEVEL - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MARKRESET_BUFFER_PERCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MARKRESET_BUFFER_SIZE - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MAX_ATTEMPTS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MEMORY_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MEMORY_PHYSICAL_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MEMORY_TOTAL_BYTES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MEMTOMEM_ENABLED - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MEMTOMEM_THRESHOLD - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_MERGE_INMEM_THRESHOLD - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_SKIP_INCR_PROC_COUNT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_SKIP_MAXGROUPS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_SPECULATIVE - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCE_ULIMIT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

REDUCEMEMORY_MB - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

renameFile(String, String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

S

SCHEMA_FILE_URL - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

SEGMENTS - Static variable in class com.senseidb.indexing.hadoop.util.LuceneUtil.IndexFileNames

Name of the index segment file

SEGMENTS_GEN - Static variable in class com.senseidb.indexing.hadoop.util.LuceneUtil.IndexFileNames

Name of the generation reference file name

SenseiCombiner - Class in com.senseidb.indexing.hadoop.reduce

This combiner combines multiple intermediate forms into one intermediate form.

SenseiCombiner() - Constructor for class com.senseidb.indexing.hadoop.reduce.SenseiCombiner

SenseiJobConfig - Interface in com.senseidb.indexing.hadoop.util

SenseiMapper - Class in com.senseidb.indexing.hadoop.map

SenseiMapper() - Constructor for class com.senseidb.indexing.hadoop.map.SenseiMapper

SenseiReducer - Class in com.senseidb.indexing.hadoop.reduce

SenseiReducer() - Constructor for class com.senseidb.indexing.hadoop.reduce.SenseiReducer

setIndexShards(Configuration, Shard[]) - Static method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

SETUP_CLEANUP_NEEDED - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

Shard - Class in com.senseidb.indexing.hadoop.keyvalueformat

This class represents the metadata of a shard.

Shard() - Constructor for class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Constructor.

Shard(long, String, long) - Constructor for class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Construct a shard from a versio number, a directory and a generation number.

Shard(Shard) - Constructor for class com.senseidb.indexing.hadoop.keyvalueformat.Shard

Construct using a shard object.

ShardWriter - Class in com.senseidb.indexing.hadoop.reduce

The initial version of an index is stored in the perm dir.

ShardWriter(FileSystem, Shard, String, Configuration) - Constructor for class com.senseidb.indexing.hadoop.reduce.ShardWriter

Constructor

SHUFFLE_CONNECT_TIMEOUT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SHUFFLE_FETCH_FAILURES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SHUFFLE_INPUT_BUFFER_PERCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SHUFFLE_MERGE_EPRCENT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SHUFFLE_NOTIFY_READERROR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SHUFFLE_PARALLEL_COPIES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SHUFFLE_READ_TIMEOUT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SKIP_OUTDIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SKIP_RECORDS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SKIP_START_ATTEMPTS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SPECULATIVE_SLOWNODE_THRESHOLD - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SPECULATIVE_SLOWTASK_THRESHOLD - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SPECULATIVECAP - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

SPLIT_FILE - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

T

TASK_ATTEMPT_ID - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_CLEANUP_NEEDED - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_DEBUGOUT_LINES - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_ID - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_ISMAP - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_LOCAL_OUTPUT_CLASS - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

TASK_OUTPUT_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_PARTITION - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_PROFILE - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_PROFILE_PARAMS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_TEMP_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_TIMEOUT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TASK_USERLOG_LIMIT - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

TEMP_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRConfig

TestRAMDirectorySerializer - Class in org.apache.lucene.store

TestRAMDirectorySerializer() - Constructor for class org.apache.lucene.store.TestRAMDirectorySerializer

toBytes(RAMDirectory) - Static method in class org.apache.lucene.store.RAMDirectorySerializer

toDataOutput(DataOutput, RAMDirectory) - Static method in class org.apache.lucene.store.RAMDirectorySerializer

toFlatString() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

toString() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

toString() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

toString() - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

toString() - Method in class com.senseidb.indexing.hadoop.reduce.ShardWriter

totalSizeInBytes() - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

The total size of files in the directory and ram used by the index writer.

touchFile(String) - Method in class com.senseidb.indexing.hadoop.reduce.FileSystemDirectory

U

USE_COMPOUND_FILE - Static variable in interface com.senseidb.indexing.hadoop.util.SenseiJobConfig

USER_LOG_RETAIN_HOURS - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

USER_NAME - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

W

WORKING_DIR - Static variable in interface com.senseidb.indexing.hadoop.util.MRJobConfig

write(DataOutput) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.IntermediateForm

write(DataOutput) - Method in class com.senseidb.indexing.hadoop.keyvalueformat.Shard

writeRAMFiles(DataOutput, RAMDirectory, String[]) - Static method in class com.senseidb.indexing.hadoop.reduce.RAMDirectoryUtil

Write a number of files from a ram directory to a data output.

A C D E F G H I J K L M N O P Q R S T U W