public class SequenceFileInputFilter<K,V> extends SequenceFileInputFormat<K,V>
Modifier and Type | Class and Description |
---|---|
static interface |
SequenceFileInputFilter.Filter
filter interface
|
static class |
SequenceFileInputFilter.FilterBase
base class for Filters
|
static class |
SequenceFileInputFilter.MD5Filter
This class returns a set of records by examing the MD5 digest of its
key against a filtering frequency f.
|
static class |
SequenceFileInputFilter.PercentFilter
This class returns a percentage of records
The percentage is determined by a filtering frequency f using
the criteria record# % f == 0.
|
static class |
SequenceFileInputFilter.RegexFilter
Records filter by matching key to regex
|
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
FILTER_CLASS |
static java.lang.String |
FILTER_FREQUENCY |
static java.lang.String |
FILTER_REGEX |
static org.apache.commons.logging.Log |
LOG |
Constructor and Description |
---|
SequenceFileInputFilter() |
Modifier and Type | Method and Description |
---|---|
RecordReader<K,V> |
createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for the given split
|
static void |
setFilterClass(Job job,
java.lang.Class<?> filterClass)
set the filter class
|
getFormatMinSplitSize, listStatus
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, isSplitable, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
public static final org.apache.commons.logging.Log LOG
public static final java.lang.String FILTER_CLASS
public static final java.lang.String FILTER_FREQUENCY
public static final java.lang.String FILTER_REGEX
public RecordReader<K,V> createRecordReader(InputSplit split, TaskAttemptContext context) throws java.io.IOException
createRecordReader
in class SequenceFileInputFormat<K,V>
split
- file splitcontext
- the task-attempt contextjava.io.IOException
public static void setFilterClass(Job job, java.lang.Class<?> filterClass)
job
- The jobfilterClass
- filter classCopyright © 2009 The Apache Software Foundation