Package | Description |
---|---|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapreduce.task |
Modifier and Type | Class and Description |
---|---|
protected class |
MapTask.MapOutputBuffer.MRResultIterator |
Modifier and Type | Method and Description |
---|---|
RawKeyValueIterator |
ReduceTask.ReduceCopier.createKVIterator()
Create a RawKeyValueIterator from copied map outputs.
|
RawKeyValueIterator |
ShuffleConsumerPlugin.createKVIterator()
To create a key-value iterator to read the merged output.
|
Modifier and Type | Method and Description |
---|---|
abstract void |
Task.CombinerRunner.combine(RawKeyValueIterator iterator,
OutputCollector<K,V> collector)
Run the combiner over a set of inputs.
|
void |
Task.OldCombinerRunner.combine(RawKeyValueIterator kvIter,
OutputCollector<K,V> combineCollector) |
void |
Task.NewCombinerRunner.combine(RawKeyValueIterator iterator,
OutputCollector<K,V> collector) |
protected static <INKEY,INVALUE,OUTKEY,OUTVALUE> |
Task.createReduceContext(Reducer<INKEY,INVALUE,OUTKEY,OUTVALUE> reducer,
org.apache.hadoop.conf.Configuration job,
TaskAttemptID taskId,
RawKeyValueIterator rIter,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<OUTKEY,OUTVALUE> output,
OutputCommitter committer,
StatusReporter reporter,
org.apache.hadoop.io.RawComparator<INKEY> comparator,
java.lang.Class<INKEY> keyClass,
java.lang.Class<INVALUE> valueClass) |
Constructor and Description |
---|
Task.CombineValuesIterator(RawKeyValueIterator in,
org.apache.hadoop.io.RawComparator<KEY> comparator,
java.lang.Class<KEY> keyClass,
java.lang.Class<VALUE> valClass,
org.apache.hadoop.conf.Configuration conf,
Reporter reporter,
Counters.Counter combineInputCounter) |
Constructor and Description |
---|
ReduceContextImpl(org.apache.hadoop.conf.Configuration conf,
TaskAttemptID taskid,
RawKeyValueIterator input,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<KEYOUT,VALUEOUT> output,
OutputCommitter committer,
StatusReporter reporter,
org.apache.hadoop.io.RawComparator<KEYIN> comparator,
java.lang.Class<KEYIN> keyClass,
java.lang.Class<VALUEIN> valueClass) |
Copyright © 2009 The Apache Software Foundation