Package | Description |
---|---|
org.apache.hadoop.examples |
Hadoop example code.
|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.fieldsel | |
org.apache.hadoop.mapreduce.lib.map | |
org.apache.hadoop.mapreduce.lib.reduce | |
org.apache.hadoop.mapreduce.task |
Modifier and Type | Class and Description |
---|---|
static class |
SecondarySort.Reduce
A reducer class that just emits the sum of the input values.
|
static class |
WordCount.IntSumReducer |
Modifier and Type | Method and Description |
---|---|
protected static <INKEY,INVALUE,OUTKEY,OUTVALUE> |
Task.createReduceContext(Reducer<INKEY,INVALUE,OUTKEY,OUTVALUE> reducer,
org.apache.hadoop.conf.Configuration job,
TaskAttemptID taskId,
RawKeyValueIterator rIter,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<OUTKEY,OUTVALUE> output,
OutputCommitter committer,
StatusReporter reporter,
org.apache.hadoop.io.RawComparator<INKEY> comparator,
java.lang.Class<INKEY> keyClass,
java.lang.Class<INVALUE> valueClass) |
Modifier and Type | Method and Description |
---|---|
java.lang.Class<? extends Reducer<?,?,?,?>> |
JobContext.getCombinerClass()
Get the combiner class for the job.
|
java.lang.Class<? extends Reducer<?,?,?,?>> |
JobContext.getReducerClass()
Get the
Reducer class for the job. |
Modifier and Type | Method and Description |
---|---|
void |
Job.setCombinerClass(java.lang.Class<? extends Reducer> cls)
Set the combiner class for the job.
|
void |
Job.setReducerClass(java.lang.Class<? extends Reducer> cls)
Set the
Reducer for the job. |
Modifier and Type | Class and Description |
---|---|
class |
FieldSelectionReducer<K,V>
This class implements a reducer class that can be used to perform field
selections in a manner similar to unix cut.
|
Modifier and Type | Method and Description |
---|---|
java.lang.Class<? extends Reducer<?,?,?,?>> |
WrappedMapper.Context.getCombinerClass() |
java.lang.Class<? extends Reducer<?,?,?,?>> |
WrappedMapper.Context.getReducerClass() |
Modifier and Type | Class and Description |
---|---|
class |
IntSumReducer<Key> |
class |
LongSumReducer<KEY> |
class |
WrappedReducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
A
Reducer which wraps a given one to allow for custom
Reducer.Context implementations. |
Modifier and Type | Method and Description |
---|---|
java.lang.Class<? extends Reducer<?,?,?,?>> |
WrappedReducer.Context.getCombinerClass() |
java.lang.Class<? extends Reducer<?,?,?,?>> |
WrappedReducer.Context.getReducerClass() |
Modifier and Type | Method and Description |
---|---|
java.lang.Class<? extends Reducer<?,?,?,?>> |
JobContextImpl.getCombinerClass()
Get the combiner class for the job.
|
java.lang.Class<? extends Reducer<?,?,?,?>> |
JobContextImpl.getReducerClass()
Get the
Reducer class for the job. |
Copyright © 2009 The Apache Software Foundation