Package | Description |
---|---|
org.apache.hadoop.contrib.index.mapred | |
org.apache.hadoop.examples |
Hadoop example code.
|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapred.lib |
Library of generally useful mappers, reducers, and partitioners.
|
Modifier and Type | Class and Description |
---|---|
class |
IndexUpdatePartitioner
This partitioner class puts the values of the same key - in this case the
same shard - in the same partition.
|
Modifier and Type | Class and Description |
---|---|
class |
SleepJob
Dummy class for testing MR framefork.
|
Modifier and Type | Method and Description |
---|---|
java.lang.Class<? extends Partitioner> |
JobConf.getPartitionerClass()
|
Modifier and Type | Method and Description |
---|---|
static <K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable> |
MapFileOutputFormat.getEntry(org.apache.hadoop.io.MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
Modifier and Type | Method and Description |
---|---|
void |
JobConf.setPartitionerClass(java.lang.Class<? extends Partitioner> theClass)
|
Modifier and Type | Class and Description |
---|---|
class |
BinaryPartitioner<V>
Partition
BinaryComparable keys using a configurable part of
the bytes array returned by BinaryComparable.getBytes() . |
class |
HashPartitioner<K2,V2>
Partition keys by their
Object.hashCode() . |
class |
KeyFieldBasedPartitioner<K2,V2>
Defines a way to partition keys based on certain key fields (also see
KeyFieldBasedComparator . |
class |
TotalOrderPartitioner<K extends org.apache.hadoop.io.WritableComparable,V>
Partitioner effecting a total order by reading split points from
an externally generated source.
|
Copyright © 2009 The Apache Software Foundation