public class CombineFileSplit extends InputSplit implements org.apache.hadoop.io.Writable
FileSplit
, CombineFileSplit class does not represent
a split of a file, but a split of input files into smaller sets.
A split may contain blocks from different file but all
the blocks in the same split are probably local to some rack RecordReader
's,
with reading one record per file.FileSplit
,
CombineFileInputFormat
Constructor and Description |
---|
CombineFileSplit()
default constructor
|
CombineFileSplit(CombineFileSplit old)
Copy constructor
|
CombineFileSplit(org.apache.hadoop.fs.Path[] files,
long[] lengths) |
CombineFileSplit(org.apache.hadoop.fs.Path[] files,
long[] start,
long[] lengths,
java.lang.String[] locations) |
Modifier and Type | Method and Description |
---|---|
long |
getLength()
Get the size of the split, so that the input splits can be sorted by size.
|
long |
getLength(int i)
Returns the length of the ith Path
|
long[] |
getLengths()
Returns an array containing the lengths of the files in the split
|
java.lang.String[] |
getLocations()
Returns all the Paths where this input-split resides
|
int |
getNumPaths()
Returns the number of Paths in the split
|
long |
getOffset(int i)
Returns the start offset of the ith Path
|
org.apache.hadoop.fs.Path |
getPath(int i)
Returns the ith Path
|
org.apache.hadoop.fs.Path[] |
getPaths()
Returns all the Paths in the split
|
long[] |
getStartOffsets()
Returns an array containing the start offsets of the files in the split
|
void |
readFields(java.io.DataInput in) |
java.lang.String |
toString() |
void |
write(java.io.DataOutput out) |
public CombineFileSplit()
public CombineFileSplit(org.apache.hadoop.fs.Path[] files, long[] start, long[] lengths, java.lang.String[] locations)
public CombineFileSplit(org.apache.hadoop.fs.Path[] files, long[] lengths)
public CombineFileSplit(CombineFileSplit old) throws java.io.IOException
java.io.IOException
public long getLength()
InputSplit
getLength
in class InputSplit
public long[] getStartOffsets()
public long[] getLengths()
public long getOffset(int i)
public long getLength(int i)
public int getNumPaths()
public org.apache.hadoop.fs.Path getPath(int i)
public org.apache.hadoop.fs.Path[] getPaths()
public java.lang.String[] getLocations() throws java.io.IOException
getLocations
in class InputSplit
java.io.IOException
public void readFields(java.io.DataInput in) throws java.io.IOException
readFields
in interface org.apache.hadoop.io.Writable
java.io.IOException
public void write(java.io.DataOutput out) throws java.io.IOException
write
in interface org.apache.hadoop.io.Writable
java.io.IOException
public java.lang.String toString()
toString
in class java.lang.Object
Copyright © 2009 The Apache Software Foundation