public class FileOutputCommitter extends OutputCommitter
OutputCommitter
that commits files specified
in job output directory i.e. ${mapred.output.dir}.Modifier and Type | Field and Description |
---|---|
static org.apache.commons.logging.Log |
LOG |
static java.lang.String |
SUCCEEDED_FILE_NAME |
static java.lang.String |
TEMP_DIR_NAME
Temporary directory name
|
Constructor and Description |
---|
FileOutputCommitter() |
Modifier and Type | Method and Description |
---|---|
void |
abortJob(JobContext context,
int runState)
Delete the temporary directory, including all of the work directories.
|
void |
abortTask(TaskAttemptContext context)
Discard the task output
|
void |
cleanupJob(JobContext context)
Deprecated.
|
void |
commitJob(JobContext context)
For committing job's output after successful job completion.
|
void |
commitTask(TaskAttemptContext context)
To promote the task's temporary output to final output location
The task's output is moved to the job's output directory.
|
boolean |
needsTaskCommit(TaskAttemptContext context)
Check whether task needs a commit
|
void |
setupJob(JobContext context)
For the framework to setup the job output during initialization
|
void |
setupTask(TaskAttemptContext context)
Sets up output for the task.
|
abortJob, abortTask, cleanupJob, commitJob, commitTask, needsTaskCommit, setupJob, setupTask
public static final org.apache.commons.logging.Log LOG
public static final java.lang.String TEMP_DIR_NAME
public static final java.lang.String SUCCEEDED_FILE_NAME
public void setupJob(JobContext context) throws java.io.IOException
OutputCommitter
setupJob
in class OutputCommitter
context
- Context of the job whose output is being written.java.io.IOException
- if temporary output could not be createdpublic void commitJob(JobContext context) throws java.io.IOException
OutputCommitter
JobStatus.SUCCEEDED
.commitJob
in class OutputCommitter
context
- Context of the job whose output is being written.java.io.IOException
@Deprecated public void cleanupJob(JobContext context) throws java.io.IOException
OutputCommitter
cleanupJob
in class OutputCommitter
java.io.IOException
public void abortJob(JobContext context, int runState) throws java.io.IOException
abortJob
in class OutputCommitter
context
- the job's contextrunState
- final run state of the job, should be
JobStatus.KILLED
or JobStatus.FAILED
java.io.IOException
public void setupTask(TaskAttemptContext context) throws java.io.IOException
OutputCommitter
setupTask
in class OutputCommitter
context
- Context of the task whose output is being written.java.io.IOException
public void commitTask(TaskAttemptContext context) throws java.io.IOException
OutputCommitter
commitTask
in class OutputCommitter
context
- Context of the task whose output is being written.java.io.IOException
- if commit is notpublic void abortTask(TaskAttemptContext context) throws java.io.IOException
OutputCommitter
abortTask
in class OutputCommitter
java.io.IOException
public boolean needsTaskCommit(TaskAttemptContext context) throws java.io.IOException
OutputCommitter
needsTaskCommit
in class OutputCommitter
java.io.IOException
Copyright © 2009 The Apache Software Foundation