Package | Description |
---|---|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapred.jobcontrol |
Utilities for managing dependent jobs.
|
org.apache.hadoop.streaming |
Hadoop Streaming is a utility which allows users to create and run
Map-Reduce jobs with any executables (e.g.
|
Modifier and Type | Method and Description |
---|---|
static JobID |
JobID.downgrade(JobID old)
Downgrade a new JobID to an old one
|
static JobID |
JobID.forName(java.lang.String str)
Construct a JobId object from given string
|
JobID |
RunningJob.getID()
Get the job identifier.
|
JobID |
TaskAttemptID.getJobID() |
JobID |
Task.getJobID()
Get the job name for this task.
|
JobID |
TaskID.getJobID() |
JobID |
JobInProgress.getJobID() |
JobID |
JobStatus.getJobID() |
JobID |
JobProfile.getJobID()
Get the job id.
|
JobID |
JobTracker.getNewJobId()
Allocates a new JobId string.
|
JobID |
LocalJobRunner.getNewJobId() |
static JobID |
JobID.read(java.io.DataInput in)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
void |
JobClient.displayTasks(JobID jobId,
java.lang.String type,
java.lang.String state)
Display the information about a job's tasks, of a particular type and
in a particular state
|
TaskReport[] |
JobTracker.getCleanupTaskReports(JobID jobid) |
TaskReport[] |
JobClient.getCleanupTaskReports(JobID jobId)
Get the information of the current state of the cleanup tasks of a job.
|
TaskReport[] |
LocalJobRunner.getCleanupTaskReports(JobID id) |
static java.lang.String |
JobHistory.getHistoryFilePath(JobID jobId)
Given the job id, return the history file path from the cache
|
JobInProgress |
JobTracker.getJob(JobID jobid) |
RunningJob |
JobClient.getJob(JobID jobid)
Get an
RunningJob object to track an ongoing job. |
JobConf |
TaskTracker.getJobConf(JobID jobId)
Get the specific job conf for a running job.
|
Counters |
JobTracker.getJobCounters(JobID jobid) |
Counters |
LocalJobRunner.getJobCounters(JobID id) |
static java.lang.String |
JobHistory.JobInfo.getJobHistoryFileName(JobConf jobConf,
JobID id)
Recover the job history filename from the history folder.
|
JobProfile |
JobTracker.getJobProfile(JobID jobid) |
JobProfile |
LocalJobRunner.getJobProfile(JobID id) |
JobStatus |
JobTracker.getJobStatus(JobID jobid) |
JobStatus |
LocalJobRunner.getJobStatus(JobID id) |
static java.lang.String |
JobHistory.JobInfo.getLocalJobFilePath(JobID jobId)
Get the path of the locally stored job file
|
static java.lang.String |
JobTracker.getLocalJobFilePath(JobID jobId)
Get the localized job file path on the job trackers local file system
|
MapTaskCompletionEventsUpdate |
TaskTracker.getMapCompletionEvents(JobID jobId,
int fromEventId,
int maxLocs,
TaskAttemptID id,
org.apache.hadoop.mapred.JvmContext jvmContext) |
MapTaskCompletionEventsUpdate |
TaskUmbilicalProtocol.getMapCompletionEvents(JobID jobId,
int fromIndex,
int maxLocs,
TaskAttemptID id,
org.apache.hadoop.mapred.JvmContext jvmContext)
Called by a reduce task to get the map output locations for finished maps.
|
TaskReport[] |
JobTracker.getMapTaskReports(JobID jobid) |
TaskReport[] |
JobClient.getMapTaskReports(JobID jobId)
Get the information of the current state of the map tasks of a job.
|
TaskReport[] |
LocalJobRunner.getMapTaskReports(JobID id) |
TaskReport[] |
JobTracker.getReduceTaskReports(JobID jobid) |
TaskReport[] |
JobClient.getReduceTaskReports(JobID jobId)
Get the information of the current state of the reduce tasks of a job.
|
TaskReport[] |
LocalJobRunner.getReduceTaskReports(JobID id) |
TaskReport[] |
JobTracker.getSetupTaskReports(JobID jobid) |
TaskReport[] |
JobClient.getSetupTaskReports(JobID jobId)
Get the information of the current state of the setup tasks of a job.
|
TaskReport[] |
LocalJobRunner.getSetupTaskReports(JobID id) |
TaskCompletionEvent[] |
JobTracker.getTaskCompletionEvents(JobID jobid,
int fromEventId,
int maxEvents) |
TaskCompletionEvent[] |
LocalJobRunner.getTaskCompletionEvents(JobID jobid,
int fromEventId,
int maxEvents) |
void |
Task.initialize(JobConf job,
JobID id,
Reporter reporter,
boolean useNewApi) |
void |
JobTracker.killJob(JobID jobid) |
void |
LocalJobRunner.killJob(JobID id) |
static void |
JobHistory.JobInfo.logFailed(JobID jobid,
long timestamp,
int finishedMaps,
int finishedReduces)
Logs job failed event.
|
static void |
JobHistory.JobInfo.logFinished(JobID jobId,
long finishTime,
int finishedMaps,
int finishedReduces,
int failedMaps,
int failedReduces,
Counters mapCounters,
Counters reduceCounters,
Counters counters)
Log job finished.
|
static void |
JobHistory.JobInfo.logInited(JobID jobId,
long startTime,
int totalMaps,
int totalReduces)
Logs launch time of job.
|
static void |
JobHistory.JobInfo.logJobInfo(JobID jobid,
long submitTime,
long launchTime) |
static void |
JobHistory.JobInfo.logJobInfo(JobID jobid,
long submitTime,
long launchTime,
int restartCount)
Deprecated.
Use
JobHistory.JobInfo.logJobInfo(JobID, long, long) instead. |
static void |
JobHistory.JobInfo.logJobPriority(JobID jobid,
JobPriority priority)
Log job's priority.
|
static void |
JobHistory.JobInfo.logKilled(JobID jobid,
long timestamp,
int finishedMaps,
int finishedReduces)
Logs job killed event.
|
static void |
JobHistory.JobInfo.logStarted(JobID jobId)
Logs job as running
|
static void |
JobHistory.JobInfo.logStarted(JobID jobId,
long startTime,
int totalMaps,
int totalReduces)
|
static void |
JobHistory.JobInfo.logSubmitted(JobID jobId,
JobConf jobConf,
java.lang.String jobConfPath,
long submitTime)
Deprecated.
|
static void |
JobHistory.JobInfo.logSubmitted(JobID jobId,
JobConf jobConf,
java.lang.String jobConfPath,
long submitTime,
boolean restarted) |
void |
JobTracker.setJobPriority(JobID jobid,
java.lang.String priority) |
void |
LocalJobRunner.setJobPriority(JobID id,
java.lang.String jp) |
JobStatus |
JobTracker.submitJob(JobID jobId,
java.lang.String jobSubmitDir,
org.apache.hadoop.security.Credentials ts)
JobTracker.submitJob() kicks off a new job.
|
JobStatus |
LocalJobRunner.submitJob(JobID jobid,
java.lang.String jobSubmitDir,
org.apache.hadoop.security.Credentials credentials) |
Constructor and Description |
---|
CleanupQueue.PathDeletionContext(org.apache.hadoop.fs.Path fullPath,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.security.UserGroupInformation ugi,
JobID jobIdTokenRenewalToCancel,
org.apache.hadoop.fs.FileSystem fs)
PathDeletionContext ctor which also allows for a job-delegation token
renewal to be cancelled.
|
JobInProgress(JobID jobid,
JobConf conf,
JobTracker tracker)
Create an almost empty JobInProgress, which can be used only for tests
|
JobStatus(JobID jobid,
float setupProgress,
float mapProgress,
float reduceProgress,
float cleanupProgress,
int runState,
JobPriority jp)
Create a job status object for a given jobid.
|
JobStatus(JobID jobid,
float mapProgress,
float reduceProgress,
float cleanupProgress,
int runState)
Create a job status object for a given jobid.
|
JobStatus(JobID jobid,
float mapProgress,
float reduceProgress,
float cleanupProgress,
int runState,
JobPriority jp)
Create a job status object for a given jobid.
|
JobStatus(JobID jobid,
float mapProgress,
float reduceProgress,
int runState)
Create a job status object for a given jobid.
|
TaskInProgress(JobID jobid,
java.lang.String jobFile,
int numMaps,
int partition,
JobTracker jobtracker,
JobConf conf,
JobInProgress job,
int numSlotsRequired)
Constructor for ReduceTask
|
TaskInProgress(JobID jobid,
java.lang.String jobFile,
JobSplit.TaskSplitMetaInfo split,
JobTracker jobtracker,
JobConf conf,
JobInProgress job,
int partition,
int numSlotsRequired)
Constructor for MapTask
|
Modifier and Type | Method and Description |
---|---|
JobID |
Job.getAssignedJobID()
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
void |
Job.setAssignedJobID(JobID mapredJobID)
Deprecated.
setAssignedJobID should not be called.
JOBID is set by the framework.
|
Modifier and Type | Field and Description |
---|---|
protected JobID |
StreamJob.jobId_ |
Copyright © 2009 The Apache Software Foundation