Package | Description |
---|---|
org.apache.hadoop.filecache | |
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.jobcontrol |
Utilities for managing dependent jobs.
|
org.apache.hadoop.mapreduce.lib.map | |
org.apache.hadoop.mapreduce.lib.reduce | |
org.apache.hadoop.mapreduce.security.token | |
org.apache.hadoop.mapreduce.server.tasktracker | |
org.apache.hadoop.mapreduce.server.tasktracker.userlogs | |
org.apache.hadoop.mapreduce.split | |
org.apache.hadoop.mapreduce.task |
Modifier and Type | Method and Description |
---|---|
protected TaskDistributedCacheManager |
TrackerDistributedCacheManager.getTaskDistributedCacheManager(JobID jobId) |
TaskDistributedCacheManager |
TrackerDistributedCacheManager.newTaskDistributedCacheManager(JobID jobId,
org.apache.hadoop.conf.Configuration taskConf) |
void |
TrackerDistributedCacheManager.removeTaskDistributedCacheManager(JobID jobId) |
void |
TrackerDistributedCacheManager.setArchiveSizes(JobID jobId,
long[] sizes)
Set the sizes for any archives, files, or directories in the private
distributed cache.
|
Modifier and Type | Class and Description |
---|---|
class |
JobID
JobID represents the immutable and unique identifier for
the job.
|
Modifier and Type | Method and Description |
---|---|
void |
UserLogCleaner.deleteJobLogs(JobID jobid) |
static JobID |
JobID.downgrade(JobID old)
Downgrade a new JobID to an old one
|
static java.io.File |
TaskLog.getJobDir(JobID jobid)
Get the user log directory for the job jobid.
|
void |
JobLocalizer.localizeJobFiles(JobID jobid,
JobConf jConf,
org.apache.hadoop.fs.Path localJobFile,
org.apache.hadoop.fs.Path localJobTokenFile,
TaskUmbilicalProtocol taskTracker) |
void |
JobLocalizer.localizeJobFiles(JobID jobid,
JobConf jConf,
org.apache.hadoop.fs.Path localJobTokenFile,
TaskUmbilicalProtocol taskTracker) |
void |
UserLogCleaner.markJobLogsForDeletion(long jobCompletionTime,
int retainHours,
JobID jobid)
Adds job user-log directory to cleanup thread to delete logs after user-log
retain hours.
|
void |
UserLogCleaner.unmarkJobFromLogDeletion(JobID jobid)
Remove job from user log deletion.
|
void |
TaskTracker.updatePrivateDistributedCacheSizes(JobID jobId,
long[] sizes) |
void |
TaskUmbilicalProtocol.updatePrivateDistributedCacheSizes(JobID jobId,
long[] sizes)
The job initializer needs to report the sizes of the archive
objects and directories in the private distributed cache.
|
Constructor and Description |
---|
JobProfile(java.lang.String user,
JobID jobid,
java.lang.String jobFile,
java.lang.String url,
java.lang.String name)
Construct a
JobProfile the userid, jobid,
job config-file, job-details url and job name. |
JobProfile(java.lang.String user,
JobID jobid,
java.lang.String jobFile,
java.lang.String url,
java.lang.String name,
java.lang.String queueName)
Construct a
JobProfile the userid, jobid,
job config-file, job-details url and job name. |
TaskID(JobID jobId,
boolean isMap,
int id)
Constructs a TaskID object from given
JobID . |
Modifier and Type | Method and Description |
---|---|
static JobID |
JobID.forName(java.lang.String str)
Construct a JobId object from given string
|
JobID |
TaskAttemptID.getJobID()
Returns the
JobID object that this task attempt belongs to |
JobID |
TaskID.getJobID()
Returns the
JobID object that this tip belongs to |
JobID |
JobContext.getJobID()
Get the unique ID for the job.
|
Constructor and Description |
---|
TaskID(JobID jobId,
boolean isMap,
int id)
Constructs a TaskID object from given
JobID . |
Modifier and Type | Method and Description |
---|---|
JobID |
ControlledJob.getMapredJobID() |
Modifier and Type | Method and Description |
---|---|
JobID |
WrappedMapper.Context.getJobID() |
Modifier and Type | Method and Description |
---|---|
JobID |
WrappedReducer.Context.getJobID() |
Modifier and Type | Method and Description |
---|---|
static void |
DelegationTokenRenewal.registerDelegationTokensForRenewal(JobID jobId,
org.apache.hadoop.security.Credentials ts,
org.apache.hadoop.conf.Configuration conf) |
static void |
DelegationTokenRenewal.removeDelegationTokenRenewalForJob(JobID jobId)
removing DT for completed jobs
|
Modifier and Type | Method and Description |
---|---|
void |
Localizer.initializeJobDirs(java.lang.String user,
JobID jobId)
Prepare the job directories for a given job.
|
void |
Localizer.initializeJobLogDir(JobID jobId)
Create job log directory and set appropriate permissions for the directory.
|
Modifier and Type | Method and Description |
---|---|
JobID |
JobStartedEvent.getJobID()
Get the job id.
|
JobID |
JobCompletedEvent.getJobID()
Get the job id.
|
JobID |
DeleteJobEvent.getJobID()
Get the jobid.
|
Constructor and Description |
---|
DeleteJobEvent(JobID jobid)
Create the event to delete job log directory.
|
JobCompletedEvent(JobID jobid,
long jobCompletionTime,
int retainHours)
Create the event for job completion.
|
JobStartedEvent(JobID jobid)
Create the event to inform the job has started.
|
Modifier and Type | Method and Description |
---|---|
static JobSplit.TaskSplitMetaInfo[] |
SplitMetaInfoReader.readSplitMetaInfo(JobID jobId,
org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path jobSubmitDir) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobContextImpl.getJobID()
Get the unique ID for the job.
|
Modifier and Type | Method and Description |
---|---|
void |
JobContextImpl.setJobID(JobID jobId)
Set the JobID.
|
Constructor and Description |
---|
JobContextImpl(org.apache.hadoop.conf.Configuration conf,
JobID jobId) |
Copyright © 2009 The Apache Software Foundation