public class SymlinkTextInputFormat extends SymbolicInputFormat implements ContentSummaryInputFormat, ReworkMapredInputFormat
Modifier and Type | Class and Description |
---|---|
static class |
SymlinkTextInputFormat.SymlinkTextInputSplit
This input split wraps the FileSplit generated from
TextInputFormat.getSplits(), while setting the original link file path
as job input path.
|
Constructor and Description |
---|
SymlinkTextInputFormat() |
Modifier and Type | Method and Description |
---|---|
void |
configure(JobConf job) |
ContentSummary |
getContentSummary(Path p,
JobConf job) |
<any> |
getRecordReader(InputSplit split,
JobConf job,
Reporter reporter) |
InputSplit[] |
getSplits(JobConf job,
int numSplits)
Parses all target paths from job input directory which contains symlink
files, and splits the target data using TextInputFormat.
|
void |
validateInput(JobConf job)
For backward compatibility with hadoop 0.17.
|
rework
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
rework
public <any> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws java.io.IOException
java.io.IOException
public InputSplit[] getSplits(JobConf job, int numSplits) throws java.io.IOException
java.io.IOException
public void configure(JobConf job)
public void validateInput(JobConf job) throws java.io.IOException
java.io.IOException
public ContentSummary getContentSummary(Path p, JobConf job) throws java.io.IOException
getContentSummary
in interface ContentSummaryInputFormat
java.io.IOException
Copyright © 2012 The Apache Software Foundation