Package | Description |
---|---|
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans | |
org.apache.pig.impl.plan | |
org.apache.pig.pen | |
org.apache.pig.tools.pigstats |
Modifier and Type | Class and Description |
---|---|
class |
AccumulatorOptimizer
A visitor to optimize plans that determines if a reduce plan
can run in accumulative mode.
|
class |
CombinerOptimizer
Optimize map reduce plans to use the combiner where possible.
|
class |
KeyTypeDiscoveryVisitor
A visitor to figure out the type of the key for the map plan
this is needed when the key is null to create
an appropriate NullableXXXWritable object
|
class |
LimitAdjuster |
class |
MRCompiler
The compiler that compiles a given physical plan
into a DAG of MapReduce operators which can then
be converted into the JobControl structure.
|
class |
PhyPlanSetter
Sets the parent plan for all Physical Operators.
|
class |
SampleOptimizer
A visitor to optimize plans that have a sample job that immediately follows a
load/store only MR job.
|
class |
SecondaryKeyOptimizer |
class |
UDFFinishVisitor |
Modifier and Type | Class and Description |
---|---|
class |
EndOfAllInputSetter
This visitor visits the MRPlan and does the following
for each MROper: If the map plan or the reduce plan of the MROper has
an end of all input flag present in it, this marks in the MROper whether the map
has an end of all input flag set or if the reduce has an end of all input flag set.
|
class |
MRIntermediateDataVisitor
An
MROpPlanVisitor that gathers the paths for all
intermediate data from a MROperPlan |
class |
MROpPlanVisitor
A visitor for the MROperPlan class
|
class |
MRPrinter
A visitor mechanism printing out the logical plan.
|
class |
POPackageAnnotator
This visitor visits the MRPlan and does the following
for each MROper
- visits the POPackage in the reduce plan and finds the corresponding
POLocalRearrange(s) (either in the map plan of the same oper OR
reduce plan of predecessor MROper).
|
class |
ScalarPhyFinder |
class |
UDFFinder |
class |
XMLMRPrinter
A visitor mechanism printing out the logical plan.
|
Modifier and Type | Method and Description |
---|---|
void |
DotMRPrinter.InnerOperator.visit(PlanVisitor v) |
Modifier and Type | Class and Description |
---|---|
class |
POPrinter |
Modifier and Type | Class and Description |
---|---|
class |
PhyPlanVisitor
The visitor class for the Physical Plan.
|
class |
PlanPrinter<O extends Operator,P extends OperatorPlan<O>> |
class |
XMLPhysicalPlanPrinter<P extends OperatorPlan<PhysicalOperator>> |
Modifier and Type | Class and Description |
---|---|
class |
Operator<V extends PlanVisitor>
Base class for all types of operators.
|
Modifier and Type | Method and Description |
---|---|
void |
ReverseDependencyOrderWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
abstract void |
PlanWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
void |
DepthFirstWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
void |
DependencyOrderWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
Modifier and Type | Class and Description |
---|---|
class |
IllustratorAttacher
The class used to (re)attach illustrators to physical operators
|
class |
PhysicalPlanResetter
This visitor visits the physical plan and resets it for next MRCompilation
|
Modifier and Type | Class and Description |
---|---|
protected static class |
ScriptState.AliasVisitor |
protected static class |
ScriptState.FeatureVisitor |
Copyright © 2007-2012 The Apache Software Foundation