The RDD dependency of the target
The depth along the current path from the target RDD to this dependency. It is possible for an RDD to be reachable along multiple paths starting from the target. Therefore one dependency RDD may appear multiple times in the lineage, with differing values for depth depending on the particular path.
The RDD whose immediate dependency this is.
The depth along the current path from the target RDD to this dependency.
The depth along the current path from the target RDD to this dependency. It is possible for an RDD to be reachable along multiple paths starting from the target. Therefore one dependency RDD may appear multiple times in the lineage, with differing values for depth depending on the particular path.
The RDD dependency of the target
The RDD whose immediate dependency this is.
Encodes an RDD dependency arc in the lineage DAG of a target RDD.