Skip to content

RDDCheckpointData

RDDCheckpointData is an abstraction of information related to RDD checkpointing.

== [[implementations]] Available RDDCheckpointDatas

[cols="30,70",options="header",width="100%"] |=== | RDDCheckpointData | Description

| rdd:LocalRDDCheckpointData.md[LocalRDDCheckpointData] | [[LocalRDDCheckpointData]]

| rdd:ReliableRDDCheckpointData.md[ReliableRDDCheckpointData] | [[ReliableRDDCheckpointData]] Reliable Checkpointing

|===

== [[creating-instance]] Creating Instance

RDDCheckpointData takes the following to be created:

  • [[rdd]] rdd:RDD.md[RDD]

== [[Serializable]] RDDCheckpointData as Serializable

RDDCheckpointData is java.io.Serializable.

== [[cpState]] States

  • [[Initialized]] Initialized

  • [[CheckpointingInProgress]] CheckpointingInProgress

  • [[Checkpointed]] Checkpointed

== [[checkpoint]] Checkpointing RDD

[source, scala]

checkpoint(): CheckpointRDD[T]

checkpoint changes the <> to <> only when in <> state. Otherwise, checkpoint does nothing and returns.

checkpoint <> that gives an CheckpointRDD (that is the <> internal registry).

checkpoint changes the <> to <>.

In the end, checkpoint requests the given <> to rdd:RDD.md#markCheckpointed[markCheckpointed].

checkpoint is used when RDD is requested to rdd:RDD.md#doCheckpoint[doCheckpoint].

== [[doCheckpoint]] doCheckpoint Method

[source, scala]

doCheckpoint(): CheckpointRDD[T]

doCheckpoint is used when RDDCheckpointData is requested to <>.

Back to top