RDDCheckpointData¶

RDDCheckpointData is an abstraction of information related to RDD checkpointing.

== [[implementations]] Available RDDCheckpointDatas

[cols="30,70",options="header",width="100%"] |=== | RDDCheckpointData | Description

| rdd:LocalRDDCheckpointData.md[LocalRDDCheckpointData] | [[LocalRDDCheckpointData]]

| rdd:ReliableRDDCheckpointData.md[ReliableRDDCheckpointData] | [[ReliableRDDCheckpointData]] Reliable Checkpointing

|===

== [[creating-instance]] Creating Instance

RDDCheckpointData takes the following to be created:

• [[rdd]] rdd:RDD.md[RDD]

== [[Serializable]] RDDCheckpointData as Serializable

RDDCheckpointData is java.io.Serializable.

== [[cpState]] States

• [[Initialized]] Initialized

• [[CheckpointingInProgress]] CheckpointingInProgress

• [[Checkpointed]] Checkpointed

== [[checkpoint]] Checkpointing RDD

[source, scala]¶

checkpoint(): CheckpointRDD[T]¶

checkpoint changes the <> to <> only when in <> state. Otherwise, checkpoint does nothing and returns.

checkpoint <> that gives an CheckpointRDD (that is the <> internal registry).

checkpoint changes the <> to <>.

In the end, checkpoint requests the given <> to rdd:RDD.md#markCheckpointed[markCheckpointed].

checkpoint is used when RDD is requested to rdd:RDD.md#doCheckpoint[doCheckpoint].

== [[doCheckpoint]] doCheckpoint Method

[source, scala]¶

doCheckpoint(): CheckpointRDD[T]¶

doCheckpoint is used when RDDCheckpointData is requested to <>.