LiveEntity¶

LiveEntity is an abstraction of entities of a running (live) Spark application.

Contract¶

doUpdate¶

doUpdate(): Any

Updated view of this entity's data

Used when:

• LiveEntity is requested to write out to the store

Implementations¶

• LiveExecutionData (Spark SQL)
• LiveExecutionData (Spark Thrift Server)
• LiveExecutor
• LiveExecutorStageSummary
• LiveJob
• LiveRDD
• LiveResourceProfile
• LiveSessionData
• LiveStage
• LiveTask
• SchedulerPool

Writing Out to Store¶

write(
  store: ElementTrackingStore,
  now: Long,
  checkTriggers: Boolean = false): Unit

write...FIXME

write is used when:

• AppStatusListener is requested to update
• HiveThriftServer2Listener (Spark Thrift Server) is requested to updateStoreWithTriggerEnabled and updateLiveStore
• SQLAppStatusListener (Spark SQL) is requested to update