Skip to content

ExecutorData

ExecutorData is a metadata of an executor:

  • Executor's RPC Endpoint
  • Executor's RpcAddress
  • Executor's Host
  • Executor's Free Cores
  • Executor's Total Cores
  • Executor's Log URLs (Map[String, String])
  • Executor's Attributes (Map[String, String])
  • Executor's Resources Info (Map[String, ExecutorResourceInfo])
  • Executor's ResourceProfile ID

ExecutorData is created for every executor registered (when DriverEndpoint is requested to handle a RegisterExecutor message).

ExecutorData is used by CoarseGrainedSchedulerBackend to track registered executors.

Note

ExecutorData is posted as part of SparkListenerExecutorAdded event by DriverEndpoint every time an executor is registered.

Back to top