ResourceProfile¶

ResourceProfile is a resource profile (with executor and task requirements) for Stage Level Scheduling.

ResourceProfile is a Java Serializable.

Creating Instance¶

ResourceProfile takes the following to be created:

• Executor Resources (Map[String, ExecutorResourceRequest])
• Task Resources (Map[String, TaskResourceRequest])

ResourceProfile is created (directly or using getOrCreateDefaultProfile) when:

• DriverEndpoint is requested to handle a RetrieveSparkAppConfig message
• ResourceProfileBuilder utility is requested to build

getOrCreateDefaultProfile Utility¶

getOrCreateDefaultProfile(
  conf: SparkConf): ResourceProfile

getOrCreateDefaultProfile...FIXME

getOrCreateDefaultProfile is used when:

• DriverEndpoint is requested to handle a RetrieveSparkAppConfig message