Configuration Properties¶

spark.metrics.appStatusSource.enabled¶

Enables Dropwizard/Codahale metrics with the status of a live Spark application

Default: false

Used when:

• AppStatusSource utility is used to create an AppStatusSource

spark.metrics.conf¶

The metrics configuration file

Default: metrics.properties

spark.metrics.namespace¶

Root namespace for metrics reporting

Default: Spark Application ID (i.e. spark.app.id configuration property)

Since a Spark application's ID changes with every execution of a Spark application, a custom namespace can be specified for an easier metrics reporting.

Used when MetricsSystem is requested for a metrics source identifier (metrics namespace)