StagesTab¶
StagesTab
is a SparkUITab with stages
URL prefix.
Creating Instance¶
StagesTab
takes the following to be created:
- Parent SparkUI
- AppStatusStore
StagesTab
is created when:
SparkUI
is requested to initialize
Pages¶
When created, StagesTab
attaches the following pages:
- AllStagesPage
- StagePage (with the AppStatusStore)
- PoolPage
Introduction¶
Stages tab shows the current state of all stages of all jobs in a Spark application with two optional pages for the tasks and statistics for a stage (when a stage is selected) and pool details (when the application works in FAIR scheduling mode).
The title of the tab is Stages for All Jobs.
With no jobs submitted yet (and hence no stages to display), the page shows nothing but the title.
The Stages page shows the stages in a Spark application per state in their respective sections:
- Active Stages
- Pending Stages
- Completed Stages
- Failed Stages
The state sections are only displayed when there are stages in a given state.
In FAIR scheduling mode you have access to the table showing the scheduler pools.