1. [SPARK-25502][CORE][WEBUI] Empty Page when page number exceeds the (commit: 8ccc4788154080e8508818c3a612c364edfeef59) (details)
Commit 8ccc4788154080e8508818c3a612c364edfeef59 by vanzin
[SPARK-25502][CORE][WEBUI] Empty Page when page number exceeds the
reatinedTask size.
## What changes were proposed in this pull request? Test steps : 1)
bin/spark-shell --conf spark.ui.retainedTasks=200
``` val rdd = sc.parallelize(1 to 1000, 1000) rdd.count
Stage tab in the UI will display 10 pages with 100 tasks per page. But
number of retained tasks is only 200. So, from the 3rd page onwards will
display nothing.
We have to calculate total pages based on the number of tasks need
display in the UI.
**Before fix:**
**After fix:**
## How was this patch tested?
Manually tested
Closes #22526 from shahidki31/SPARK-25502.
Authored-by: Shahid <> Signed-off-by: Marcelo Vanzin
(cherry picked from commit 3ce2e008ec1bf70adc5a4b356e09a469e94af803)
Signed-off-by: Marcelo Vanzin <>
(commit: 8ccc4788154080e8508818c3a612c364edfeef59)
The file was modifiedcore/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala (diff)