SuccessConsole Output

Skipping 3,956 KB.. Full Log
ls: Successfully started service 'sparkDriver' on port 34085.
17/10/03 16:07:07 INFO SparkEnv: Registering MapOutputTracker
17/10/03 16:07:07 INFO SparkEnv: Registering BlockManagerMaster
17/10/03 16:07:07 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-ca628ffd-2ddf-4ed3-9433-089052b15036
17/10/03 16:07:07 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/10/03 16:07:07 INFO SparkEnv: Registering OutputCommitCoordinator
17/10/03 16:07:07 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/10/03 16:07:07 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/10/03 16:07:07 INFO Executor: Starting executor ID driver on host localhost
17/10/03 16:07:07 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43930.
17/10/03 16:07:07 INFO NettyBlockTransferService: Server created on localhost:43930
17/10/03 16:07:07 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 43930)
17/10/03 16:07:07 INFO BlockManagerMasterEndpoint: Registering block manager localhost:43930 with 15.8 GB RAM, BlockManagerId(driver, localhost, 43930)
17/10/03 16:07:07 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 43930)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:43930 (size: 14.3 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:146
17/10/03 16:07:07 INFO FileInputFormat: Total input paths to process : 1
17/10/03 16:07:07 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
17/10/03 16:07:07 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:146)
17/10/03 16:07:07 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
17/10/03 16:07:07 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:43930 (size: 2.7 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5463 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/10/03 16:07:07 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/people.json:0+506
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 18 ms on localhost (1/1)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:146) finished in 0.018 s
17/10/03 16:07:07 INFO DAGScheduler: looking for newly runnable stages
17/10/03 16:07:07 INFO DAGScheduler: running: Set()
17/10/03 16:07:07 INFO DAGScheduler: waiting: Set(ResultStage 1)
17/10/03 16:07:07 INFO DAGScheduler: failed: Set()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:43930 (size: 2.3 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 4 ms on localhost (1/5)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 4 ms on localhost (2/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1208 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 4 ms on localhost (3/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 3 ms on localhost (4/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 3 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.018 s
17/10/03 16:07:07 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.046157 s
17/10/03 16:07:07 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:07 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
17/10/03 16:07:07 INFO DAGScheduler: Got job 1 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 3.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:43930 (size: 1128.0 B, free: 15.8 GB)
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 6 ms on localhost (1/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:43930 (size: 1440.0 B, free: 15.8 GB)
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 4 ms on localhost (2/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:43930 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 4 ms on localhost (3/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:43930 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 10, localhost, partition 4, NODE_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 3.0 (TID 10)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 5 ms on localhost (4/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/10/03 16:07:07 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:43930 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 3.0 (TID 10). 1987 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 3.0 (TID 10) in 5 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.023 s
17/10/03 16:07:07 INFO DAGScheduler: Job 1 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.028800 s
17/10/03 16:07:07 INFO SparkContext: Starting job: count at SuccinctJsonRDD.scala:90
17/10/03 16:07:07 INFO DAGScheduler: Got job 2 (count at SuccinctJsonRDD.scala:90) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 5 (count at SuccinctJsonRDD.scala:90)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:43930 (size: 2.1 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 11, localhost, partition 0, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 5.0 (TID 11)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 5.0 (TID 11). 1346 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 12, localhost, partition 1, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 5.0 (TID 12)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 11) in 4 ms on localhost (1/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 5.0 (TID 12). 1346 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 13, localhost, partition 2, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 5.0 (TID 13)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 12) in 4 ms on localhost (2/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 5.0 (TID 13). 1346 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 14, localhost, partition 3, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 5.0 (TID 14)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 13) in 4 ms on localhost (3/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 5.0 (TID 14). 1259 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 15, localhost, partition 4, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 5.0 (TID 15)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 14) in 4 ms on localhost (4/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 5.0 (TID 15). 1259 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 15) in 3 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 5 (count at SuccinctJsonRDD.scala:90) finished in 0.017 s
17/10/03 16:07:07 INFO DAGScheduler: Job 2 finished: count at SuccinctJsonRDD.scala:90, took 0.022406 s
17/10/03 16:07:07 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:98
17/10/03 16:07:07 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDD.scala:98) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDD.scala:98)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:43930 (size: 2.3 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 16, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 7.0 (TID 16)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 7.0 (TID 16). 1208 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 17, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 7.0 (TID 17)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 16) in 4 ms on localhost (1/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 7.0 (TID 17). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 18, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 7.0 (TID 18)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 17) in 4 ms on localhost (2/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 7.0 (TID 18). 1208 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 19, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 7.0 (TID 19)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 18) in 4 ms on localhost (3/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 7.0 (TID 19). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 20, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 7.0 (TID 20)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 19) in 4 ms on localhost (4/5)
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:07 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 7.0 (TID 20). 1295 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 20) in 3 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDD.scala:98) finished in 0.018 s
17/10/03 16:07:07 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDD.scala:98, took 0.023993 s
17/10/03 16:07:07 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:07 INFO DAGScheduler: Got job 4 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 8)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 9.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 21, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 9.0 (TID 21)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 9.0 (TID 21). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 9.0 (TID 22, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 9.0 (TID 22)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 21) in 3 ms on localhost (1/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 9.0 (TID 22). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 9.0 (TID 23, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 9.0 (TID 23)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 9.0 (TID 22) in 3 ms on localhost (2/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 9.0 (TID 23). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 9.0 (TID 24, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 9.0 (TID 24)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 9.0 (TID 23) in 2 ms on localhost (3/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 9.0 (TID 24). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 9.0 (TID 25, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 9.0 (TID 25)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 9.0 (TID 24) in 3 ms on localhost (4/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 9.0 (TID 25). 788 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 9.0 (TID 25) in 2 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 9.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.009 s
17/10/03 16:07:07 INFO DAGScheduler: Job 4 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.014732 s
17/10/03 16:07:07 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:07 INFO DAGScheduler: Got job 5 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 10)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 11.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 26, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 11.0 (TID 26)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 11.0 (TID 26). 867 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 11.0 (TID 27, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 11.0 (TID 27)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 26) in 2 ms on localhost (1/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 11.0 (TID 27). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 11.0 (TID 28, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 11.0 (TID 28)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 11.0 (TID 27) in 2 ms on localhost (2/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 11.0 (TID 28). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 11.0 (TID 29, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 11.0 (TID 29)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 11.0 (TID 28) in 3 ms on localhost (3/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 11.0 (TID 29). 788 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 11.0 (TID 30, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 11.0 (TID 30)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 11.0 (TID 29) in 2 ms on localhost (4/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 11.0 (TID 30). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 11.0 (TID 30) in 1 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 11.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.009 s
17/10/03 16:07:07 INFO DAGScheduler: Job 5 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.014324 s
17/10/03 16:07:07 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:07 INFO DAGScheduler: Got job 6 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 12)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 13.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 31, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 13.0 (TID 31)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 13.0 (TID 31). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 32, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 13.0 (TID 32)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 31) in 1 ms on localhost (1/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 13.0 (TID 32). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 13.0 (TID 33, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 13.0 (TID 33)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 32) in 2 ms on localhost (2/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:07 INFO Executor: Finished task 2.0 in stage 13.0 (TID 33). 788 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 3.0 in stage 13.0 (TID 34, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 3.0 in stage 13.0 (TID 34)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 2.0 in stage 13.0 (TID 33) in 2 ms on localhost (3/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:07 INFO Executor: Finished task 3.0 in stage 13.0 (TID 34). 788 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 4.0 in stage 13.0 (TID 35, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 4.0 in stage 13.0 (TID 35)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 3.0 in stage 13.0 (TID 34) in 2 ms on localhost (4/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:07 INFO Executor: Finished task 4.0 in stage 13.0 (TID 35). 867 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Finished task 4.0 in stage 13.0 (TID 35) in 1 ms on localhost (5/5)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Removed TaskSet 13.0, whose tasks have all completed, from pool 
17/10/03 16:07:07 INFO DAGScheduler: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.006 s
17/10/03 16:07:07 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.011065 s
17/10/03 16:07:07 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:07 INFO DAGScheduler: Got job 7 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:07 INFO DAGScheduler: Final stage: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 14)
17/10/03 16:07:07 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:07 INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:07 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:07 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:07 INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:07 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:07 INFO TaskSchedulerImpl: Adding task set 15.0 with 5 tasks
17/10/03 16:07:07 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 36, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 0.0 in stage 15.0 (TID 36)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:07 INFO Executor: Finished task 0.0 in stage 15.0 (TID 36). 788 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 1.0 in stage 15.0 (TID 37, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 1.0 in stage 15.0 (TID 37)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 36) in 2 ms on localhost (1/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:07 INFO Executor: Finished task 1.0 in stage 15.0 (TID 37). 875 bytes result sent to driver
17/10/03 16:07:07 INFO TaskSetManager: Starting task 2.0 in stage 15.0 (TID 38, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:07 INFO Executor: Running task 2.0 in stage 15.0 (TID 38)
17/10/03 16:07:07 INFO TaskSetManager: Finished task 1.0 in stage 15.0 (TID 37) in 2 ms on localhost (2/5)
17/10/03 16:07:07 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 15.0 (TID 38). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 15.0 (TID 39, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 15.0 (TID 39)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 15.0 (TID 38) in 2 ms on localhost (3/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 15.0 (TID 39). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 15.0 (TID 40, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 15.0 (TID 40)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 15.0 (TID 39) in 2 ms on localhost (4/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 15.0 (TID 40). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 15.0 (TID 40) in 2 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 15.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.008 s
17/10/03 16:07:08 INFO DAGScheduler: Job 7 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.012927 s
17/10/03 16:07:08 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:08 INFO DAGScheduler: Got job 8 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 16)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 17.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 41, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 17.0 (TID 41)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 17.0 (TID 41). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 17.0 (TID 42, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 17.0 (TID 42)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 41) in 3 ms on localhost (1/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 17.0 (TID 42). 788 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 17.0 (TID 43, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 17.0 (TID 43)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 17.0 (TID 42) in 2 ms on localhost (2/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 17.0 (TID 43). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 17.0 (TID 44, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 17.0 (TID 44)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 17.0 (TID 43) in 2 ms on localhost (3/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 17.0 (TID 44). 867 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 17.0 (TID 45, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 17.0 (TID 45)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 17.0 (TID 44) in 2 ms on localhost (4/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 17.0 (TID 45). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 17.0 (TID 45) in 2 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 17.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.009 s
17/10/03 16:07:08 INFO DAGScheduler: Job 8 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.014744 s
17/10/03 16:07:08 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:08 INFO DAGScheduler: Got job 9 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 18)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on localhost:43930 (size: 2.6 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 19.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 46, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 19.0 (TID 46)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 19.0 (TID 46). 867 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 19.0 (TID 47, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 19.0 (TID 47)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 46) in 2 ms on localhost (1/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 19.0 (TID 47). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 19.0 (TID 48, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 19.0 (TID 48)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 19.0 (TID 47) in 2 ms on localhost (2/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 19.0 (TID 48). 788 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 19.0 (TID 49, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 19.0 (TID 49)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 19.0 (TID 48) in 2 ms on localhost (3/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 19.0 (TID 49). 875 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 19.0 (TID 50, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 19.0 (TID 50)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 19.0 (TID 49) in 2 ms on localhost (4/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 19.0 (TID 50). 788 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 19.0 (TID 50) in 2 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 19.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.008 s
17/10/03 16:07:08 INFO DAGScheduler: Job 9 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.014092 s
17/10/03 16:07:08 INFO MapPartitionsRDD: Removing RDD 7 from persistence list
17/10/03 16:07:08 INFO BlockManager: Removing RDD 7
17/10/03 16:07:08 INFO SparkContext: Starting job: count at SuccinctJsonRDDSuite.scala:150
17/10/03 16:07:08 INFO DAGScheduler: Got job 10 (count at SuccinctJsonRDDSuite.scala:150) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 20)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on localhost:43930 (size: 2.1 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 21.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 51, localhost, partition 0, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 21.0 (TID 51)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 21.0 (TID 51). 1259 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 21.0 (TID 52, localhost, partition 1, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 21.0 (TID 52)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 51) in 5 ms on localhost (1/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 21.0 (TID 52). 1259 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 21.0 (TID 53, localhost, partition 2, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 21.0 (TID 53)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 21.0 (TID 52) in 4 ms on localhost (2/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 21.0 (TID 53). 1346 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 21.0 (TID 54, localhost, partition 3, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 21.0 (TID 54)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 21.0 (TID 53) in 4 ms on localhost (3/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 21.0 (TID 54). 1346 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 21.0 (TID 55, localhost, partition 4, NODE_LOCAL, 5387 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 21.0 (TID 55)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 21.0 (TID 54) in 3 ms on localhost (4/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 21.0 (TID 55). 1346 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 21.0 (TID 55) in 3 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 21.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150) finished in 0.017 s
17/10/03 16:07:08 INFO DAGScheduler: Job 10 finished: count at SuccinctJsonRDDSuite.scala:150, took 0.022357 s
17/10/03 16:07:08 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/10/03 16:07:08 INFO DAGScheduler: Registering RDD 17 (repartition at SuccinctJsonRDD.scala:94)
17/10/03 16:07:08 INFO DAGScheduler: Got job 11 (aggregate at SuccinctJsonRDD.scala:113) with 10 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 22, ShuffleMapStage 23)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 23)
17/10/03 16:07:08 INFO DAGScheduler: Submitting ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on localhost:43930 (size: 2.3 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 23.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 56, localhost, partition 0, NODE_LOCAL, 5466 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 23.0 (TID 56)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 23.0 (TID 56). 1548 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 23.0 (TID 57, localhost, partition 1, NODE_LOCAL, 5466 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 23.0 (TID 57)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 56) in 6 ms on localhost (1/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 23.0 (TID 57). 1635 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 23.0 (TID 58, localhost, partition 2, NODE_LOCAL, 5466 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 23.0 (TID 58)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 23.0 (TID 57) in 7 ms on localhost (2/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 23.0 (TID 58). 1635 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 23.0 (TID 59, localhost, partition 3, NODE_LOCAL, 5466 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 23.0 (TID 59)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 23.0 (TID 58) in 7 ms on localhost (3/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 23.0 (TID 59). 1548 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 23.0 (TID 60, localhost, partition 4, NODE_LOCAL, 5466 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 23.0 (TID 60)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 23.0 (TID 59) in 6 ms on localhost (4/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 23.0 (TID 60). 1548 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 23.0 (TID 60) in 5 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 23.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ShuffleMapStage 23 (repartition at SuccinctJsonRDD.scala:94) finished in 0.028 s
17/10/03 16:07:08 INFO DAGScheduler: looking for newly runnable stages
17/10/03 16:07:08 INFO DAGScheduler: running: Set()
17/10/03 16:07:08 INFO DAGScheduler: waiting: Set(ResultStage 24)
17/10/03 16:07:08 INFO DAGScheduler: failed: Set()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 5.7 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 3.2 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on localhost:43930 (size: 3.2 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 24.0 with 10 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 61, localhost, partition 0, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 24.0 (TID 61)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_0 in memory on localhost:43930 (size: 1128.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 24.0 (TID 61). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 24.0 (TID 62, localhost, partition 1, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 24.0 (TID 62)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 61) in 6 ms on localhost (1/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_1 in memory on localhost:43930 (size: 1440.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 24.0 (TID 62). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 24.0 (TID 63, localhost, partition 2, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 24.0 (TID 63)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 24.0 (TID 62) in 6 ms on localhost (2/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_2 in memory on localhost:43930 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 24.0 (TID 63). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 24.0 (TID 64, localhost, partition 3, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 24.0 (TID 64)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 24.0 (TID 63) in 6 ms on localhost (3/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_3 in memory on localhost:43930 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 24.0 (TID 64). 1987 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 24.0 (TID 65, localhost, partition 4, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 24.0 (TID 65)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 24.0 (TID 64) in 5 ms on localhost (4/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_4 in memory on localhost:43930 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 24.0 (TID 65). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 5.0 in stage 24.0 (TID 66, localhost, partition 5, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 5.0 in stage 24.0 (TID 66)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 24.0 (TID 65) in 5 ms on localhost (5/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_5 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_5 in memory on localhost:43930 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 5.0 in stage 24.0 (TID 66). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 6.0 in stage 24.0 (TID 67, localhost, partition 6, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 6.0 in stage 24.0 (TID 67)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 5.0 in stage 24.0 (TID 66) in 5 ms on localhost (6/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 5 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_6 stored as values in memory (estimated size 1872.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_6 in memory on localhost:43930 (size: 1872.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 6.0 in stage 24.0 (TID 67). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 8.0 in stage 24.0 (TID 68, localhost, partition 8, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 8.0 in stage 24.0 (TID 68)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 6.0 in stage 24.0 (TID 67) in 6 ms on localhost (7/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_8 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_8 in memory on localhost:43930 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 8.0 in stage 24.0 (TID 68). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 9.0 in stage 24.0 (TID 69, localhost, partition 9, NODE_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 9.0 in stage 24.0 (TID 69)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 8.0 in stage 24.0 (TID 68) in 5 ms on localhost (8/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_9 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_9 in memory on localhost:43930 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 9.0 in stage 24.0 (TID 69). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 7.0 in stage 24.0 (TID 70, localhost, partition 7, PROCESS_LOCAL, 5586 bytes)
17/10/03 16:07:08 INFO Executor: Running task 7.0 in stage 24.0 (TID 70)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 9.0 in stage 24.0 (TID 69) in 6 ms on localhost (9/10)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 5 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_22_7 stored as values in memory (estimated size 152.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_22_7 in memory on localhost:43930 (size: 152.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 7.0 in stage 24.0 (TID 70). 1987 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 7.0 in stage 24.0 (TID 70) in 5 ms on localhost (10/10)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 24.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.048 s
17/10/03 16:07:08 INFO DAGScheduler: Job 11 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.086516 s
- Test bulkAppend
17/10/03 16:07:08 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/10/03 16:07:08 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/10/03 16:07:08 INFO MemoryStore: MemoryStore cleared
17/10/03 16:07:08 INFO BlockManager: BlockManager stopped
17/10/03 16:07:08 INFO BlockManagerMaster: BlockManagerMaster stopped
17/10/03 16:07:08 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/10/03 16:07:08 INFO SparkContext: Successfully stopped SparkContext
17/10/03 16:07:08 INFO SparkContext: Running Spark version 2.0.1
17/10/03 16:07:08 INFO SecurityManager: Changing view acls to: jenkins
17/10/03 16:07:08 INFO SecurityManager: Changing modify acls to: jenkins
17/10/03 16:07:08 INFO SecurityManager: Changing view acls groups to: 
17/10/03 16:07:08 INFO SecurityManager: Changing modify acls groups to: 
17/10/03 16:07:08 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
17/10/03 16:07:08 INFO Utils: Successfully started service 'sparkDriver' on port 37122.
17/10/03 16:07:08 INFO SparkEnv: Registering MapOutputTracker
17/10/03 16:07:08 INFO SparkEnv: Registering BlockManagerMaster
17/10/03 16:07:08 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-32a84f58-12bc-4557-9952-1c162f47c6e2
17/10/03 16:07:08 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/10/03 16:07:08 INFO SparkEnv: Registering OutputCommitCoordinator
17/10/03 16:07:08 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/10/03 16:07:08 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/10/03 16:07:08 INFO Executor: Starting executor ID driver on host localhost
17/10/03 16:07:08 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 33591.
17/10/03 16:07:08 INFO NettyBlockTransferService: Server created on localhost:33591
17/10/03 16:07:08 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 33591)
17/10/03 16:07:08 INFO BlockManagerMasterEndpoint: Registering block manager localhost:33591 with 15.8 GB RAM, BlockManagerId(driver, localhost, 33591)
17/10/03 16:07:08 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 33591)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:33591 (size: 14.3 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:156
17/10/03 16:07:08 INFO FileInputFormat: Total input paths to process : 1
17/10/03 16:07:08 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
17/10/03 16:07:08 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:156)
17/10/03 16:07:08 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
17/10/03 16:07:08 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:33591 (size: 2.7 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5463 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/10/03 16:07:08 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/people.json:0+506
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 17 ms on localhost (1/1)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:156) finished in 0.018 s
17/10/03 16:07:08 INFO DAGScheduler: looking for newly runnable stages
17/10/03 16:07:08 INFO DAGScheduler: running: Set()
17/10/03 16:07:08 INFO DAGScheduler: waiting: Set(ResultStage 1)
17/10/03 16:07:08 INFO DAGScheduler: failed: Set()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:33591 (size: 2.3 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 6 ms on localhost (1/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1208 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 5 ms on localhost (2/5)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1208 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 5 ms on localhost (3/5)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1208 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 4 ms on localhost (4/5)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 8 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.025 s
17/10/03 16:07:08 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.055866 s
17/10/03 16:07:08 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
17/10/03 16:07:08 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 148 bytes
17/10/03 16:07:08 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:33591 (size: 2.4 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:33591 (size: 1128.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 5 ms on localhost (1/4)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:33591 (size: 1440.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 9 ms on localhost (2/4)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:33591 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 6 ms on localhost (3/4)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:33591 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 7 ms on localhost (4/4)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.025 s
17/10/03 16:07:08 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.030699 s
17/10/03 16:07:08 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
17/10/03 16:07:08 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:33591 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 28 ms on localhost (1/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 28 ms on localhost (2/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 23 ms on localhost (3/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 23 ms on localhost (4/5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:33591 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 21 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.119 s
17/10/03 16:07:08 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.127173 s
17/10/03 16:07:08 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:165
17/10/03 16:07:08 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:165) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:33591 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 8 ms on localhost (1/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 1026 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 8 ms on localhost (2/5)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 992 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 7 ms on localhost (3/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 8 ms on localhost (4/5)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 997 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 6 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165) finished in 0.034 s
17/10/03 16:07:08 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:165, took 0.040378 s
17/10/03 16:07:08 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:166
17/10/03 16:07:08 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:166) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:33591 (size: 1516.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:33591 (size: 1128.0 B, free: 15.8 GB)
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 19 ms on localhost (1/5)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:33591 (size: 1440.0 B, free: 15.8 GB)
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 16 ms on localhost (2/5)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:33591 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1473 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 19 ms on localhost (3/5)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:33591 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1575 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 15 ms on localhost (4/5)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:33591 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1565 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 13 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166) finished in 0.080 s
- Test save and load in memory
17/10/03 16:07:08 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:166, took 0.085207 s
17/10/03 16:07:08 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/10/03 16:07:08 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/10/03 16:07:08 INFO MemoryStore: MemoryStore cleared
17/10/03 16:07:08 INFO BlockManager: BlockManager stopped
17/10/03 16:07:08 INFO BlockManagerMaster: BlockManagerMaster stopped
17/10/03 16:07:08 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/10/03 16:07:08 INFO SparkContext: Successfully stopped SparkContext
17/10/03 16:07:08 INFO SparkContext: Running Spark version 2.0.1
17/10/03 16:07:08 INFO SecurityManager: Changing view acls to: jenkins
17/10/03 16:07:08 INFO SecurityManager: Changing modify acls to: jenkins
17/10/03 16:07:08 INFO SecurityManager: Changing view acls groups to: 
17/10/03 16:07:08 INFO SecurityManager: Changing modify acls groups to: 
17/10/03 16:07:08 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
17/10/03 16:07:08 INFO Utils: Successfully started service 'sparkDriver' on port 42903.
17/10/03 16:07:08 INFO SparkEnv: Registering MapOutputTracker
17/10/03 16:07:08 INFO SparkEnv: Registering BlockManagerMaster
17/10/03 16:07:08 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-cdc97887-af2c-4c88-bb44-a894b5f3a57d
17/10/03 16:07:08 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/10/03 16:07:08 INFO SparkEnv: Registering OutputCommitCoordinator
17/10/03 16:07:08 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/10/03 16:07:08 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/10/03 16:07:08 INFO Executor: Starting executor ID driver on host localhost
17/10/03 16:07:08 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 33270.
17/10/03 16:07:08 INFO NettyBlockTransferService: Server created on localhost:33270
17/10/03 16:07:08 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 33270)
17/10/03 16:07:08 INFO BlockManagerMasterEndpoint: Registering block manager localhost:33270 with 15.8 GB RAM, BlockManagerId(driver, localhost, 33270)
17/10/03 16:07:08 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 33270)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:33270 (size: 14.3 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:174
17/10/03 16:07:08 INFO FileInputFormat: Total input paths to process : 1
17/10/03 16:07:08 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
17/10/03 16:07:08 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:174)
17/10/03 16:07:08 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
17/10/03 16:07:08 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:33270 (size: 2.7 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5463 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/10/03 16:07:08 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/people.json:0+506
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 19 ms on localhost (1/1)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:174) finished in 0.019 s
17/10/03 16:07:08 INFO DAGScheduler: looking for newly runnable stages
17/10/03 16:07:08 INFO DAGScheduler: running: Set()
17/10/03 16:07:08 INFO DAGScheduler: waiting: Set(ResultStage 1)
17/10/03 16:07:08 INFO DAGScheduler: failed: Set()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:33270 (size: 2.3 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 5 ms on localhost (1/5)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 8 ms on localhost (2/5)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 9 ms on localhost (3/5)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 8 ms on localhost (4/5)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 7 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.036 s
17/10/03 16:07:08 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.064078 s
17/10/03 16:07:08 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
17/10/03 16:07:08 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
17/10/03 16:07:08 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:33270 (size: 2.4 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:33270 (size: 1128.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 9 ms on localhost (1/4)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:33270 (size: 1440.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 5 ms on localhost (2/4)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:33270 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 5 ms on localhost (3/4)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:33270 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 5 ms on localhost (4/4)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.023 s
17/10/03 16:07:08 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.027211 s
17/10/03 16:07:08 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
17/10/03 16:07:08 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:33270 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 27 ms on localhost (1/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 20 ms on localhost (2/5)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 829 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 18 ms on localhost (3/5)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 18 ms on localhost (4/5)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/10/03 16:07:08 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/10/03 16:07:08 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:33270 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 24 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.105 s
17/10/03 16:07:08 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.109096 s
17/10/03 16:07:08 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:183
17/10/03 16:07:08 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:183) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:33270 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_0 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 7 ms on localhost (1/5)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_1 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
17/10/03 16:07:08 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 1026 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 8 ms on localhost (2/5)
17/10/03 16:07:08 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_2 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
17/10/03 16:07:08 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 992 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 7 ms on localhost (3/5)
17/10/03 16:07:08 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_3 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
17/10/03 16:07:08 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 7 ms on localhost (4/5)
17/10/03 16:07:08 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
17/10/03 16:07:08 INFO BlockManager: Found block rdd_7_4 locally
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
17/10/03 16:07:08 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 997 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 6 ms on localhost (5/5)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/10/03 16:07:08 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183) finished in 0.033 s
17/10/03 16:07:08 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:183, took 0.036581 s
17/10/03 16:07:08 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:184
17/10/03 16:07:08 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:184) with 5 output partitions
17/10/03 16:07:08 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184)
17/10/03 16:07:08 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:08 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:08 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
17/10/03 16:07:08 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:33270 (size: 1516.0 B, free: 15.8 GB)
17/10/03 16:07:08 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:08 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
17/10/03 16:07:08 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
17/10/03 16:07:08 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:33270 (size: 1128.0 B, free: 15.8 GB)
17/10/03 16:07:08 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
17/10/03 16:07:08 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
17/10/03 16:07:08 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:08 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 17 ms on localhost (1/5)
17/10/03 16:07:08 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
17/10/03 16:07:08 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/10/03 16:07:08 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:33270 (size: 1440.0 B, free: 15.8 GB)
17/10/03 16:07:09 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
17/10/03 16:07:09 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1507 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:09 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
17/10/03 16:07:09 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 12 ms on localhost (2/5)
17/10/03 16:07:09 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:33270 (size: 1284.0 B, free: 15.8 GB)
17/10/03 16:07:09 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
17/10/03 16:07:09 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1560 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:09 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
17/10/03 16:07:09 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 12 ms on localhost (3/5)
17/10/03 16:07:09 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:33270 (size: 1156.0 B, free: 15.8 GB)
17/10/03 16:07:09 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
17/10/03 16:07:09 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1575 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:09 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
17/10/03 16:07:09 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 12 ms on localhost (4/5)
17/10/03 16:07:09 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:33270 (size: 1044.0 B, free: 15.8 GB)
17/10/03 16:07:09 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
17/10/03 16:07:09 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1478 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 11 ms on localhost (5/5)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184) finished in 0.063 s
17/10/03 16:07:09 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:184, took 0.066291 s
- Test save and load in memory 2
17/10/03 16:07:09 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/10/03 16:07:09 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/10/03 16:07:09 INFO MemoryStore: MemoryStore cleared
17/10/03 16:07:09 INFO BlockManager: BlockManager stopped
17/10/03 16:07:09 INFO BlockManagerMaster: BlockManagerMaster stopped
17/10/03 16:07:09 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/10/03 16:07:09 INFO SparkContext: Successfully stopped SparkContext
SuccinctTableRDDSuite:
17/10/03 16:07:09 INFO SparkContext: Running Spark version 2.0.1
17/10/03 16:07:09 INFO SecurityManager: Changing view acls to: jenkins
17/10/03 16:07:09 INFO SecurityManager: Changing modify acls to: jenkins
17/10/03 16:07:09 INFO SecurityManager: Changing view acls groups to: 
17/10/03 16:07:09 INFO SecurityManager: Changing modify acls groups to: 
17/10/03 16:07:09 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
17/10/03 16:07:09 INFO Utils: Successfully started service 'sparkDriver' on port 33736.
17/10/03 16:07:09 INFO SparkEnv: Registering MapOutputTracker
17/10/03 16:07:09 INFO SparkEnv: Registering BlockManagerMaster
17/10/03 16:07:09 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-040a355c-b6d1-405d-b5c0-8252a6699710
17/10/03 16:07:09 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/10/03 16:07:09 INFO SparkEnv: Registering OutputCommitCoordinator
17/10/03 16:07:09 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/10/03 16:07:09 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/10/03 16:07:09 INFO Executor: Starting executor ID driver on host localhost
17/10/03 16:07:09 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 44602.
17/10/03 16:07:09 INFO NettyBlockTransferService: Server created on localhost:44602
17/10/03 16:07:09 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 44602)
17/10/03 16:07:09 INFO BlockManagerMasterEndpoint: Registering block manager localhost:44602 with 15.8 GB RAM, BlockManagerId(driver, localhost, 44602)
17/10/03 16:07:09 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 44602)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:44602 (size: 14.3 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 0 from textFile at SuccinctTableRDDSuite.scala:19
17/10/03 16:07:09 INFO FileInputFormat: Total input paths to process : 1
17/10/03 16:07:09 INFO SparkContext: Starting job: first at SuccinctTableRDDSuite.scala:21
17/10/03 16:07:09 INFO DAGScheduler: Got job 0 (first at SuccinctTableRDDSuite.scala:21) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.3 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2025.0 B, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:44602 (size: 2025.0 B, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5470 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/10/03 16:07:09 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1291 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 10 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21) finished in 0.011 s
17/10/03 16:07:09 INFO DAGScheduler: Job 0 finished: first at SuccinctTableRDDSuite.scala:21, took 0.016108 s
17/10/03 16:07:09 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:227
17/10/03 16:07:09 INFO DAGScheduler: Got job 1 (fold at SuccinctTableRDD.scala:227) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 1 (fold at SuccinctTableRDD.scala:227)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:44602 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, PROCESS_LOCAL, 5469 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/10/03 16:07:09 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1178 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 21 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 1 (fold at SuccinctTableRDD.scala:227) finished in 0.021 s
17/10/03 16:07:09 INFO DAGScheduler: Job 1 finished: fold at SuccinctTableRDD.scala:227, took 0.024997 s
17/10/03 16:07:09 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:245
17/10/03 16:07:09 INFO DAGScheduler: Got job 2 (fold at SuccinctTableRDD.scala:245) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 2 (fold at SuccinctTableRDD.scala:245)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:44602 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 2.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 2, localhost, partition 0, PROCESS_LOCAL, 5469 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 2.0 (TID 2)
17/10/03 16:07:09 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 2.0 (TID 2). 1181 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 2) in 19 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 2 (fold at SuccinctTableRDD.scala:245) finished in 0.020 s
17/10/03 16:07:09 INFO DAGScheduler: Job 2 finished: fold at SuccinctTableRDD.scala:245, took 0.023067 s
17/10/03 16:07:09 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
17/10/03 16:07:09 INFO DAGScheduler: Got job 3 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 6.5 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.5 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:44602 (size: 3.5 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 3.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 3, localhost, partition 0, PROCESS_LOCAL, 5474 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 3.0 (TID 3)
17/10/03 16:07:09 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct-PRB/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/10/03 16:07:09 INFO MemoryStore: Block rdd_5_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added rdd_5_0 in memory on localhost:44602 (size: 81.1 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 3.0 (TID 3). 1682 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 3) in 56 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.056 s
17/10/03 16:07:09 INFO DAGScheduler: Job 3 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.060912 s
17/10/03 16:07:09 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:26
17/10/03 16:07:09 INFO DAGScheduler: Got job 4 (collect at SuccinctTableRDDSuite.scala:26) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.7 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 3.8 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:44602 (size: 3.8 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 4.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 4, localhost, partition 0, PROCESS_LOCAL, 5472 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 4.0 (TID 4)
17/10/03 16:07:09 INFO BlockManager: Found block rdd_5_0 locally
17/10/03 16:07:09 WARN Executor: 1 block locks were not released by TID = 4:
[rdd_5_0]
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 4.0 (TID 4). 177609 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 4) in 146 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26) finished in 0.147 s
17/10/03 16:07:09 INFO DAGScheduler: Job 4 finished: collect at SuccinctTableRDDSuite.scala:26, took 0.152003 s
17/10/03 16:07:09 INFO SparkContext: Starting job: foreach at SuccinctTableRDDImpl.scala:111
17/10/03 16:07:09 INFO DAGScheduler: Got job 5 (foreach at SuccinctTableRDDImpl.scala:111) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.1 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 3.3 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:44602 (size: 3.3 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 5.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 5, localhost, partition 0, PROCESS_LOCAL, 5582 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 5.0 (TID 5)
17/10/03 16:07:09 INFO BlockManager: Found block rdd_5_0 locally
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 5.0 (TID 5). 916 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 5) in 27 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111) finished in 0.028 s
17/10/03 16:07:09 INFO DAGScheduler: Job 5 finished: foreach at SuccinctTableRDDImpl.scala:111, took 0.032134 s
17/10/03 16:07:09 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
17/10/03 16:07:09 INFO DAGScheduler: Got job 6 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:44602 (size: 2.5 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 6.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 6, localhost, partition 0, PROCESS_LOCAL, 5392 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 6.0 (TID 6)
17/10/03 16:07:09 INFO MemoryStore: Block rdd_10_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added rdd_10_0 in memory on localhost:44602 (size: 81.1 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 6.0 (TID 6). 1522 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 6) in 14 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.016 s
17/10/03 16:07:09 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.020026 s
17/10/03 16:07:09 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:32
17/10/03 16:07:09 INFO DAGScheduler: Got job 7 (collect at SuccinctTableRDDSuite.scala:32) with 1 output partitions
17/10/03 16:07:09 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32)
17/10/03 16:07:09 INFO DAGScheduler: Parents of final stage: List()
17/10/03 16:07:09 INFO DAGScheduler: Missing parents: List()
17/10/03 16:07:09 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.6 KB, free 15.8 GB)
17/10/03 16:07:09 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.8 KB, free 15.8 GB)
17/10/03 16:07:09 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:44602 (size: 2.8 KB, free: 15.8 GB)
17/10/03 16:07:09 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
17/10/03 16:07:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Adding task set 7.0 with 1 tasks
17/10/03 16:07:09 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 7, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
17/10/03 16:07:09 INFO Executor: Running task 0.0 in stage 7.0 (TID 7)
17/10/03 16:07:09 INFO BlockManager: Found block rdd_10_0 locally
17/10/03 16:07:09 WARN Executor: 1 block locks were not released by TID = 7:
[rdd_10_0]
17/10/03 16:07:09 INFO Executor: Finished task 0.0 in stage 7.0 (TID 7). 177609 bytes result sent to driver
17/10/03 16:07:09 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 7) in 100 ms on localhost (1/1)
17/10/03 16:07:09 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/10/03 16:07:09 INFO DAGScheduler: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32) finished in 0.100 s
17/10/03 16:07:09 INFO DAGScheduler: Job 7 finished: collect at SuccinctTableRDDSuite.scala:32, took 0.103406 s
- Test save and retrieve in memory
17/10/03 16:07:09 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/10/03 16:07:09 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/10/03 16:07:09 INFO MemoryStore: MemoryStore cleared
17/10/03 16:07:09 INFO BlockManager: BlockManager stopped
17/10/03 16:07:09 INFO BlockManagerMaster: BlockManagerMaster stopped
17/10/03 16:07:09 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/10/03 16:07:09 INFO SparkContext: Successfully stopped SparkContext
Run completed in 53 seconds, 33 milliseconds.
Total number of tests run: 33
Suites: completed 6, aborted 0
Tests: succeeded 33, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
17/10/03 16:07:09 INFO ShutdownHookManager: Shutdown hook called
17/10/03 16:07:09 INFO ShutdownHookManager: Deleting directory /tmp/spark-4867f394-3eee-460d-80e9-5d7a1c3faa9a
[JENKINS] Recording test results
[INFO] 
[INFO] --- maven-jar-plugin:2.3.2:jar (default-jar) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct-PRB/spark/target/succinct-spark-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-spark ---
[INFO] Configured Artifact: amplab:succinct-spark:0.1.8:jar
[INFO] amplab:succinct-spark:0.1.8:jar already exists in /home/jenkins/workspace/Succinct-PRB/spark/target
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (make-assembly) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct-PRB/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ succinct-spark ---
[INFO] Installing /home/jenkins/workspace/Succinct-PRB/spark/target/succinct-spark-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[INFO] Installing /home/jenkins/workspace/Succinct-PRB/spark/pom.xml to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[INFO] Installing /home/jenkins/workspace/Succinct-PRB/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Succinct Assembly 0.1.8
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (package-all) @ succinct-assembly ---
[INFO] Reading assembly descriptor: src/main/assembly/assembly.xml
[INFO] Building jar: /home/jenkins/workspace/Succinct-PRB/assembly/../target/succinct-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:pom
[INFO] Copying pom.xml to /home/jenkins/workspace/Succinct-PRB/assembly/target/pom.xml
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ succinct-assembly ---
[INFO] Skipping artifact installation
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (install-assembly-jar) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:jar
[INFO] Copying succinct-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct/0.1.8/succinct-0.1.8.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Succinct .......................................... SUCCESS [2.799s]
[INFO] Succinct Core ..................................... SUCCESS [29.247s]
[INFO] Succinct Serialization/Deserialization ............ SUCCESS [2.030s]
[INFO] Succinct on Apache Spark .......................... SUCCESS [1:58.645s]
[INFO] Succinct Assembly ................................. SUCCESS [0.827s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:34.786s
[INFO] Finished at: Tue Oct 03 16:07:13 PDT 2017
[INFO] Final Memory: 60M/3016M
[INFO] ------------------------------------------------------------------------
Waiting for Jenkins to finish collecting data
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/assembly/pom.xml to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/assembly/../target/succinct-0.1.8.jar to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.jar
/home/jenkins/workspace/Succinct-PRB/target/succinct-0.1.8.jar is not inside /home/jenkins/workspace/Succinct-PRB/assembly/; will archive in a separate pass
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/pom.xml to amplab/succinct/0.1.8/succinct-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/spark/pom.xml to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/spark/target/succinct-spark-0.1.8.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/serde/pom.xml to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/serde/target/succinct-serde-0.1.8.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/serde/target/succinct-serde-0.1.8-tests.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/core/pom.xml to amplab/succinct-core/0.1.8/succinct-core-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/core/target/succinct-core-0.1.8.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/core/target/succinct-core-0.1.8-tests.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct-PRB/core/target/succinct-core-0.1.8-jar-with-dependencies.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-jar-with-dependencies.jar
channel stopped
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/Succinct-PRB/2/
Test PASSed.
Finished: SUCCESS