SuccessConsole Output

Skipping 3,856 KB.. Full Log
reated local directory at /tmp/blockmgr-23cc4e54-7882-43a8-a586-c490f12b38d8
17/03/01 13:51:36 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/03/01 13:51:36 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/01 13:51:36 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/01 13:51:36 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/03/01 13:51:36 INFO Executor: Starting executor ID driver on host localhost
17/03/01 13:51:36 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 33771.
17/03/01 13:51:36 INFO NettyBlockTransferService: Server created on localhost:33771
17/03/01 13:51:36 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 33771)
17/03/01 13:51:36 INFO BlockManagerMasterEndpoint: Registering block manager localhost:33771 with 15.8 GB RAM, BlockManagerId(driver, localhost, 33771)
17/03/01 13:51:36 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 33771)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:33771 (size: 14.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:146
17/03/01 13:51:36 INFO FileInputFormat: Total input paths to process : 1
17/03/01 13:51:36 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
17/03/01 13:51:36 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:146)
17/03/01 13:51:36 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
17/03/01 13:51:36 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:33771 (size: 2.7 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/03/01 13:51:36 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 18 ms on localhost (1/1)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:146) finished in 0.018 s
17/03/01 13:51:36 INFO DAGScheduler: looking for newly runnable stages
17/03/01 13:51:36 INFO DAGScheduler: running: Set()
17/03/01 13:51:36 INFO DAGScheduler: waiting: Set(ResultStage 1)
17/03/01 13:51:36 INFO DAGScheduler: failed: Set()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:33771 (size: 2.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 6 ms on localhost (1/5)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 4 ms on localhost (2/5)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 4 ms on localhost (3/5)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 3 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 3 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.019 s
17/03/01 13:51:36 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.044708 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
17/03/01 13:51:36 INFO DAGScheduler: Got job 1 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 3.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:33771 (size: 1128.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 6 ms on localhost (1/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:33771 (size: 1440.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 4 ms on localhost (2/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:33771 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 4 ms on localhost (3/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:33771 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 10, localhost, partition 4, NODE_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 3.0 (TID 10)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 5 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:33771 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 3.0 (TID 10). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 3.0 (TID 10) in 5 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.024 s
17/03/01 13:51:36 INFO DAGScheduler: Job 1 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.028722 s
17/03/01 13:51:36 INFO SparkContext: Starting job: count at SuccinctJsonRDD.scala:90
17/03/01 13:51:36 INFO DAGScheduler: Got job 2 (count at SuccinctJsonRDD.scala:90) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 5 (count at SuccinctJsonRDD.scala:90)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:33771 (size: 2.1 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 11, localhost, partition 0, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 5.0 (TID 11)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 5.0 (TID 11). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 12, localhost, partition 1, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 5.0 (TID 12)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 11) in 4 ms on localhost (1/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 5.0 (TID 12). 1259 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 13, localhost, partition 2, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 5.0 (TID 13)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 12) in 4 ms on localhost (2/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 5.0 (TID 13). 1259 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 14, localhost, partition 3, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 5.0 (TID 14)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 13) in 3 ms on localhost (3/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 5.0 (TID 14). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 15, localhost, partition 4, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 5.0 (TID 15)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 14) in 3 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 5.0 (TID 15). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 15) in 3 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 5 (count at SuccinctJsonRDD.scala:90) finished in 0.016 s
17/03/01 13:51:36 INFO DAGScheduler: Job 2 finished: count at SuccinctJsonRDD.scala:90, took 0.019589 s
17/03/01 13:51:36 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:98
17/03/01 13:51:36 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDD.scala:98) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDD.scala:98)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:33771 (size: 2.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 16, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 7.0 (TID 16)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 7.0 (TID 16). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 17, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 7.0 (TID 17)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 16) in 5 ms on localhost (1/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 7.0 (TID 17). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 18, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 7.0 (TID 18)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 17) in 4 ms on localhost (2/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 7.0 (TID 18). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 19, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 7.0 (TID 19)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 18) in 3 ms on localhost (3/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 7.0 (TID 19). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 20, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 19) in 5 ms on localhost (4/5)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 7.0 (TID 20)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 7.0 (TID 20). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 20) in 5 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDD.scala:98) finished in 0.019 s
17/03/01 13:51:36 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDD.scala:98, took 0.022570 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Got job 4 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 8)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 9.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 21, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 9.0 (TID 21)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 9.0 (TID 21). 954 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 9.0 (TID 22, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 9.0 (TID 22)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 21) in 2 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 9.0 (TID 22). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 9.0 (TID 23, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 9.0 (TID 23)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 9.0 (TID 22) in 2 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 9.0 (TID 23). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 9.0 (TID 24, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 9.0 (TID 24)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 9.0 (TID 23) in 2 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 9.0 (TID 24). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 9.0 (TID 25, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 9.0 (TID 25)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 9.0 (TID 24) in 2 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 9.0 (TID 25). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 9.0 (TID 25) in 2 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 9.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.008 s
17/03/01 13:51:36 INFO DAGScheduler: Job 4 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.011038 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Got job 5 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 10)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 11.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 26, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 11.0 (TID 26)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 11.0 (TID 26). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 11.0 (TID 27, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 11.0 (TID 27)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 26) in 1 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 11.0 (TID 27). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 11.0 (TID 28, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 11.0 (TID 28)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 11.0 (TID 27) in 2 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 11.0 (TID 28). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 11.0 (TID 29, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 11.0 (TID 28) in 2 ms on localhost (3/5)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 11.0 (TID 29)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 11.0 (TID 29). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 11.0 (TID 30, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 11.0 (TID 30)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 11.0 (TID 29) in 2 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 11.0 (TID 30). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 11.0 (TID 30) in 1 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 11.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.009 s
17/03/01 13:51:36 INFO DAGScheduler: Job 5 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.011130 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Got job 6 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 12)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 13.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 31, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 13.0 (TID 31)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 13.0 (TID 31). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 32, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 13.0 (TID 32)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 31) in 2 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 13.0 (TID 32). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 13.0 (TID 33, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 13.0 (TID 33)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 32) in 1 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 13.0 (TID 33). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 13.0 (TID 34, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 13.0 (TID 34)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 13.0 (TID 33) in 1 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 13.0 (TID 34). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 13.0 (TID 35, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 13.0 (TID 35)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 13.0 (TID 34) in 2 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 13.0 (TID 35). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 13.0 (TID 35) in 2 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 13.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
17/03/01 13:51:36 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.009402 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Got job 7 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 14)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 15.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 36, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 15.0 (TID 36)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 15.0 (TID 36). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 15.0 (TID 37, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 15.0 (TID 37)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 36) in 2 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 15.0 (TID 37). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 15.0 (TID 38, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 15.0 (TID 38)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 15.0 (TID 37) in 2 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 15.0 (TID 38). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 15.0 (TID 39, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 15.0 (TID 39)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 15.0 (TID 38) in 1 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 15.0 (TID 39). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 15.0 (TID 40, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 15.0 (TID 40)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 15.0 (TID 39) in 1 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 15.0 (TID 40). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 15.0 (TID 40) in 1 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 15.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.006 s
17/03/01 13:51:36 INFO DAGScheduler: Job 7 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.009733 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Got job 8 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 16)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 17.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 41, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 17.0 (TID 41)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 17.0 (TID 41). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 17.0 (TID 42, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 17.0 (TID 42)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 41) in 1 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 17.0 (TID 42). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 17.0 (TID 43, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 17.0 (TID 43)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 17.0 (TID 42) in 2 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 17.0 (TID 43). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 17.0 (TID 44, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 17.0 (TID 44)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 17.0 (TID 43) in 2 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 17.0 (TID 44). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 17.0 (TID 45, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 17.0 (TID 45)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 17.0 (TID 44) in 1 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 17.0 (TID 45). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 17.0 (TID 45) in 1 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 17.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
17/03/01 13:51:36 INFO DAGScheduler: Job 8 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.009892 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Got job 9 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 18)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on localhost:33771 (size: 2.6 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 19.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 46, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 19.0 (TID 46)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 19.0 (TID 46). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 19.0 (TID 47, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 19.0 (TID 47)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 46) in 2 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 19.0 (TID 47). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 19.0 (TID 48, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 19.0 (TID 48)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 19.0 (TID 47) in 1 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 19.0 (TID 48). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 19.0 (TID 49, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 19.0 (TID 49)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 19.0 (TID 48) in 1 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 19.0 (TID 49). 875 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 19.0 (TID 50, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 19.0 (TID 50)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 19.0 (TID 49) in 2 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 19.0 (TID 50). 788 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 19.0 (TID 50) in 2 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 19.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
17/03/01 13:51:36 INFO DAGScheduler: Job 9 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.010157 s
17/03/01 13:51:36 INFO MapPartitionsRDD: Removing RDD 7 from persistence list
17/03/01 13:51:36 INFO BlockManager: Removing RDD 7
17/03/01 13:51:36 INFO SparkContext: Starting job: count at SuccinctJsonRDDSuite.scala:150
17/03/01 13:51:36 INFO DAGScheduler: Got job 10 (count at SuccinctJsonRDDSuite.scala:150) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 20)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on localhost:33771 (size: 2.1 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 21.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 51, localhost, partition 0, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 21.0 (TID 51)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 21.0 (TID 51). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 21.0 (TID 52, localhost, partition 1, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 21.0 (TID 52)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 51) in 4 ms on localhost (1/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 21.0 (TID 52). 1259 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 21.0 (TID 53, localhost, partition 2, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 21.0 (TID 53)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 21.0 (TID 52) in 3 ms on localhost (2/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 21.0 (TID 53). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 21.0 (TID 54, localhost, partition 3, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 21.0 (TID 54)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 21.0 (TID 53) in 3 ms on localhost (3/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 21.0 (TID 54). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 21.0 (TID 55, localhost, partition 4, NODE_LOCAL, 5387 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 21.0 (TID 55)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 21.0 (TID 54) in 3 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 21.0 (TID 55). 1346 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 21.0 (TID 55) in 3 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 21.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150) finished in 0.016 s
17/03/01 13:51:36 INFO DAGScheduler: Job 10 finished: count at SuccinctJsonRDDSuite.scala:150, took 0.018924 s
17/03/01 13:51:36 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
17/03/01 13:51:36 INFO DAGScheduler: Registering RDD 17 (repartition at SuccinctJsonRDD.scala:94)
17/03/01 13:51:36 INFO DAGScheduler: Got job 11 (aggregate at SuccinctJsonRDD.scala:113) with 10 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 22, ShuffleMapStage 23)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 23)
17/03/01 13:51:36 INFO DAGScheduler: Submitting ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on localhost:33771 (size: 2.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 23.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 56, localhost, partition 0, NODE_LOCAL, 5466 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 23.0 (TID 56)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 23.0 (TID 56). 1635 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 23.0 (TID 57, localhost, partition 1, NODE_LOCAL, 5466 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 56) in 7 ms on localhost (1/5)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 23.0 (TID 57)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 23.0 (TID 57). 1548 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 23.0 (TID 58, localhost, partition 2, NODE_LOCAL, 5466 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 23.0 (TID 57) in 6 ms on localhost (2/5)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 23.0 (TID 58)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 23.0 (TID 58). 1635 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 23.0 (TID 59, localhost, partition 3, NODE_LOCAL, 5466 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 23.0 (TID 59)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 23.0 (TID 58) in 10 ms on localhost (3/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 23.0 (TID 59). 1635 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 23.0 (TID 60, localhost, partition 4, NODE_LOCAL, 5466 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 23.0 (TID 60)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 23.0 (TID 59) in 8 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 23.0 (TID 60). 1635 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 23.0 (TID 60) in 10 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 23.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ShuffleMapStage 23 (repartition at SuccinctJsonRDD.scala:94) finished in 0.039 s
17/03/01 13:51:36 INFO DAGScheduler: looking for newly runnable stages
17/03/01 13:51:36 INFO DAGScheduler: running: Set()
17/03/01 13:51:36 INFO DAGScheduler: waiting: Set(ResultStage 24)
17/03/01 13:51:36 INFO DAGScheduler: failed: Set()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 5.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 3.2 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on localhost:33771 (size: 3.2 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 24.0 with 10 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 61, localhost, partition 0, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 24.0 (TID 61)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_0 in memory on localhost:33771 (size: 1128.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 24.0 (TID 61). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 24.0 (TID 62, localhost, partition 1, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 24.0 (TID 62)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 61) in 8 ms on localhost (1/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_1 in memory on localhost:33771 (size: 1440.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 24.0 (TID 62). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 24.0 (TID 63, localhost, partition 2, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 24.0 (TID 63)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 24.0 (TID 62) in 7 ms on localhost (2/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_2 in memory on localhost:33771 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 24.0 (TID 63). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 24.0 (TID 64, localhost, partition 3, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 24.0 (TID 64)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 24.0 (TID 63) in 6 ms on localhost (3/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_3 in memory on localhost:33771 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 24.0 (TID 64). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 24.0 (TID 65, localhost, partition 4, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 24.0 (TID 65)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 24.0 (TID 64) in 7 ms on localhost (4/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_4 in memory on localhost:33771 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 24.0 (TID 65). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 5.0 in stage 24.0 (TID 66, localhost, partition 5, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 5.0 in stage 24.0 (TID 66)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 24.0 (TID 65) in 7 ms on localhost (5/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_5 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_5 in memory on localhost:33771 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 5.0 in stage 24.0 (TID 66). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 6.0 in stage 24.0 (TID 67, localhost, partition 6, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 6.0 in stage 24.0 (TID 67)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 5.0 in stage 24.0 (TID 66) in 6 ms on localhost (6/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 5 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_6 stored as values in memory (estimated size 1872.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_6 in memory on localhost:33771 (size: 1872.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 6.0 in stage 24.0 (TID 67). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 8.0 in stage 24.0 (TID 68, localhost, partition 8, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 8.0 in stage 24.0 (TID 68)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 6.0 in stage 24.0 (TID 67) in 7 ms on localhost (7/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_8 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_8 in memory on localhost:33771 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 8.0 in stage 24.0 (TID 68). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 9.0 in stage 24.0 (TID 69, localhost, partition 9, NODE_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 9.0 in stage 24.0 (TID 69)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 8.0 in stage 24.0 (TID 68) in 8 ms on localhost (8/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_9 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_9 in memory on localhost:33771 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 9.0 in stage 24.0 (TID 69). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 7.0 in stage 24.0 (TID 70, localhost, partition 7, PROCESS_LOCAL, 5586 bytes)
17/03/01 13:51:36 INFO Executor: Running task 7.0 in stage 24.0 (TID 70)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 9.0 in stage 24.0 (TID 69) in 7 ms on localhost (9/10)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 5 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_22_7 stored as values in memory (estimated size 152.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_22_7 in memory on localhost:33771 (size: 152.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 7.0 in stage 24.0 (TID 70). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 7.0 in stage 24.0 (TID 70) in 5 ms on localhost (10/10)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 24.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.063 s
17/03/01 13:51:36 INFO DAGScheduler: Job 11 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.110318 s
- Test bulkAppend
17/03/01 13:51:36 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/03/01 13:51:36 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/01 13:51:36 INFO MemoryStore: MemoryStore cleared
17/03/01 13:51:36 INFO BlockManager: BlockManager stopped
17/03/01 13:51:36 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/01 13:51:36 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/01 13:51:36 INFO SparkContext: Successfully stopped SparkContext
17/03/01 13:51:36 INFO SparkContext: Running Spark version 2.0.1
17/03/01 13:51:36 INFO SecurityManager: Changing view acls to: jenkins
17/03/01 13:51:36 INFO SecurityManager: Changing modify acls to: jenkins
17/03/01 13:51:36 INFO SecurityManager: Changing view acls groups to: 
17/03/01 13:51:36 INFO SecurityManager: Changing modify acls groups to: 
17/03/01 13:51:36 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
17/03/01 13:51:36 INFO Utils: Successfully started service 'sparkDriver' on port 49049.
17/03/01 13:51:36 INFO SparkEnv: Registering MapOutputTracker
17/03/01 13:51:36 INFO SparkEnv: Registering BlockManagerMaster
17/03/01 13:51:36 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-05bf7a22-abe3-409d-ba07-ae193014328f
17/03/01 13:51:36 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/03/01 13:51:36 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/01 13:51:36 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/01 13:51:36 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/03/01 13:51:36 INFO Executor: Starting executor ID driver on host localhost
17/03/01 13:51:36 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 46411.
17/03/01 13:51:36 INFO NettyBlockTransferService: Server created on localhost:46411
17/03/01 13:51:36 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 46411)
17/03/01 13:51:36 INFO BlockManagerMasterEndpoint: Registering block manager localhost:46411 with 15.8 GB RAM, BlockManagerId(driver, localhost, 46411)
17/03/01 13:51:36 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 46411)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:46411 (size: 14.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:156
17/03/01 13:51:36 INFO FileInputFormat: Total input paths to process : 1
17/03/01 13:51:36 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
17/03/01 13:51:36 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:156)
17/03/01 13:51:36 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
17/03/01 13:51:36 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:46411 (size: 2.7 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/03/01 13:51:36 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 16 ms on localhost (1/1)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:156) finished in 0.016 s
17/03/01 13:51:36 INFO DAGScheduler: looking for newly runnable stages
17/03/01 13:51:36 INFO DAGScheduler: running: Set()
17/03/01 13:51:36 INFO DAGScheduler: waiting: Set(ResultStage 1)
17/03/01 13:51:36 INFO DAGScheduler: failed: Set()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:46411 (size: 2.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 5 ms on localhost (1/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 4 ms on localhost (2/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 4 ms on localhost (3/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 3 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1208 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 3 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.017 s
17/03/01 13:51:36 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.040053 s
17/03/01 13:51:36 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
17/03/01 13:51:36 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
17/03/01 13:51:36 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:46411 (size: 2.4 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:46411 (size: 1128.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 7 ms on localhost (1/4)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:46411 (size: 1440.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 1987 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 5 ms on localhost (2/4)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:46411 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 4 ms on localhost (3/4)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:46411 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 6 ms on localhost (4/4)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.021 s
17/03/01 13:51:36 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.024489 s
17/03/01 13:51:36 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
17/03/01 13:51:36 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:46411 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 18 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 16 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 17 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 16 ms on localhost (4/5)
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:36 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:36 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:46411 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 23 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.088 s
17/03/01 13:51:36 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.091769 s
17/03/01 13:51:36 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:165
17/03/01 13:51:36 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:165) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:46411 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 5 ms on localhost (1/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 1026 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 3 ms on localhost (2/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 992 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 3 ms on localhost (3/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 3 ms on localhost (4/5)
17/03/01 13:51:36 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 910 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 2 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165) finished in 0.017 s
17/03/01 13:51:36 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:165, took 0.020628 s
17/03/01 13:51:36 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:166
17/03/01 13:51:36 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:166) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:36 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:46411 (size: 1516.0 B, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
17/03/01 13:51:36 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:46411 (size: 1128.0 B, free: 15.8 GB)
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
17/03/01 13:51:36 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:36 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 16 ms on localhost (1/5)
17/03/01 13:51:36 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:46411 (size: 1440.0 B, free: 15.8 GB)
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
17/03/01 13:51:36 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:36 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 15 ms on localhost (2/5)
17/03/01 13:51:36 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:46411 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
17/03/01 13:51:36 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1560 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 14 ms on localhost (3/5)
17/03/01 13:51:36 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
17/03/01 13:51:36 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:46411 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
17/03/01 13:51:36 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1575 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:36 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
17/03/01 13:51:36 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 14 ms on localhost (4/5)
17/03/01 13:51:36 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:46411 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:36 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
17/03/01 13:51:36 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1565 bytes result sent to driver
17/03/01 13:51:36 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 14 ms on localhost (5/5)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
17/03/01 13:51:36 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166) finished in 0.071 s
17/03/01 13:51:36 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:166, took 0.073511 s
- Test save and load in memory
17/03/01 13:51:36 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/03/01 13:51:36 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/01 13:51:36 INFO MemoryStore: MemoryStore cleared
17/03/01 13:51:36 INFO BlockManager: BlockManager stopped
17/03/01 13:51:36 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/01 13:51:36 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/01 13:51:36 INFO SparkContext: Successfully stopped SparkContext
17/03/01 13:51:36 INFO SparkContext: Running Spark version 2.0.1
17/03/01 13:51:36 INFO SecurityManager: Changing view acls to: jenkins
17/03/01 13:51:36 INFO SecurityManager: Changing modify acls to: jenkins
17/03/01 13:51:36 INFO SecurityManager: Changing view acls groups to: 
17/03/01 13:51:36 INFO SecurityManager: Changing modify acls groups to: 
17/03/01 13:51:36 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
17/03/01 13:51:36 INFO Utils: Successfully started service 'sparkDriver' on port 60394.
17/03/01 13:51:36 INFO SparkEnv: Registering MapOutputTracker
17/03/01 13:51:36 INFO SparkEnv: Registering BlockManagerMaster
17/03/01 13:51:36 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-6a63c534-1533-4b48-8ae3-90eed2beb143
17/03/01 13:51:36 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/03/01 13:51:36 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/01 13:51:36 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/01 13:51:36 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/03/01 13:51:36 INFO Executor: Starting executor ID driver on host localhost
17/03/01 13:51:36 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 52177.
17/03/01 13:51:36 INFO NettyBlockTransferService: Server created on localhost:52177
17/03/01 13:51:36 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 52177)
17/03/01 13:51:36 INFO BlockManagerMasterEndpoint: Registering block manager localhost:52177 with 15.8 GB RAM, BlockManagerId(driver, localhost, 52177)
17/03/01 13:51:36 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 52177)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:52177 (size: 14.3 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:174
17/03/01 13:51:36 INFO FileInputFormat: Total input paths to process : 1
17/03/01 13:51:36 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
17/03/01 13:51:36 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:174)
17/03/01 13:51:36 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
17/03/01 13:51:36 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
17/03/01 13:51:36 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
17/03/01 13:51:36 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
17/03/01 13:51:36 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174), which has no missing parents
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
17/03/01 13:51:36 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
17/03/01 13:51:36 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:52177 (size: 2.7 KB, free: 15.8 GB)
17/03/01 13:51:36 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:36 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174)
17/03/01 13:51:36 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/03/01 13:51:36 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
17/03/01 13:51:36 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/03/01 13:51:37 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 16 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:174) finished in 0.017 s
17/03/01 13:51:37 INFO DAGScheduler: looking for newly runnable stages
17/03/01 13:51:37 INFO DAGScheduler: running: Set()
17/03/01 13:51:37 INFO DAGScheduler: waiting: Set(ResultStage 1)
17/03/01 13:51:37 INFO DAGScheduler: failed: Set()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:52177 (size: 2.3 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 6 ms on localhost (1/5)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1208 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 4 ms on localhost (2/5)
17/03/01 13:51:37 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 4 ms on localhost (3/5)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 4 ms on localhost (4/5)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1208 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 3 ms on localhost (5/5)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.020 s
17/03/01 13:51:37 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.043334 s
17/03/01 13:51:37 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
17/03/01 13:51:37 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
17/03/01 13:51:37 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:52177 (size: 2.4 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
17/03/01 13:51:37 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:52177 (size: 1128.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:37 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 7 ms on localhost (1/4)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:52177 (size: 1440.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:37 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 5 ms on localhost (2/4)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:52177 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
17/03/01 13:51:37 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 4 ms on localhost (3/4)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:52177 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 4 ms on localhost (4/4)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.019 s
17/03/01 13:51:37 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.022664 s
17/03/01 13:51:37 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
17/03/01 13:51:37 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:52177 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:37 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 16 ms on localhost (1/5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:37 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:37 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 15 ms on localhost (2/5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:37 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
17/03/01 13:51:37 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 16 ms on localhost (3/5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:37 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
17/03/01 13:51:37 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 16 ms on localhost (4/5)
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
17/03/01 13:51:37 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
17/03/01 13:51:37 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:52177 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 18 ms on localhost (5/5)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.080 s
17/03/01 13:51:37 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.084330 s
17/03/01 13:51:37 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:183
17/03/01 13:51:37 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:183) with 5 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:52177 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_0 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 3 ms on localhost (1/5)
17/03/01 13:51:37 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_1 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
17/03/01 13:51:37 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 939 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 3 ms on localhost (2/5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_2 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
17/03/01 13:51:37 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 905 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 3 ms on localhost (3/5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_3 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
17/03/01 13:51:37 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
17/03/01 13:51:37 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 3 ms on localhost (4/5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_7_4 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
17/03/01 13:51:37 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 997 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 2 ms on localhost (5/5)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183) finished in 0.014 s
17/03/01 13:51:37 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:183, took 0.017099 s
17/03/01 13:51:37 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:184
17/03/01 13:51:37 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:184) with 5 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:52177 (size: 1516.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
17/03/01 13:51:37 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:52177 (size: 1128.0 B, free: 15.8 GB)
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 16 ms on localhost (1/5)
17/03/01 13:51:37 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
17/03/01 13:51:37 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:52177 (size: 1440.0 B, free: 15.8 GB)
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
17/03/01 13:51:37 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:37 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 17 ms on localhost (2/5)
17/03/01 13:51:37 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:52177 (size: 1284.0 B, free: 15.8 GB)
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
17/03/01 13:51:37 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1473 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:37 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 17 ms on localhost (3/5)
17/03/01 13:51:37 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:52177 (size: 1156.0 B, free: 15.8 GB)
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
17/03/01 13:51:37 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1575 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:37 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 15 ms on localhost (4/5)
17/03/01 13:51:37 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:52177 (size: 1044.0 B, free: 15.8 GB)
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
17/03/01 13:51:37 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1565 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 15 ms on localhost (5/5)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184) finished in 0.078 s
17/03/01 13:51:37 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:184, took 0.081062 s
- Test save and load in memory 2
17/03/01 13:51:37 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/03/01 13:51:37 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/01 13:51:37 INFO MemoryStore: MemoryStore cleared
17/03/01 13:51:37 INFO BlockManager: BlockManager stopped
17/03/01 13:51:37 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/01 13:51:37 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/01 13:51:37 INFO SparkContext: Successfully stopped SparkContext
SuccinctTableRDDSuite:
17/03/01 13:51:37 INFO SparkContext: Running Spark version 2.0.1
17/03/01 13:51:37 INFO SecurityManager: Changing view acls to: jenkins
17/03/01 13:51:37 INFO SecurityManager: Changing modify acls to: jenkins
17/03/01 13:51:37 INFO SecurityManager: Changing view acls groups to: 
17/03/01 13:51:37 INFO SecurityManager: Changing modify acls groups to: 
17/03/01 13:51:37 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
17/03/01 13:51:37 INFO Utils: Successfully started service 'sparkDriver' on port 34424.
17/03/01 13:51:37 INFO SparkEnv: Registering MapOutputTracker
17/03/01 13:51:37 INFO SparkEnv: Registering BlockManagerMaster
17/03/01 13:51:37 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-f3d28852-0d9e-43a8-b300-8d4c3d62587e
17/03/01 13:51:37 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
17/03/01 13:51:37 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/01 13:51:37 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/01 13:51:37 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
17/03/01 13:51:37 INFO Executor: Starting executor ID driver on host localhost
17/03/01 13:51:37 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 37825.
17/03/01 13:51:37 INFO NettyBlockTransferService: Server created on localhost:37825
17/03/01 13:51:37 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 37825)
17/03/01 13:51:37 INFO BlockManagerMasterEndpoint: Registering block manager localhost:37825 with 15.8 GB RAM, BlockManagerId(driver, localhost, 37825)
17/03/01 13:51:37 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 37825)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:37825 (size: 14.3 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 0 from textFile at SuccinctTableRDDSuite.scala:19
17/03/01 13:51:37 INFO FileInputFormat: Total input paths to process : 1
17/03/01 13:51:37 INFO SparkContext: Starting job: first at SuccinctTableRDDSuite.scala:21
17/03/01 13:51:37 INFO DAGScheduler: Got job 0 (first at SuccinctTableRDDSuite.scala:21) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.3 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2021.0 B, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:37825 (size: 2021.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5466 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/03/01 13:51:37 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1291 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 7 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21) finished in 0.008 s
17/03/01 13:51:37 INFO DAGScheduler: Job 0 finished: first at SuccinctTableRDDSuite.scala:21, took 0.011866 s
17/03/01 13:51:37 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:227
17/03/01 13:51:37 INFO DAGScheduler: Got job 1 (fold at SuccinctTableRDD.scala:227) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 1 (fold at SuccinctTableRDD.scala:227)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:37825 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, PROCESS_LOCAL, 5465 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
17/03/01 13:51:37 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1178 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 10 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 1 (fold at SuccinctTableRDD.scala:227) finished in 0.011 s
17/03/01 13:51:37 INFO DAGScheduler: Job 1 finished: fold at SuccinctTableRDD.scala:227, took 0.014781 s
17/03/01 13:51:37 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:245
17/03/01 13:51:37 INFO DAGScheduler: Got job 2 (fold at SuccinctTableRDD.scala:245) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 2 (fold at SuccinctTableRDD.scala:245)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:37825 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 2.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 2, localhost, partition 0, PROCESS_LOCAL, 5465 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 2.0 (TID 2)
17/03/01 13:51:37 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 2.0 (TID 2). 1181 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 2) in 10 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 2 (fold at SuccinctTableRDD.scala:245) finished in 0.011 s
17/03/01 13:51:37 INFO DAGScheduler: Job 2 finished: fold at SuccinctTableRDD.scala:245, took 0.014412 s
17/03/01 13:51:37 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
17/03/01 13:51:37 INFO DAGScheduler: Got job 3 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 6.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:37825 (size: 3.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 3.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 3, localhost, partition 0, PROCESS_LOCAL, 5470 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 3.0 (TID 3)
17/03/01 13:51:37 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
17/03/01 13:51:37 INFO MemoryStore: Block rdd_5_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_5_0 in memory on localhost:37825 (size: 81.1 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 3.0 (TID 3). 1682 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 3) in 61 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.062 s
17/03/01 13:51:37 INFO DAGScheduler: Job 3 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.065741 s
17/03/01 13:51:37 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:26
17/03/01 13:51:37 INFO DAGScheduler: Got job 4 (collect at SuccinctTableRDDSuite.scala:26) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.7 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 3.8 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:37825 (size: 3.8 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 4.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 4, localhost, partition 0, PROCESS_LOCAL, 5468 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 4.0 (TID 4)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_5_0 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 4:
[rdd_5_0]
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 4.0 (TID 4). 177682 bytes result sent to driver
17/03/01 13:51:37 INFO BlockManagerInfo: Removed broadcast_4_piece0 on localhost:37825 in memory (size: 3.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Removed broadcast_1_piece0 on localhost:37825 in memory (size: 2021.0 B, free: 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Removed broadcast_2_piece0 on localhost:37825 in memory (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Removed broadcast_3_piece0 on localhost:37825 in memory (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 4) in 181 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26) finished in 0.181 s
17/03/01 13:51:37 INFO DAGScheduler: Job 4 finished: collect at SuccinctTableRDDSuite.scala:26, took 0.185313 s
17/03/01 13:51:37 INFO SparkContext: Starting job: foreach at SuccinctTableRDDImpl.scala:111
17/03/01 13:51:37 INFO DAGScheduler: Got job 5 (foreach at SuccinctTableRDDImpl.scala:111) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.1 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 3.3 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:37825 (size: 3.3 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 5.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 5, localhost, partition 0, PROCESS_LOCAL, 5578 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 5.0 (TID 5)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_5_0 locally
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 5.0 (TID 5). 916 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 5) in 18 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111) finished in 0.019 s
17/03/01 13:51:37 INFO DAGScheduler: Job 5 finished: foreach at SuccinctTableRDDImpl.scala:111, took 0.022202 s
17/03/01 13:51:37 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
17/03/01 13:51:37 INFO DAGScheduler: Got job 6 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:37825 (size: 2.5 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 6.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 6, localhost, partition 0, PROCESS_LOCAL, 5392 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 6.0 (TID 6)
17/03/01 13:51:37 INFO MemoryStore: Block rdd_10_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added rdd_10_0 in memory on localhost:37825 (size: 81.1 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 6.0 (TID 6). 1522 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 6) in 15 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.016 s
17/03/01 13:51:37 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.019128 s
17/03/01 13:51:37 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:32
17/03/01 13:51:37 INFO DAGScheduler: Got job 7 (collect at SuccinctTableRDDSuite.scala:32) with 1 output partitions
17/03/01 13:51:37 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32)
17/03/01 13:51:37 INFO DAGScheduler: Parents of final stage: List()
17/03/01 13:51:37 INFO DAGScheduler: Missing parents: List()
17/03/01 13:51:37 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.6 KB, free 15.8 GB)
17/03/01 13:51:37 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.8 KB, free 15.8 GB)
17/03/01 13:51:37 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:37825 (size: 2.8 KB, free: 15.8 GB)
17/03/01 13:51:37 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
17/03/01 13:51:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Adding task set 7.0 with 1 tasks
17/03/01 13:51:37 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 7, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
17/03/01 13:51:37 INFO Executor: Running task 0.0 in stage 7.0 (TID 7)
17/03/01 13:51:37 INFO BlockManager: Found block rdd_10_0 locally
17/03/01 13:51:37 WARN Executor: 1 block locks were not released by TID = 7:
[rdd_10_0]
17/03/01 13:51:37 INFO Executor: Finished task 0.0 in stage 7.0 (TID 7). 177609 bytes result sent to driver
17/03/01 13:51:37 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 7) in 110 ms on localhost (1/1)
17/03/01 13:51:37 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
17/03/01 13:51:37 INFO DAGScheduler: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32) finished in 0.111 s
17/03/01 13:51:37 INFO DAGScheduler: Job 7 finished: collect at SuccinctTableRDDSuite.scala:32, took 0.113782 s
- Test save and retrieve in memory
17/03/01 13:51:37 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
17/03/01 13:51:37 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/01 13:51:37 INFO MemoryStore: MemoryStore cleared
17/03/01 13:51:37 INFO BlockManager: BlockManager stopped
17/03/01 13:51:37 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/01 13:51:37 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/01 13:51:37 INFO SparkContext: Successfully stopped SparkContext
Run completed in 55 seconds, 255 milliseconds.
Total number of tests run: 33
Suites: completed 6, aborted 0
Tests: succeeded 33, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
17/03/01 13:51:37 INFO ShutdownHookManager: Shutdown hook called
17/03/01 13:51:37 INFO ShutdownHookManager: Deleting directory /tmp/spark-0b76e777-54ac-4705-be54-ae5c26664af1
[JENKINS] Recording test results
[INFO] 
[INFO] --- maven-jar-plugin:2.3.2:jar (default-jar) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-spark ---
[INFO] Configured Artifact: amplab:succinct-spark:0.1.8:jar
[INFO] amplab:succinct-spark:0.1.8:jar already exists in /home/jenkins/workspace/Succinct/spark/target
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (make-assembly) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ succinct-spark ---
[INFO] Installing /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[INFO] Installing /home/jenkins/workspace/Succinct/spark/pom.xml to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[INFO] Installing /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Succinct Assembly 0.1.8
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (package-all) @ succinct-assembly ---
[INFO] Reading assembly descriptor: src/main/assembly/assembly.xml
[INFO] Building jar: /home/jenkins/workspace/Succinct/assembly/../target/succinct-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:pom
[INFO] Copying pom.xml to /home/jenkins/workspace/Succinct/assembly/target/pom.xml
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ succinct-assembly ---
[INFO] Skipping artifact installation
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (install-assembly-jar) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:jar
[INFO] Copying succinct-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct/0.1.8/succinct-0.1.8.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Succinct .......................................... SUCCESS [2.176s]
[INFO] Succinct Core ..................................... SUCCESS [27.429s]
[INFO] Succinct Serialization/Deserialization ............ SUCCESS [1.230s]
[INFO] Succinct on Apache Spark .......................... SUCCESS [2:04.479s]
[INFO] Succinct Assembly ................................. SUCCESS [0.938s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:37.392s
[INFO] Finished at: Wed Mar 01 13:51:42 PST 2017
[INFO] Final Memory: 57M/2330M
[INFO] ------------------------------------------------------------------------
Waiting for Jenkins to finish collecting data
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/pom.xml to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/pom.xml to amplab/succinct-core/0.1.8/succinct-core-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8-tests.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8-jar-with-dependencies.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/assembly/pom.xml to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/assembly/../target/succinct-0.1.8.jar to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.jar
/home/jenkins/workspace/Succinct/target/succinct-0.1.8.jar is not inside /home/jenkins/workspace/Succinct/assembly/; will archive in a separate pass
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/pom.xml to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/target/succinct-serde-0.1.8.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/target/succinct-serde-0.1.8-tests.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/pom.xml to amplab/succinct/0.1.8/succinct-0.1.8.pom
channel stopped
Finished: SUCCESS