SuccessConsole Output

Skipping 3,904 KB.. Full Log
led; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/10/26 02:43:43 INFO Utils: Successfully started service 'sparkDriver' on port 55949.
16/10/26 02:43:43 INFO SparkEnv: Registering MapOutputTracker
16/10/26 02:43:43 INFO SparkEnv: Registering BlockManagerMaster
16/10/26 02:43:43 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-b210cdee-6c4c-492e-a1a8-1796c2293e1c
16/10/26 02:43:43 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/10/26 02:43:43 INFO SparkEnv: Registering OutputCommitCoordinator
16/10/26 02:43:43 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/10/26 02:43:43 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/10/26 02:43:43 INFO Executor: Starting executor ID driver on host localhost
16/10/26 02:43:43 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 44154.
16/10/26 02:43:43 INFO NettyBlockTransferService: Server created on localhost:44154
16/10/26 02:43:43 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 44154)
16/10/26 02:43:43 INFO BlockManagerMasterEndpoint: Registering block manager localhost:44154 with 15.8 GB RAM, BlockManagerId(driver, localhost, 44154)
16/10/26 02:43:43 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 44154)
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:44154 (size: 14.3 KB, free: 15.8 GB)
16/10/26 02:43:43 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:146
16/10/26 02:43:43 INFO FileInputFormat: Total input paths to process : 1
16/10/26 02:43:43 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
16/10/26 02:43:43 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:146)
16/10/26 02:43:43 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
16/10/26 02:43:43 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
16/10/26 02:43:43 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
16/10/26 02:43:43 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
16/10/26 02:43:43 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:44154 (size: 2.7 KB, free: 15.8 GB)
16/10/26 02:43:43 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:43 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146)
16/10/26 02:43:43 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/10/26 02:43:43 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
16/10/26 02:43:43 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/10/26 02:43:43 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
16/10/26 02:43:43 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 18 ms on localhost (1/1)
16/10/26 02:43:43 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/10/26 02:43:43 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:146) finished in 0.018 s
16/10/26 02:43:43 INFO DAGScheduler: looking for newly runnable stages
16/10/26 02:43:43 INFO DAGScheduler: running: Set()
16/10/26 02:43:43 INFO DAGScheduler: waiting: Set(ResultStage 1)
16/10/26 02:43:43 INFO DAGScheduler: failed: Set()
16/10/26 02:43:43 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:44154 (size: 2.3 KB, free: 15.8 GB)
16/10/26 02:43:43 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:43 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
16/10/26 02:43:43 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
16/10/26 02:43:43 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:43 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 8 ms on localhost (1/5)
16/10/26 02:43:43 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:43 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 8 ms on localhost (2/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:43 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 9 ms on localhost (3/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:43 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 4 ms on localhost (4/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1208 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 4 ms on localhost (5/5)
16/10/26 02:43:43 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/10/26 02:43:43 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.030 s
16/10/26 02:43:43 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.057441 s
16/10/26 02:43:43 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:43 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
16/10/26 02:43:43 INFO DAGScheduler: Got job 1 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:43 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:43 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
16/10/26 02:43:43 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:43 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:43 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:43 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:43 INFO TaskSchedulerImpl: Adding task set 3.0 with 5 tasks
16/10/26 02:43:43 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5477 bytes)
16/10/26 02:43:43 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:44154 (size: 1128.0 B, free: 15.8 GB)
16/10/26 02:43:43 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5477 bytes)
16/10/26 02:43:43 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 11 ms on localhost (1/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:44154 (size: 1440.0 B, free: 15.8 GB)
16/10/26 02:43:43 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5477 bytes)
16/10/26 02:43:43 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 6 ms on localhost (2/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:44154 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:43 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5477 bytes)
16/10/26 02:43:43 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 9 ms on localhost (3/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:44154 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:43 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 10, localhost, partition 4, NODE_LOCAL, 5477 bytes)
16/10/26 02:43:43 INFO Executor: Running task 4.0 in stage 3.0 (TID 10)
16/10/26 02:43:43 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 6 ms on localhost (4/5)
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:43 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:43 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:43 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:44154 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:43 INFO Executor: Finished task 4.0 in stage 3.0 (TID 10). 1987 bytes result sent to driver
16/10/26 02:43:43 INFO TaskSetManager: Finished task 4.0 in stage 3.0 (TID 10) in 6 ms on localhost (5/5)
16/10/26 02:43:43 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/10/26 02:43:43 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.035 s
16/10/26 02:43:43 INFO DAGScheduler: Job 1 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.040181 s
16/10/26 02:43:43 INFO SparkContext: Starting job: count at SuccinctJsonRDD.scala:90
16/10/26 02:43:43 INFO DAGScheduler: Got job 2 (count at SuccinctJsonRDD.scala:90) with 5 output partitions
16/10/26 02:43:43 INFO DAGScheduler: Final stage: ResultStage 5 (count at SuccinctJsonRDD.scala:90)
16/10/26 02:43:43 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
16/10/26 02:43:43 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:43 INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
16/10/26 02:43:43 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:44154 (size: 2.1 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 11, localhost, partition 0, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 5.0 (TID 11)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 5.0 (TID 11). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 12, localhost, partition 1, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 5.0 (TID 12)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 11) in 9 ms on localhost (1/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 5.0 (TID 12). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 13, localhost, partition 2, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 5.0 (TID 13)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 12) in 8 ms on localhost (2/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 5.0 (TID 13). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 14, localhost, partition 3, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 5.0 (TID 14)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 13) in 8 ms on localhost (3/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 5.0 (TID 14). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 15, localhost, partition 4, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 5.0 (TID 15)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 14) in 8 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 5.0 (TID 15). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 15) in 7 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 5 (count at SuccinctJsonRDD.scala:90) finished in 0.038 s
16/10/26 02:43:44 INFO DAGScheduler: Job 2 finished: count at SuccinctJsonRDD.scala:90, took 0.044176 s
16/10/26 02:43:44 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:98
16/10/26 02:43:44 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDD.scala:98) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDD.scala:98)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:44154 (size: 2.3 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 16, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 7.0 (TID 16)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 7.0 (TID 16). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 17, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 7.0 (TID 17)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 16) in 7 ms on localhost (1/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 7.0 (TID 17). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 18, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 7.0 (TID 18)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 17) in 4 ms on localhost (2/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 7.0 (TID 18). 1208 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 19, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 7.0 (TID 19)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 18) in 4 ms on localhost (3/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 7.0 (TID 19). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 20, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 7.0 (TID 20)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 19) in 4 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 7.0 (TID 20). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 20) in 4 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDD.scala:98) finished in 0.022 s
16/10/26 02:43:44 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDD.scala:98, took 0.027424 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Got job 4 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 8)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 9.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 21, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 9.0 (TID 21)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 9.0 (TID 21). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 9.0 (TID 22, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 9.0 (TID 22)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 21) in 3 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 9.0 (TID 22). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 9.0 (TID 23, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 9.0 (TID 23)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 9.0 (TID 22) in 4 ms on localhost (2/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 9.0 (TID 23). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 9.0 (TID 24, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 9.0 (TID 24)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 9.0 (TID 23) in 4 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 9.0 (TID 24). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 9.0 (TID 25, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 9.0 (TID 25)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 9.0 (TID 24) in 4 ms on localhost (4/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 9.0 (TID 25). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 9.0 (TID 25) in 4 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 9.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.015 s
16/10/26 02:43:44 INFO DAGScheduler: Job 4 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.022010 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Got job 5 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 10)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 11.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 26, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 11.0 (TID 26)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 11.0 (TID 26). 954 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 11.0 (TID 27, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 11.0 (TID 27)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 26) in 4 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 11.0 (TID 27). 962 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 11.0 (TID 28, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 11.0 (TID 27) in 4 ms on localhost (2/5)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 11.0 (TID 28)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 11.0 (TID 28). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 11.0 (TID 29, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 11.0 (TID 29)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 11.0 (TID 28) in 4 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 11.0 (TID 29). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 11.0 (TID 30, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 11.0 (TID 30)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 11.0 (TID 29) in 4 ms on localhost (4/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 11.0 (TID 30). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 11.0 (TID 30) in 3 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 11.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.015 s
16/10/26 02:43:44 INFO DAGScheduler: Job 5 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.021053 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Got job 6 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 12)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 13.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 31, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 13.0 (TID 31)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 13.0 (TID 31). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 32, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 13.0 (TID 32)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 31) in 3 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 13.0 (TID 32). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 13.0 (TID 33, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 13.0 (TID 33)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 32) in 3 ms on localhost (2/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 13.0 (TID 33). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 13.0 (TID 34, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 13.0 (TID 34)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 13.0 (TID 33) in 3 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 13.0 (TID 34). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 13.0 (TID 35, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 13.0 (TID 35)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 13.0 (TID 34) in 3 ms on localhost (4/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 13.0 (TID 35). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 13.0 (TID 35) in 4 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 13.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.016 s
16/10/26 02:43:44 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.021046 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Got job 7 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 14)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 15.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 36, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 15.0 (TID 36)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 15.0 (TID 36). 954 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 15.0 (TID 37, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 15.0 (TID 37)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 36) in 4 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 15.0 (TID 37). 788 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 15.0 (TID 38, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 15.0 (TID 37) in 2 ms on localhost (2/5)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 15.0 (TID 38)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 15.0 (TID 38). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 15.0 (TID 39, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 15.0 (TID 39)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 15.0 (TID 38) in 2 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 15.0 (TID 39). 867 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 15.0 (TID 40, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 15.0 (TID 40)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 15.0 (TID 39) in 2 ms on localhost (4/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 15.0 (TID 40). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 15.0 (TID 40) in 2 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 15.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.010 s
16/10/26 02:43:44 INFO DAGScheduler: Job 7 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.015642 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Got job 8 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 16)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 17.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 41, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 17.0 (TID 41)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 17.0 (TID 41). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 17.0 (TID 42, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 17.0 (TID 42)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 41) in 3 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 17.0 (TID 42). 954 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 17.0 (TID 43, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 17.0 (TID 43)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 17.0 (TID 42) in 4 ms on localhost (2/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 17.0 (TID 43). 954 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 17.0 (TID 44, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 17.0 (TID 44)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 17.0 (TID 43) in 3 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 17.0 (TID 44). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 17.0 (TID 45, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 17.0 (TID 45)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 17.0 (TID 44) in 3 ms on localhost (4/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 17.0 (TID 45). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 17.0 (TID 45) in 3 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 17.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.014 s
16/10/26 02:43:44 INFO DAGScheduler: Job 8 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.019587 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Got job 9 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 18)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on localhost:44154 (size: 2.6 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 19.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 46, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 19.0 (TID 46)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 19.0 (TID 46). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 19.0 (TID 47, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 46) in 4 ms on localhost (1/5)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 19.0 (TID 47)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 19.0 (TID 47). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 19.0 (TID 48, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 19.0 (TID 47) in 4 ms on localhost (2/5)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 19.0 (TID 48)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 19.0 (TID 48). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 19.0 (TID 49, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 19.0 (TID 48) in 4 ms on localhost (3/5)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 19.0 (TID 49)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 19.0 (TID 49). 875 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 19.0 (TID 50, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 19.0 (TID 49) in 3 ms on localhost (4/5)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 19.0 (TID 50)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 19.0 (TID 50). 788 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 19.0 (TID 50) in 2 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 19.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.013 s
16/10/26 02:43:44 INFO DAGScheduler: Job 9 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.017434 s
16/10/26 02:43:44 INFO MapPartitionsRDD: Removing RDD 7 from persistence list
16/10/26 02:43:44 INFO BlockManager: Removing RDD 7
16/10/26 02:43:44 INFO SparkContext: Starting job: count at SuccinctJsonRDDSuite.scala:150
16/10/26 02:43:44 INFO DAGScheduler: Got job 10 (count at SuccinctJsonRDDSuite.scala:150) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 20)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on localhost:44154 (size: 2.1 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 21.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 51, localhost, partition 0, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 21.0 (TID 51)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 21.0 (TID 51). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 21.0 (TID 52, localhost, partition 1, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 21.0 (TID 52)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 51) in 7 ms on localhost (1/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 21.0 (TID 52). 1259 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 21.0 (TID 53, localhost, partition 2, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 21.0 (TID 53)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 21.0 (TID 52) in 4 ms on localhost (2/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 21.0 (TID 53). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 21.0 (TID 54, localhost, partition 3, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 21.0 (TID 54)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 21.0 (TID 53) in 5 ms on localhost (3/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 21.0 (TID 54). 1259 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 21.0 (TID 55, localhost, partition 4, NODE_LOCAL, 5387 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 21.0 (TID 55)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 21.0 (TID 54) in 4 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 21.0 (TID 55). 1346 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 21.0 (TID 55) in 4 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 21.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150) finished in 0.021 s
16/10/26 02:43:44 INFO DAGScheduler: Job 10 finished: count at SuccinctJsonRDDSuite.scala:150, took 0.026634 s
16/10/26 02:43:44 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/10/26 02:43:44 INFO DAGScheduler: Registering RDD 17 (repartition at SuccinctJsonRDD.scala:94)
16/10/26 02:43:44 INFO DAGScheduler: Got job 11 (aggregate at SuccinctJsonRDD.scala:113) with 10 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 22, ShuffleMapStage 23)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 23)
16/10/26 02:43:44 INFO DAGScheduler: Submitting ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on localhost:44154 (size: 2.3 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 23.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 56, localhost, partition 0, NODE_LOCAL, 5466 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 23.0 (TID 56)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 23.0 (TID 56). 1635 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 23.0 (TID 57, localhost, partition 1, NODE_LOCAL, 5466 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 23.0 (TID 57)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 56) in 13 ms on localhost (1/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 23.0 (TID 57). 1635 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 23.0 (TID 58, localhost, partition 2, NODE_LOCAL, 5466 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 23.0 (TID 58)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 23.0 (TID 57) in 6 ms on localhost (2/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 23.0 (TID 58). 1635 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 23.0 (TID 59, localhost, partition 3, NODE_LOCAL, 5466 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 23.0 (TID 59)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 23.0 (TID 58) in 6 ms on localhost (3/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 23.0 (TID 59). 1635 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 23.0 (TID 60, localhost, partition 4, NODE_LOCAL, 5466 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 23.0 (TID 60)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 23.0 (TID 59) in 7 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 23.0 (TID 60). 1548 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 23.0 (TID 60) in 6 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 23.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ShuffleMapStage 23 (repartition at SuccinctJsonRDD.scala:94) finished in 0.037 s
16/10/26 02:43:44 INFO DAGScheduler: looking for newly runnable stages
16/10/26 02:43:44 INFO DAGScheduler: running: Set()
16/10/26 02:43:44 INFO DAGScheduler: waiting: Set(ResultStage 24)
16/10/26 02:43:44 INFO DAGScheduler: failed: Set()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 5.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 3.2 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on localhost:44154 (size: 3.2 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 24.0 with 10 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 61, localhost, partition 0, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 24.0 (TID 61)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_0 in memory on localhost:44154 (size: 1128.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 24.0 (TID 61). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 24.0 (TID 62, localhost, partition 1, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 24.0 (TID 62)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 61) in 6 ms on localhost (1/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_1 in memory on localhost:44154 (size: 1440.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 24.0 (TID 62). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 24.0 (TID 63, localhost, partition 2, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 24.0 (TID 63)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 24.0 (TID 62) in 5 ms on localhost (2/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_2 in memory on localhost:44154 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 24.0 (TID 63). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 24.0 (TID 64, localhost, partition 3, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 24.0 (TID 64)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 24.0 (TID 63) in 6 ms on localhost (3/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_3 in memory on localhost:44154 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 24.0 (TID 64). 1987 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 24.0 (TID 65, localhost, partition 4, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 24.0 (TID 65)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 24.0 (TID 64) in 5 ms on localhost (4/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_4 in memory on localhost:44154 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 24.0 (TID 65). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 5.0 in stage 24.0 (TID 66, localhost, partition 5, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 5.0 in stage 24.0 (TID 66)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 24.0 (TID 65) in 9 ms on localhost (5/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_5 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_5 in memory on localhost:44154 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 5.0 in stage 24.0 (TID 66). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 6.0 in stage 24.0 (TID 67, localhost, partition 6, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 6.0 in stage 24.0 (TID 67)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 5.0 in stage 24.0 (TID 66) in 5 ms on localhost (6/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 5 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_6 stored as values in memory (estimated size 1872.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_6 in memory on localhost:44154 (size: 1872.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 6.0 in stage 24.0 (TID 67). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 8.0 in stage 24.0 (TID 68, localhost, partition 8, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 8.0 in stage 24.0 (TID 68)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 6.0 in stage 24.0 (TID 67) in 7 ms on localhost (7/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_8 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_8 in memory on localhost:44154 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 8.0 in stage 24.0 (TID 68). 1987 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 9.0 in stage 24.0 (TID 69, localhost, partition 9, NODE_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 8.0 in stage 24.0 (TID 68) in 6 ms on localhost (8/10)
16/10/26 02:43:44 INFO Executor: Running task 9.0 in stage 24.0 (TID 69)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_9 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_9 in memory on localhost:44154 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 9.0 in stage 24.0 (TID 69). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 7.0 in stage 24.0 (TID 70, localhost, partition 7, PROCESS_LOCAL, 5586 bytes)
16/10/26 02:43:44 INFO Executor: Running task 7.0 in stage 24.0 (TID 70)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 9.0 in stage 24.0 (TID 69) in 7 ms on localhost (9/10)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 5 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_22_7 stored as values in memory (estimated size 152.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_22_7 in memory on localhost:44154 (size: 152.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 7.0 in stage 24.0 (TID 70). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 7.0 in stage 24.0 (TID 70) in 7 ms on localhost (10/10)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 24.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.057 s
16/10/26 02:43:44 INFO DAGScheduler: Job 11 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.107477 s
- Test bulkAppend
16/10/26 02:43:44 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/10/26 02:43:44 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/10/26 02:43:44 INFO MemoryStore: MemoryStore cleared
16/10/26 02:43:44 INFO BlockManager: BlockManager stopped
16/10/26 02:43:44 INFO BlockManagerMaster: BlockManagerMaster stopped
16/10/26 02:43:44 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/10/26 02:43:44 INFO SparkContext: Successfully stopped SparkContext
16/10/26 02:43:44 INFO SparkContext: Running Spark version 2.0.1
16/10/26 02:43:44 INFO SecurityManager: Changing view acls to: jenkins
16/10/26 02:43:44 INFO SecurityManager: Changing modify acls to: jenkins
16/10/26 02:43:44 INFO SecurityManager: Changing view acls groups to: 
16/10/26 02:43:44 INFO SecurityManager: Changing modify acls groups to: 
16/10/26 02:43:44 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/10/26 02:43:44 INFO Utils: Successfully started service 'sparkDriver' on port 58588.
16/10/26 02:43:44 INFO SparkEnv: Registering MapOutputTracker
16/10/26 02:43:44 INFO SparkEnv: Registering BlockManagerMaster
16/10/26 02:43:44 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-6a1bc93b-1ec0-491b-97fa-705238087b7d
16/10/26 02:43:44 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/10/26 02:43:44 INFO SparkEnv: Registering OutputCommitCoordinator
16/10/26 02:43:44 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/10/26 02:43:44 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/10/26 02:43:44 INFO Executor: Starting executor ID driver on host localhost
16/10/26 02:43:44 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 47573.
16/10/26 02:43:44 INFO NettyBlockTransferService: Server created on localhost:47573
16/10/26 02:43:44 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 47573)
16/10/26 02:43:44 INFO BlockManagerMasterEndpoint: Registering block manager localhost:47573 with 15.8 GB RAM, BlockManagerId(driver, localhost, 47573)
16/10/26 02:43:44 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 47573)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:47573 (size: 14.3 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:156
16/10/26 02:43:44 INFO FileInputFormat: Total input paths to process : 1
16/10/26 02:43:44 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
16/10/26 02:43:44 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:156)
16/10/26 02:43:44 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
16/10/26 02:43:44 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:47573 (size: 2.7 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/10/26 02:43:44 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 21 ms on localhost (1/1)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:156) finished in 0.023 s
16/10/26 02:43:44 INFO DAGScheduler: looking for newly runnable stages
16/10/26 02:43:44 INFO DAGScheduler: running: Set()
16/10/26 02:43:44 INFO DAGScheduler: waiting: Set(ResultStage 1)
16/10/26 02:43:44 INFO DAGScheduler: failed: Set()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:47573 (size: 2.3 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 5 ms on localhost (1/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 8 ms on localhost (2/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 8 ms on localhost (3/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 9 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 6 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.036 s
16/10/26 02:43:44 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.070034 s
16/10/26 02:43:44 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
16/10/26 02:43:44 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
16/10/26 02:43:44 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:47573 (size: 2.4 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:47573 (size: 1128.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 7 ms on localhost (1/4)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:47573 (size: 1440.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 1987 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 5 ms on localhost (2/4)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:47573 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 5 ms on localhost (3/4)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:47573 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 1987 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 5 ms on localhost (4/4)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.020 s
16/10/26 02:43:44 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.023695 s
16/10/26 02:43:44 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
16/10/26 02:43:44 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:47573 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 21 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 16 ms on localhost (2/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 22 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 26 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:47573 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 25 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.109 s
16/10/26 02:43:44 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.112712 s
16/10/26 02:43:44 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:165
16/10/26 02:43:44 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:165) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:47573 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 9 ms on localhost (1/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 1026 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 8 ms on localhost (2/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 992 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 7 ms on localhost (3/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 8 ms on localhost (4/5)
16/10/26 02:43:44 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 997 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 6 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165) finished in 0.034 s
16/10/26 02:43:44 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:165, took 0.040705 s
16/10/26 02:43:44 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:166
16/10/26 02:43:44 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:166) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:47573 (size: 1516.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
16/10/26 02:43:44 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:47573 (size: 1128.0 B, free: 15.8 GB)
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 17 ms on localhost (1/5)
16/10/26 02:43:44 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:47573 (size: 1440.0 B, free: 15.8 GB)
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 14 ms on localhost (2/5)
16/10/26 02:43:44 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:47573 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1473 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 13 ms on localhost (3/5)
16/10/26 02:43:44 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:47573 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1488 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 13 ms on localhost (4/5)
16/10/26 02:43:44 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:47573 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:44 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1478 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 12 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166) finished in 0.065 s
16/10/26 02:43:44 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:166, took 0.070372 s
- Test save and load in memory
16/10/26 02:43:44 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/10/26 02:43:44 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/10/26 02:43:44 INFO MemoryStore: MemoryStore cleared
16/10/26 02:43:44 INFO BlockManager: BlockManager stopped
16/10/26 02:43:44 INFO BlockManagerMaster: BlockManagerMaster stopped
16/10/26 02:43:44 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/10/26 02:43:44 INFO SparkContext: Successfully stopped SparkContext
16/10/26 02:43:44 INFO SparkContext: Running Spark version 2.0.1
16/10/26 02:43:44 INFO SecurityManager: Changing view acls to: jenkins
16/10/26 02:43:44 INFO SecurityManager: Changing modify acls to: jenkins
16/10/26 02:43:44 INFO SecurityManager: Changing view acls groups to: 
16/10/26 02:43:44 INFO SecurityManager: Changing modify acls groups to: 
16/10/26 02:43:44 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/10/26 02:43:44 INFO Utils: Successfully started service 'sparkDriver' on port 45613.
16/10/26 02:43:44 INFO SparkEnv: Registering MapOutputTracker
16/10/26 02:43:44 INFO SparkEnv: Registering BlockManagerMaster
16/10/26 02:43:44 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-c8cc10ee-d23f-414d-9247-ff10f64d21e4
16/10/26 02:43:44 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/10/26 02:43:44 INFO SparkEnv: Registering OutputCommitCoordinator
16/10/26 02:43:44 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/10/26 02:43:44 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/10/26 02:43:44 INFO Executor: Starting executor ID driver on host localhost
16/10/26 02:43:44 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 36994.
16/10/26 02:43:44 INFO NettyBlockTransferService: Server created on localhost:36994
16/10/26 02:43:44 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 36994)
16/10/26 02:43:44 INFO BlockManagerMasterEndpoint: Registering block manager localhost:36994 with 15.8 GB RAM, BlockManagerId(driver, localhost, 36994)
16/10/26 02:43:44 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 36994)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:36994 (size: 14.3 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:174
16/10/26 02:43:44 INFO FileInputFormat: Total input paths to process : 1
16/10/26 02:43:44 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
16/10/26 02:43:44 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:174)
16/10/26 02:43:44 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
16/10/26 02:43:44 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:36994 (size: 2.7 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/10/26 02:43:44 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 20 ms on localhost (1/1)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:174) finished in 0.021 s
16/10/26 02:43:44 INFO DAGScheduler: looking for newly runnable stages
16/10/26 02:43:44 INFO DAGScheduler: running: Set()
16/10/26 02:43:44 INFO DAGScheduler: waiting: Set(ResultStage 1)
16/10/26 02:43:44 INFO DAGScheduler: failed: Set()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:36994 (size: 2.3 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 9 ms on localhost (1/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 9 ms on localhost (2/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 10 ms on localhost (3/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/10/26 02:43:44 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 8 ms on localhost (4/5)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 7 ms on localhost (5/5)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/10/26 02:43:44 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.041 s
16/10/26 02:43:44 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.075833 s
16/10/26 02:43:44 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
16/10/26 02:43:44 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
16/10/26 02:43:44 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
16/10/26 02:43:44 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
16/10/26 02:43:44 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
16/10/26 02:43:44 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:44 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/10/26 02:43:44 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:36994 (size: 2.4 KB, free: 15.8 GB)
16/10/26 02:43:44 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:44 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
16/10/26 02:43:44 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
16/10/26 02:43:44 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:36994 (size: 1128.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 8 ms on localhost (1/4)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:36994 (size: 1440.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:44 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
16/10/26 02:43:44 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 5 ms on localhost (2/4)
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:44 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:44 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:44 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:36994 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:44 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
16/10/26 02:43:44 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
16/10/26 02:43:45 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 11 ms on localhost (3/4)
16/10/26 02:43:45 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:45 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/10/26 02:43:45 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:36994 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:45 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 1987 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 5 ms on localhost (4/4)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.026 s
16/10/26 02:43:45 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.032704 s
16/10/26 02:43:45 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
16/10/26 02:43:45 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:36994 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:45 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 26 ms on localhost (1/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:45 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:45 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 21 ms on localhost (2/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:45 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
16/10/26 02:43:45 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 23 ms on localhost (3/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:45 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
16/10/26 02:43:45 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 20 ms on localhost (4/5)
16/10/26 02:43:45 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/10/26 02:43:45 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/10/26 02:43:45 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:36994 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:45 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 24 ms on localhost (5/5)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.112 s
16/10/26 02:43:45 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.117403 s
16/10/26 02:43:45 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:183
16/10/26 02:43:45 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:183) with 5 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:36994 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_0 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:45 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 7 ms on localhost (1/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_1 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
16/10/26 02:43:45 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 1026 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:45 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 8 ms on localhost (2/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_2 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
16/10/26 02:43:45 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 905 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:45 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 7 ms on localhost (3/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_3 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
16/10/26 02:43:45 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
16/10/26 02:43:45 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 8 ms on localhost (4/5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_7_4 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
16/10/26 02:43:45 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 997 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 5 ms on localhost (5/5)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183) finished in 0.032 s
16/10/26 02:43:45 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:183, took 0.037454 s
16/10/26 02:43:45 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:184
16/10/26 02:43:45 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:184) with 5 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:36994 (size: 1516.0 B, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
16/10/26 02:43:45 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:36994 (size: 1128.0 B, free: 15.8 GB)
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:45 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 18 ms on localhost (1/5)
16/10/26 02:43:45 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:36994 (size: 1440.0 B, free: 15.8 GB)
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
16/10/26 02:43:45 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:45 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 20 ms on localhost (2/5)
16/10/26 02:43:45 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:36994 (size: 1284.0 B, free: 15.8 GB)
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
16/10/26 02:43:45 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1647 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:45 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 17 ms on localhost (3/5)
16/10/26 02:43:45 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:36994 (size: 1156.0 B, free: 15.8 GB)
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
16/10/26 02:43:45 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1488 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:45 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
16/10/26 02:43:45 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 14 ms on localhost (4/5)
16/10/26 02:43:45 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:36994 (size: 1044.0 B, free: 15.8 GB)
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
16/10/26 02:43:45 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1478 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 12 ms on localhost (5/5)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184) finished in 0.078 s
16/10/26 02:43:45 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:184, took 0.082577 s
- Test save and load in memory 2
16/10/26 02:43:45 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/10/26 02:43:45 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/10/26 02:43:45 INFO MemoryStore: MemoryStore cleared
16/10/26 02:43:45 INFO BlockManager: BlockManager stopped
16/10/26 02:43:45 INFO BlockManagerMaster: BlockManagerMaster stopped
16/10/26 02:43:45 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/10/26 02:43:45 INFO SparkContext: Successfully stopped SparkContext
SuccinctTableRDDSuite:
16/10/26 02:43:45 INFO SparkContext: Running Spark version 2.0.1
16/10/26 02:43:45 INFO SecurityManager: Changing view acls to: jenkins
16/10/26 02:43:45 INFO SecurityManager: Changing modify acls to: jenkins
16/10/26 02:43:45 INFO SecurityManager: Changing view acls groups to: 
16/10/26 02:43:45 INFO SecurityManager: Changing modify acls groups to: 
16/10/26 02:43:45 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/10/26 02:43:45 INFO Utils: Successfully started service 'sparkDriver' on port 35201.
16/10/26 02:43:45 INFO SparkEnv: Registering MapOutputTracker
16/10/26 02:43:45 INFO SparkEnv: Registering BlockManagerMaster
16/10/26 02:43:45 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-4b861b5f-0243-4182-aade-094fd9dccbaa
16/10/26 02:43:45 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/10/26 02:43:45 INFO SparkEnv: Registering OutputCommitCoordinator
16/10/26 02:43:45 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/10/26 02:43:45 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/10/26 02:43:45 INFO Executor: Starting executor ID driver on host localhost
16/10/26 02:43:45 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 55173.
16/10/26 02:43:45 INFO NettyBlockTransferService: Server created on localhost:55173
16/10/26 02:43:45 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 55173)
16/10/26 02:43:45 INFO BlockManagerMasterEndpoint: Registering block manager localhost:55173 with 15.8 GB RAM, BlockManagerId(driver, localhost, 55173)
16/10/26 02:43:45 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 55173)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:55173 (size: 14.3 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 0 from textFile at SuccinctTableRDDSuite.scala:19
16/10/26 02:43:45 INFO FileInputFormat: Total input paths to process : 1
16/10/26 02:43:45 INFO SparkContext: Starting job: first at SuccinctTableRDDSuite.scala:21
16/10/26 02:43:45 INFO DAGScheduler: Got job 0 (first at SuccinctTableRDDSuite.scala:21) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.3 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2021.0 B, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:55173 (size: 2021.0 B, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5466 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/10/26 02:43:45 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1291 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 5 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21) finished in 0.006 s
16/10/26 02:43:45 INFO DAGScheduler: Job 0 finished: first at SuccinctTableRDDSuite.scala:21, took 0.009923 s
16/10/26 02:43:45 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:226
16/10/26 02:43:45 INFO DAGScheduler: Got job 1 (fold at SuccinctTableRDD.scala:226) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 1 (fold at SuccinctTableRDD.scala:226)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:55173 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, PROCESS_LOCAL, 5465 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/10/26 02:43:45 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1178 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 9 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 1 (fold at SuccinctTableRDD.scala:226) finished in 0.009 s
16/10/26 02:43:45 INFO DAGScheduler: Job 1 finished: fold at SuccinctTableRDD.scala:226, took 0.012571 s
16/10/26 02:43:45 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:244
16/10/26 02:43:45 INFO DAGScheduler: Got job 2 (fold at SuccinctTableRDD.scala:244) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 2 (fold at SuccinctTableRDD.scala:244)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:55173 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 2.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 2, localhost, partition 0, PROCESS_LOCAL, 5465 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 2.0 (TID 2)
16/10/26 02:43:45 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 2.0 (TID 2). 1181 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 2) in 8 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 2 (fold at SuccinctTableRDD.scala:244) finished in 0.008 s
16/10/26 02:43:45 INFO DAGScheduler: Job 2 finished: fold at SuccinctTableRDD.scala:244, took 0.013054 s
16/10/26 02:43:45 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
16/10/26 02:43:45 INFO DAGScheduler: Got job 3 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 6.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:55173 (size: 3.5 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 3.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 3, localhost, partition 0, PROCESS_LOCAL, 5470 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 3.0 (TID 3)
16/10/26 02:43:45 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/10/26 02:43:45 INFO MemoryStore: Block rdd_5_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_5_0 in memory on localhost:55173 (size: 81.1 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 3.0 (TID 3). 1682 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 3) in 44 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.045 s
16/10/26 02:43:45 INFO DAGScheduler: Job 3 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.047183 s
16/10/26 02:43:45 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:26
16/10/26 02:43:45 INFO DAGScheduler: Got job 4 (collect at SuccinctTableRDDSuite.scala:26) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.7 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 3.8 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:55173 (size: 3.8 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 4.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 4, localhost, partition 0, PROCESS_LOCAL, 5468 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 4.0 (TID 4)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_5_0 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 4:
[rdd_5_0]
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 4.0 (TID 4). 177609 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 4) in 152 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26) finished in 0.152 s
16/10/26 02:43:45 INFO DAGScheduler: Job 4 finished: collect at SuccinctTableRDDSuite.scala:26, took 0.157065 s
16/10/26 02:43:45 INFO SparkContext: Starting job: foreach at SuccinctTableRDDImpl.scala:111
16/10/26 02:43:45 INFO DAGScheduler: Got job 5 (foreach at SuccinctTableRDDImpl.scala:111) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.1 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 3.3 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:55173 (size: 3.3 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 5.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 5, localhost, partition 0, PROCESS_LOCAL, 5578 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 5.0 (TID 5)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_5_0 locally
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 5.0 (TID 5). 916 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 5) in 34 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111) finished in 0.034 s
16/10/26 02:43:45 INFO DAGScheduler: Job 5 finished: foreach at SuccinctTableRDDImpl.scala:111, took 0.039743 s
16/10/26 02:43:45 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
16/10/26 02:43:45 INFO DAGScheduler: Got job 6 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:55173 (size: 2.5 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 6.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 6, localhost, partition 0, PROCESS_LOCAL, 5392 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 6.0 (TID 6)
16/10/26 02:43:45 INFO MemoryStore: Block rdd_10_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added rdd_10_0 in memory on localhost:55173 (size: 81.1 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 6.0 (TID 6). 1522 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 6) in 16 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.017 s
16/10/26 02:43:45 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.020892 s
16/10/26 02:43:45 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:32
16/10/26 02:43:45 INFO DAGScheduler: Got job 7 (collect at SuccinctTableRDDSuite.scala:32) with 1 output partitions
16/10/26 02:43:45 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32)
16/10/26 02:43:45 INFO DAGScheduler: Parents of final stage: List()
16/10/26 02:43:45 INFO DAGScheduler: Missing parents: List()
16/10/26 02:43:45 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.6 KB, free 15.8 GB)
16/10/26 02:43:45 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.8 KB, free 15.8 GB)
16/10/26 02:43:45 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:55173 (size: 2.8 KB, free: 15.8 GB)
16/10/26 02:43:45 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
16/10/26 02:43:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Adding task set 7.0 with 1 tasks
16/10/26 02:43:45 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 7, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
16/10/26 02:43:45 INFO Executor: Running task 0.0 in stage 7.0 (TID 7)
16/10/26 02:43:45 INFO BlockManager: Found block rdd_10_0 locally
16/10/26 02:43:45 WARN Executor: 1 block locks were not released by TID = 7:
[rdd_10_0]
16/10/26 02:43:45 INFO Executor: Finished task 0.0 in stage 7.0 (TID 7). 177609 bytes result sent to driver
16/10/26 02:43:45 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 7) in 112 ms on localhost (1/1)
16/10/26 02:43:45 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/10/26 02:43:45 INFO DAGScheduler: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32) finished in 0.113 s
16/10/26 02:43:45 INFO DAGScheduler: Job 7 finished: collect at SuccinctTableRDDSuite.scala:32, took 0.118042 s
- Test save and retrieve in memory
16/10/26 02:43:45 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/10/26 02:43:45 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/10/26 02:43:45 INFO MemoryStore: MemoryStore cleared
16/10/26 02:43:45 INFO BlockManager: BlockManager stopped
16/10/26 02:43:45 INFO BlockManagerMaster: BlockManagerMaster stopped
16/10/26 02:43:45 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/10/26 02:43:45 INFO SparkContext: Successfully stopped SparkContext
Run completed in 58 seconds, 350 milliseconds.
Total number of tests run: 32
Suites: completed 6, aborted 0
Tests: succeeded 32, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
16/10/26 02:43:45 INFO ShutdownHookManager: Shutdown hook called
16/10/26 02:43:45 INFO ShutdownHookManager: Deleting directory /tmp/spark-b03852c4-e899-441d-8b57-338dd1418133
[JENKINS] Recording test results
[INFO] 
[INFO] --- maven-jar-plugin:2.3.2:jar (default-jar) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-spark ---
[INFO] Configured Artifact: amplab:succinct-spark:0.1.8:jar
[INFO] amplab:succinct-spark:0.1.8:jar already exists in /home/jenkins/workspace/Succinct/spark/target
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (make-assembly) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ succinct-spark ---
[INFO] Installing /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[INFO] Installing /home/jenkins/workspace/Succinct/spark/pom.xml to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[INFO] Installing /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Succinct Assembly 0.1.8
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ succinct-assembly ---
[INFO] Deleting /home/jenkins/workspace/Succinct/assembly/target
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (package-all) @ succinct-assembly ---
[INFO] Reading assembly descriptor: src/main/assembly/assembly.xml
[INFO] Building jar: /home/jenkins/workspace/Succinct/assembly/../target/succinct-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:pom
[INFO] Copying pom.xml to /home/jenkins/workspace/Succinct/assembly/target/pom.xml
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ succinct-assembly ---
[INFO] Skipping artifact installation
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (install-assembly-jar) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:jar
[INFO] Copying succinct-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct/0.1.8/succinct-0.1.8.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Succinct .......................................... SUCCESS [1.696s]
[INFO] Succinct Core ..................................... SUCCESS [25.735s]
[INFO] Succinct Serialization/Deserialization ............ SUCCESS [1.185s]
[INFO] Succinct on Apache Spark .......................... SUCCESS [1:59.789s]
[INFO] Succinct Assembly ................................. SUCCESS [0.831s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:30.444s
[INFO] Finished at: Wed Oct 26 02:43:49 PDT 2016
[INFO] Final Memory: 58M/2441M
[INFO] ------------------------------------------------------------------------
Waiting for Jenkins to finish collecting data
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/pom.xml to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/pom.xml to amplab/succinct-core/0.1.8/succinct-core-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8-tests.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8-jar-with-dependencies.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/assembly/pom.xml to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/assembly/../target/succinct-0.1.8.jar to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.jar
/home/jenkins/workspace/Succinct/target/succinct-0.1.8.jar is not inside /home/jenkins/workspace/Succinct/assembly/; will archive in a separate pass
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/pom.xml to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/target/succinct-serde-0.1.8.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/target/succinct-serde-0.1.8-tests.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/pom.xml to amplab/succinct/0.1.8/succinct-0.1.8.pom
channel stopped
Finished: SUCCESS