SuccessConsole Output

Skipping 3,937 KB.. Full Log
:56 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/11/03 11:37:56 INFO Utils: Successfully started service 'sparkDriver' on port 48716.
16/11/03 11:37:56 INFO SparkEnv: Registering MapOutputTracker
16/11/03 11:37:56 INFO SparkEnv: Registering BlockManagerMaster
16/11/03 11:37:56 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-61cf2ee4-5759-45ec-b02a-7846d6a153fa
16/11/03 11:37:56 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/11/03 11:37:56 INFO SparkEnv: Registering OutputCommitCoordinator
16/11/03 11:37:56 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/11/03 11:37:56 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/11/03 11:37:56 INFO Executor: Starting executor ID driver on host localhost
16/11/03 11:37:56 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 52399.
16/11/03 11:37:56 INFO NettyBlockTransferService: Server created on localhost:52399
16/11/03 11:37:56 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 52399)
16/11/03 11:37:56 INFO BlockManagerMasterEndpoint: Registering block manager localhost:52399 with 15.8 GB RAM, BlockManagerId(driver, localhost, 52399)
16/11/03 11:37:56 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 52399)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:52399 (size: 14.3 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:146
16/11/03 11:37:56 INFO FileInputFormat: Total input paths to process : 1
16/11/03 11:37:56 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
16/11/03 11:37:56 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:146)
16/11/03 11:37:56 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
16/11/03 11:37:56 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:52399 (size: 2.7 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:146)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/11/03 11:37:56 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 26 ms on localhost (1/1)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:146) finished in 0.026 s
16/11/03 11:37:56 INFO DAGScheduler: looking for newly runnable stages
16/11/03 11:37:56 INFO DAGScheduler: running: Set()
16/11/03 11:37:56 INFO DAGScheduler: waiting: Set(ResultStage 1)
16/11/03 11:37:56 INFO DAGScheduler: failed: Set()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:52399 (size: 2.3 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 5 ms on localhost (1/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 9 ms on localhost (2/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 8 ms on localhost (3/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 8 ms on localhost (4/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 7 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.035 s
16/11/03 11:37:56 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.073372 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
16/11/03 11:37:56 INFO DAGScheduler: Got job 1 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 3 (MapPartitionsRDD[9] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 3.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:52399 (size: 1128.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 10 ms on localhost (1/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:52399 (size: 1440.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 5 ms on localhost (2/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:52399 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 4 ms on localhost (3/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:52399 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 10, localhost, partition 4, NODE_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 3.0 (TID 10)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 6 ms on localhost (4/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:52399 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 3.0 (TID 10). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 3.0 (TID 10) in 6 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.029 s
16/11/03 11:37:56 INFO DAGScheduler: Job 1 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.037802 s
16/11/03 11:37:56 INFO SparkContext: Starting job: count at SuccinctJsonRDD.scala:90
16/11/03 11:37:56 INFO DAGScheduler: Got job 2 (count at SuccinctJsonRDD.scala:90) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 5 (count at SuccinctJsonRDD.scala:90)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:52399 (size: 2.1 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 11, localhost, partition 0, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 5.0 (TID 11)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 5.0 (TID 11). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 12, localhost, partition 1, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 5.0 (TID 12)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 11) in 4 ms on localhost (1/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 5.0 (TID 12). 1259 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 13, localhost, partition 2, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 5.0 (TID 13)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 12) in 3 ms on localhost (2/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 5.0 (TID 13). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 14, localhost, partition 3, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 13) in 4 ms on localhost (3/5)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 5.0 (TID 14)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 5.0 (TID 14). 1259 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 15, localhost, partition 4, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 14) in 4 ms on localhost (4/5)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 5.0 (TID 15)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 5.0 (TID 15). 1259 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 15) in 3 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 5 (count at SuccinctJsonRDD.scala:90) finished in 0.016 s
16/11/03 11:37:56 INFO DAGScheduler: Job 2 finished: count at SuccinctJsonRDD.scala:90, took 0.022103 s
16/11/03 11:37:56 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:98
16/11/03 11:37:56 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDD.scala:98) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDD.scala:98)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:52399 (size: 2.3 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (MapPartitionsRDD[10] at mapPartitions at SuccinctJsonRDD.scala:97)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 16, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 7.0 (TID 16)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 7.0 (TID 16). 1208 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 17, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 16) in 4 ms on localhost (1/5)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 7.0 (TID 17)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 7.0 (TID 17). 1208 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 18, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 17) in 4 ms on localhost (2/5)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 7.0 (TID 18)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 7.0 (TID 18). 1208 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 19, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 7.0 (TID 19)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 18) in 4 ms on localhost (3/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 7.0 (TID 19). 1208 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 20, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 7.0 (TID 20)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 19) in 4 ms on localhost (4/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 7.0 (TID 20). 1208 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 20) in 3 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDD.scala:98) finished in 0.016 s
16/11/03 11:37:56 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDD.scala:98, took 0.022638 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Got job 4 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 8)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 9 (MapPartitionsRDD[11] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 9.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 21, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 9.0 (TID 21)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 9.0 (TID 21). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 9.0 (TID 22, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 9.0 (TID 22)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 21) in 2 ms on localhost (1/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 9.0 (TID 22). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 9.0 (TID 23, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 9.0 (TID 23)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 9.0 (TID 22) in 1 ms on localhost (2/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 9.0 (TID 23). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 9.0 (TID 24, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 9.0 (TID 23) in 1 ms on localhost (3/5)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 9.0 (TID 24)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 9.0 (TID 24). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 9.0 (TID 25, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 9.0 (TID 25)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 9.0 (TID 24) in 1 ms on localhost (4/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 9.0 (TID 25). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 9.0 (TID 25) in 1 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 9.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 9 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
16/11/03 11:37:56 INFO DAGScheduler: Job 4 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.011787 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Got job 5 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 10)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 11 (MapPartitionsRDD[12] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 11.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 26, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 11.0 (TID 26)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 11.0 (TID 26). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 11.0 (TID 27, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 11.0 (TID 27)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 26) in 2 ms on localhost (1/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 11.0 (TID 27). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 11.0 (TID 28, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 11.0 (TID 28)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 11.0 (TID 27) in 1 ms on localhost (2/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 11.0 (TID 28). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 11.0 (TID 29, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 11.0 (TID 29)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 11.0 (TID 28) in 1 ms on localhost (3/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 11.0 (TID 29). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 11.0 (TID 30, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 11.0 (TID 30)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 11.0 (TID 29) in 1 ms on localhost (4/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 11.0 (TID 30). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 11.0 (TID 30) in 1 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 11.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 11 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
16/11/03 11:37:56 INFO DAGScheduler: Job 5 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.010518 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Got job 6 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 12)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 13 (MapPartitionsRDD[13] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 13.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 31, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 13.0 (TID 31)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 13.0 (TID 31). 867 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 32, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 13.0 (TID 32)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 31) in 1 ms on localhost (1/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 13.0 (TID 32). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 13.0 (TID 33, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 13.0 (TID 33)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 32) in 1 ms on localhost (2/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 13.0 (TID 33). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 13.0 (TID 34, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 13.0 (TID 33) in 2 ms on localhost (3/5)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 13.0 (TID 34)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 13.0 (TID 34). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 13.0 (TID 35, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 13.0 (TID 35)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 13.0 (TID 34) in 2 ms on localhost (4/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 13.0 (TID 35). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 13.0 (TID 35) in 2 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 13.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 13 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.006 s
16/11/03 11:37:56 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.009663 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Got job 7 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 14)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 15 (MapPartitionsRDD[14] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 15.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 36, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 15.0 (TID 36)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 15.0 (TID 36). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 15.0 (TID 37, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 15.0 (TID 37)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 36) in 2 ms on localhost (1/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 15.0 (TID 37). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 15.0 (TID 38, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 15.0 (TID 38)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 15.0 (TID 37) in 2 ms on localhost (2/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 15.0 (TID 38). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 15.0 (TID 39, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 15.0 (TID 39)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 15.0 (TID 38) in 2 ms on localhost (3/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 15.0 (TID 39). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 15.0 (TID 40, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 15.0 (TID 40)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 15.0 (TID 39) in 1 ms on localhost (4/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 15.0 (TID 40). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 15.0 (TID 40) in 1 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 15.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 15 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.006 s
16/11/03 11:37:56 INFO DAGScheduler: Job 7 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.012255 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Got job 8 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 16)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 17 (MapPartitionsRDD[15] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 17.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 41, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 17.0 (TID 41)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 17.0 (TID 41). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 17.0 (TID 42, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 41) in 2 ms on localhost (1/5)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 17.0 (TID 42)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 17.0 (TID 42). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 17.0 (TID 43, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 17.0 (TID 43)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 17.0 (TID 42) in 2 ms on localhost (2/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 17.0 (TID 43). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 17.0 (TID 44, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 17.0 (TID 44)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 17.0 (TID 43) in 1 ms on localhost (3/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 17.0 (TID 44). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 17.0 (TID 45, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 17.0 (TID 45)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 17.0 (TID 44) in 2 ms on localhost (4/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 17.0 (TID 45). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 17.0 (TID 45) in 2 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 17.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 17 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
16/11/03 11:37:56 INFO DAGScheduler: Job 8 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.012812 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Got job 9 (aggregate at SuccinctJsonRDD.scala:113) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 18)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on localhost:52399 (size: 2.6 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 19 (MapPartitionsRDD[16] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 19.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 46, localhost, partition 0, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 19.0 (TID 46)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 19.0 (TID 46). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 19.0 (TID 47, localhost, partition 1, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 19.0 (TID 47)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 46) in 2 ms on localhost (1/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 19.0 (TID 47). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 19.0 (TID 48, localhost, partition 2, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 19.0 (TID 48)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 19.0 (TID 47) in 2 ms on localhost (2/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 19.0 (TID 48). 875 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 19.0 (TID 49, localhost, partition 3, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 19.0 (TID 48) in 3 ms on localhost (3/5)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 19.0 (TID 49)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 19.0 (TID 49). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 19.0 (TID 50, localhost, partition 4, PROCESS_LOCAL, 5477 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 19.0 (TID 50)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 19.0 (TID 49) in 2 ms on localhost (4/5)
16/11/03 11:37:56 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 19.0 (TID 50). 788 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 19.0 (TID 50) in 1 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 19.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 19 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.007 s
16/11/03 11:37:56 INFO DAGScheduler: Job 9 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.012777 s
16/11/03 11:37:56 INFO MapPartitionsRDD: Removing RDD 7 from persistence list
16/11/03 11:37:56 INFO BlockManager: Removing RDD 7
16/11/03 11:37:56 INFO SparkContext: Starting job: count at SuccinctJsonRDDSuite.scala:150
16/11/03 11:37:56 INFO DAGScheduler: Got job 10 (count at SuccinctJsonRDDSuite.scala:150) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 20)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 3.6 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.1 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on localhost:52399 (size: 2.1 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 21 (MapPartitionsRDD[5] at repartition at SuccinctJsonRDDSuite.scala:146)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 21.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 51, localhost, partition 0, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 21.0 (TID 51)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 21.0 (TID 51). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 21.0 (TID 52, localhost, partition 1, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 21.0 (TID 52)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 51) in 5 ms on localhost (1/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 21.0 (TID 52). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 21.0 (TID 53, localhost, partition 2, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 21.0 (TID 53)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 21.0 (TID 52) in 4 ms on localhost (2/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 21.0 (TID 53). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 21.0 (TID 54, localhost, partition 3, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 21.0 (TID 53) in 3 ms on localhost (3/5)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 21.0 (TID 54)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 21.0 (TID 54). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 21.0 (TID 55, localhost, partition 4, NODE_LOCAL, 5387 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 21.0 (TID 55)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 21.0 (TID 54) in 3 ms on localhost (4/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 21.0 (TID 55). 1346 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 21.0 (TID 55) in 3 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 21.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 21 (count at SuccinctJsonRDDSuite.scala:150) finished in 0.017 s
16/11/03 11:37:56 INFO DAGScheduler: Job 10 finished: count at SuccinctJsonRDDSuite.scala:150, took 0.024518 s
16/11/03 11:37:56 INFO SparkContext: Starting job: aggregate at SuccinctJsonRDD.scala:113
16/11/03 11:37:56 INFO DAGScheduler: Registering RDD 17 (repartition at SuccinctJsonRDD.scala:94)
16/11/03 11:37:56 INFO DAGScheduler: Got job 11 (aggregate at SuccinctJsonRDD.scala:113) with 10 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 22, ShuffleMapStage 23)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 23)
16/11/03 11:37:56 INFO DAGScheduler: Submitting ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on localhost:52399 (size: 2.3 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ShuffleMapStage 23 (MapPartitionsRDD[17] at repartition at SuccinctJsonRDD.scala:94)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 23.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 56, localhost, partition 0, NODE_LOCAL, 5466 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 23.0 (TID 56)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 23.0 (TID 56). 1635 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 23.0 (TID 57, localhost, partition 1, NODE_LOCAL, 5466 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 23.0 (TID 57)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 56) in 13 ms on localhost (1/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 23.0 (TID 57). 1635 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 23.0 (TID 58, localhost, partition 2, NODE_LOCAL, 5466 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 23.0 (TID 58)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 23.0 (TID 57) in 13 ms on localhost (2/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 23.0 (TID 58). 1635 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 23.0 (TID 59, localhost, partition 3, NODE_LOCAL, 5466 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 23.0 (TID 59)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 23.0 (TID 58) in 6 ms on localhost (3/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 23.0 (TID 59). 1635 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 23.0 (TID 60, localhost, partition 4, NODE_LOCAL, 5466 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 23.0 (TID 60)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 23.0 (TID 59) in 7 ms on localhost (4/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 23.0 (TID 60). 1548 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 23.0 (TID 60) in 6 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 23.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ShuffleMapStage 23 (repartition at SuccinctJsonRDD.scala:94) finished in 0.042 s
16/11/03 11:37:56 INFO DAGScheduler: looking for newly runnable stages
16/11/03 11:37:56 INFO DAGScheduler: running: Set()
16/11/03 11:37:56 INFO DAGScheduler: waiting: Set(ResultStage 24)
16/11/03 11:37:56 INFO DAGScheduler: failed: Set()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 5.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 3.2 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on localhost:52399 (size: 3.2 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 24 (MapPartitionsRDD[24] at map at SuccinctJsonRDD.scala:113)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 24.0 with 10 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 61, localhost, partition 0, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 24.0 (TID 61)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_0 in memory on localhost:52399 (size: 1128.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 24.0 (TID 61). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 24.0 (TID 62, localhost, partition 1, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 61) in 6 ms on localhost (1/10)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 24.0 (TID 62)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_1 in memory on localhost:52399 (size: 1440.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 24.0 (TID 62). 1987 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 24.0 (TID 63, localhost, partition 2, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 24.0 (TID 62) in 5 ms on localhost (2/10)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 24.0 (TID 63)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_2 in memory on localhost:52399 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 24.0 (TID 63). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 24.0 (TID 64, localhost, partition 3, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 24.0 (TID 64)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 24.0 (TID 63) in 5 ms on localhost (3/10)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_3 in memory on localhost:52399 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 24.0 (TID 64). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 24.0 (TID 65, localhost, partition 4, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 24.0 (TID 65)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 24.0 (TID 64) in 5 ms on localhost (4/10)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_4 in memory on localhost:52399 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 24.0 (TID 65). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 5.0 in stage 24.0 (TID 66, localhost, partition 5, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 5.0 in stage 24.0 (TID 66)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 24.0 (TID 65) in 4 ms on localhost (5/10)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_5 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_5 in memory on localhost:52399 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 5.0 in stage 24.0 (TID 66). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 6.0 in stage 24.0 (TID 67, localhost, partition 6, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 6.0 in stage 24.0 (TID 67)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 5.0 in stage 24.0 (TID 66) in 5 ms on localhost (6/10)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 5 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_6 stored as values in memory (estimated size 1872.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_6 in memory on localhost:52399 (size: 1872.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 6.0 in stage 24.0 (TID 67). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 8.0 in stage 24.0 (TID 68, localhost, partition 8, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 8.0 in stage 24.0 (TID 68)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 6.0 in stage 24.0 (TID 67) in 11 ms on localhost (7/10)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_8 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_8 in memory on localhost:52399 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 8.0 in stage 24.0 (TID 68). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 9.0 in stage 24.0 (TID 69, localhost, partition 9, NODE_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO Executor: Running task 9.0 in stage 24.0 (TID 69)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 8.0 in stage 24.0 (TID 68) in 12 ms on localhost (8/10)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 5 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_9 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_9 in memory on localhost:52399 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 9.0 in stage 24.0 (TID 69). 1987 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 7.0 in stage 24.0 (TID 70, localhost, partition 7, PROCESS_LOCAL, 5586 bytes)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 9.0 in stage 24.0 (TID 69) in 5 ms on localhost (9/10)
16/11/03 11:37:56 INFO Executor: Running task 7.0 in stage 24.0 (TID 70)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 5 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_22_7 stored as values in memory (estimated size 152.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_22_7 in memory on localhost:52399 (size: 152.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 7.0 in stage 24.0 (TID 70). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 7.0 in stage 24.0 (TID 70) in 4 ms on localhost (10/10)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 24.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 24 (aggregate at SuccinctJsonRDD.scala:113) finished in 0.056 s
16/11/03 11:37:56 INFO DAGScheduler: Job 11 finished: aggregate at SuccinctJsonRDD.scala:113, took 0.111258 s
- Test bulkAppend
16/11/03 11:37:56 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/11/03 11:37:56 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/11/03 11:37:56 INFO MemoryStore: MemoryStore cleared
16/11/03 11:37:56 INFO BlockManager: BlockManager stopped
16/11/03 11:37:56 INFO BlockManagerMaster: BlockManagerMaster stopped
16/11/03 11:37:56 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/11/03 11:37:56 INFO SparkContext: Successfully stopped SparkContext
16/11/03 11:37:56 INFO SparkContext: Running Spark version 2.0.1
16/11/03 11:37:56 INFO SecurityManager: Changing view acls to: jenkins
16/11/03 11:37:56 INFO SecurityManager: Changing modify acls to: jenkins
16/11/03 11:37:56 INFO SecurityManager: Changing view acls groups to: 
16/11/03 11:37:56 INFO SecurityManager: Changing modify acls groups to: 
16/11/03 11:37:56 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/11/03 11:37:56 INFO Utils: Successfully started service 'sparkDriver' on port 37311.
16/11/03 11:37:56 INFO SparkEnv: Registering MapOutputTracker
16/11/03 11:37:56 INFO SparkEnv: Registering BlockManagerMaster
16/11/03 11:37:56 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-1013088e-64ab-45c4-b5f0-a2797947cb0f
16/11/03 11:37:56 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/11/03 11:37:56 INFO SparkEnv: Registering OutputCommitCoordinator
16/11/03 11:37:56 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/11/03 11:37:56 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/11/03 11:37:56 INFO Executor: Starting executor ID driver on host localhost
16/11/03 11:37:56 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 35771.
16/11/03 11:37:56 INFO NettyBlockTransferService: Server created on localhost:35771
16/11/03 11:37:56 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 35771)
16/11/03 11:37:56 INFO BlockManagerMasterEndpoint: Registering block manager localhost:35771 with 15.8 GB RAM, BlockManagerId(driver, localhost, 35771)
16/11/03 11:37:56 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 35771)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:35771 (size: 14.3 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:156
16/11/03 11:37:56 INFO FileInputFormat: Total input paths to process : 1
16/11/03 11:37:56 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
16/11/03 11:37:56 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:156)
16/11/03 11:37:56 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
16/11/03 11:37:56 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:35771 (size: 2.7 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:156)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/11/03 11:37:56 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 20 ms on localhost (1/1)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:156) finished in 0.021 s
16/11/03 11:37:56 INFO DAGScheduler: looking for newly runnable stages
16/11/03 11:37:56 INFO DAGScheduler: running: Set()
16/11/03 11:37:56 INFO DAGScheduler: waiting: Set(ResultStage 1)
16/11/03 11:37:56 INFO DAGScheduler: failed: Set()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:35771 (size: 2.3 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 6 ms on localhost (1/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 5 ms on localhost (2/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 5 ms on localhost (3/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1208 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:56 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 4 ms on localhost (4/5)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1295 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 3 ms on localhost (5/5)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/11/03 11:37:56 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.022 s
16/11/03 11:37:56 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.057916 s
16/11/03 11:37:56 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
16/11/03 11:37:56 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
16/11/03 11:37:56 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
16/11/03 11:37:56 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
16/11/03 11:37:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
16/11/03 11:37:56 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:56 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:56 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:35771 (size: 2.4 KB, free: 15.8 GB)
16/11/03 11:37:56 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:56 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
16/11/03 11:37:56 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
16/11/03 11:37:56 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:56 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:35771 (size: 1128.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:56 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 6 ms on localhost (1/4)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:56 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/11/03 11:37:56 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:35771 (size: 1440.0 B, free: 15.8 GB)
16/11/03 11:37:56 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 1987 bytes result sent to driver
16/11/03 11:37:56 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:56 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
16/11/03 11:37:56 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 7 ms on localhost (2/4)
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:35771 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 6 ms on localhost (3/4)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:35771 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 9 ms on localhost (4/4)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.026 s
16/11/03 11:37:57 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.031341 s
16/11/03 11:37:57 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
16/11/03 11:37:57 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:35771 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 35 ms on localhost (1/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 26 ms on localhost (2/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 22 ms on localhost (3/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 19 ms on localhost (4/5)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:35771 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 29 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.128 s
16/11/03 11:37:57 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.135121 s
16/11/03 11:37:57 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:165
16/11/03 11:37:57 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:165) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:35771 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 9 ms on localhost (1/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 1026 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 7 ms on localhost (2/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 992 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 5 ms on localhost (3/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 4 ms on localhost (4/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 997 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 2 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:165) finished in 0.026 s
16/11/03 11:37:57 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:165, took 0.033038 s
16/11/03 11:37:57 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:166
16/11/03 11:37:57 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:166) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:35771 (size: 1516.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:35771 (size: 1128.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 15 ms on localhost (1/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:35771 (size: 1440.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 13 ms on localhost (2/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:35771 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1560 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 16 ms on localhost (3/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:35771 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1575 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 19 ms on localhost (4/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:35771 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1565 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 12 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:166) finished in 0.072 s
16/11/03 11:37:57 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:166, took 0.078813 s
- Test save and load in memory
16/11/03 11:37:57 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/11/03 11:37:57 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/11/03 11:37:57 INFO MemoryStore: MemoryStore cleared
16/11/03 11:37:57 INFO BlockManager: BlockManager stopped
16/11/03 11:37:57 INFO BlockManagerMaster: BlockManagerMaster stopped
16/11/03 11:37:57 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/11/03 11:37:57 INFO SparkContext: Successfully stopped SparkContext
16/11/03 11:37:57 INFO SparkContext: Running Spark version 2.0.1
16/11/03 11:37:57 INFO SecurityManager: Changing view acls to: jenkins
16/11/03 11:37:57 INFO SecurityManager: Changing modify acls to: jenkins
16/11/03 11:37:57 INFO SecurityManager: Changing view acls groups to: 
16/11/03 11:37:57 INFO SecurityManager: Changing modify acls groups to: 
16/11/03 11:37:57 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/11/03 11:37:57 INFO Utils: Successfully started service 'sparkDriver' on port 40189.
16/11/03 11:37:57 INFO SparkEnv: Registering MapOutputTracker
16/11/03 11:37:57 INFO SparkEnv: Registering BlockManagerMaster
16/11/03 11:37:57 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-6606bbf7-869f-4646-a2e9-c966f7fefc7a
16/11/03 11:37:57 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/11/03 11:37:57 INFO SparkEnv: Registering OutputCommitCoordinator
16/11/03 11:37:57 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/11/03 11:37:57 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/11/03 11:37:57 INFO Executor: Starting executor ID driver on host localhost
16/11/03 11:37:57 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 45396.
16/11/03 11:37:57 INFO NettyBlockTransferService: Server created on localhost:45396
16/11/03 11:37:57 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 45396)
16/11/03 11:37:57 INFO BlockManagerMasterEndpoint: Registering block manager localhost:45396 with 15.8 GB RAM, BlockManagerId(driver, localhost, 45396)
16/11/03 11:37:57 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 45396)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:45396 (size: 14.3 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 0 from textFile at SuccinctJsonRDDSuite.scala:174
16/11/03 11:37:57 INFO FileInputFormat: Total input paths to process : 1
16/11/03 11:37:57 INFO SparkContext: Starting job: collect at SuccinctJsonRDD.scala:170
16/11/03 11:37:57 INFO DAGScheduler: Registering RDD 2 (repartition at SuccinctJsonRDDSuite.scala:174)
16/11/03 11:37:57 INFO DAGScheduler: Got job 0 (collect at SuccinctJsonRDD.scala:170) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 1 (collect at SuccinctJsonRDD.scala:170)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0)
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0)
16/11/03 11:37:57 INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.7 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:45396 (size: 2.7 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at repartition at SuccinctJsonRDDSuite.scala:174)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5459 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/11/03 11:37:57 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/people.json:0+506
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1243 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 20 ms on localhost (1/1)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ShuffleMapStage 0 (repartition at SuccinctJsonRDDSuite.scala:174) finished in 0.020 s
16/11/03 11:37:57 INFO DAGScheduler: looking for newly runnable stages
16/11/03 11:37:57 INFO DAGScheduler: running: Set()
16/11/03 11:37:57 INFO DAGScheduler: waiting: Set(ResultStage 1)
16/11/03 11:37:57 INFO DAGScheduler: failed: Set()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.3 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:45396 (size: 2.3 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 1 (MapPartitionsRDD[6] at mapPartitions at SuccinctJsonRDD.scala:170)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 1.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1295 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, localhost, partition 1, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 7 ms on localhost (1/5)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1295 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, localhost, partition 2, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 5 ms on localhost (2/5)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1208 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, localhost, partition 3, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 5 ms on localhost (3/5)
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1295 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 5, localhost, partition 4, NODE_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 1.0 (TID 5)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 4 ms on localhost (4/5)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 1.0 (TID 5). 1208 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 5) in 3 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 1 (collect at SuccinctJsonRDD.scala:170) finished in 0.021 s
16/11/03 11:37:57 INFO DAGScheduler: Job 0 finished: collect at SuccinctJsonRDD.scala:170, took 0.057075 s
16/11/03 11:37:57 INFO SparkContext: Starting job: zipWithIndex at SuccinctJsonRDD.scala:128
16/11/03 11:37:57 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 149 bytes
16/11/03 11:37:57 INFO DAGScheduler: Got job 1 (zipWithIndex at SuccinctJsonRDD.scala:128) with 4 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2)
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.0 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:45396 (size: 2.4 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 3 (SuccinctJsonRDD MapPartitionsRDD[7] at mapPartitionsWithIndex at SuccinctJsonRDD.scala:171)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 3.0 with 4 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, localhost, partition 0, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_0 in memory on localhost:45396 (size: 1128.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 2074 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, localhost, partition 1, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 9 ms on localhost (1/4)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_1 in memory on localhost:45396 (size: 1440.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 2074 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 8, localhost, partition 2, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 10 ms on localhost (2/4)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 3.0 (TID 8)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_2 in memory on localhost:45396 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 3.0 (TID 8). 2074 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 9, localhost, partition 3, NODE_LOCAL, 5480 bytes)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 8) in 5 ms on localhost (3/4)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 3.0 (TID 9)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_3 in memory on localhost:45396 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 3.0 (TID 9). 2074 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 9) in 7 ms on localhost (4/4)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 3 (zipWithIndex at SuccinctJsonRDD.scala:128) finished in 0.029 s
16/11/03 11:37:57 INFO DAGScheduler: Job 1 finished: zipWithIndex at SuccinctJsonRDD.scala:128, took 0.034057 s
16/11/03 11:37:57 INFO SparkContext: Starting job: foreach at SuccinctJsonRDD.scala:128
16/11/03 11:37:57 INFO DAGScheduler: Got job 2 (foreach at SuccinctJsonRDD.scala:128) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 4)
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.3 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:45396 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 5 (ZippedWithIndexRDD[9] at zipWithIndex at SuccinctJsonRDD.scala:128)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 5.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, localhost, partition 0, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, localhost, partition 1, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 22 ms on localhost (1/5)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 12, localhost, partition 2, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 5.0 (TID 12)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 16 ms on localhost (2/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 5.0 (TID 12). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 13, localhost, partition 3, PROCESS_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 12) in 14 ms on localhost (3/5)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 5.0 (TID 13)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 5.0 (TID 13). 916 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 14, localhost, partition 4, NODE_LOCAL, 5585 bytes)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 5.0 (TID 14)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 13) in 18 ms on localhost (4/5)
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
16/11/03 11:37:57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
16/11/03 11:37:57 INFO MemoryStore: Block rdd_7_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_7_4 in memory on localhost:45396 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 5.0 (TID 14). 2036 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 14) in 20 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctJsonRDD.scala:128) finished in 0.088 s
16/11/03 11:37:57 INFO DAGScheduler: Job 2 finished: foreach at SuccinctJsonRDD.scala:128, took 0.092612 s
16/11/03 11:37:57 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:183
16/11/03 11:37:57 INFO DAGScheduler: Got job 3 (collect at SuccinctJsonRDDSuite.scala:183) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 6)
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:45396 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 7 (SuccinctJsonRDDImpl[8] at RDD at SuccinctJsonRDD.scala:26)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 7.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 15, localhost, partition 0, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 7.0 (TID 15)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_0 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 15:
[rdd_7_0]
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 7.0 (TID 15). 1039 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 16, localhost, partition 1, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 7.0 (TID 16)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 15) in 5 ms on localhost (1/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_1 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 16:
[rdd_7_1]
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 7.0 (TID 16). 939 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 17, localhost, partition 2, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 7.0 (TID 17)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 16) in 3 ms on localhost (2/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_2 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 17:
[rdd_7_2]
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 7.0 (TID 17). 992 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 18, localhost, partition 3, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 7.0 (TID 18)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 17) in 3 ms on localhost (3/5)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_3 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 18:
[rdd_7_3]
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 7.0 (TID 18). 1007 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 19, localhost, partition 4, PROCESS_LOCAL, 5475 bytes)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 18) in 3 ms on localhost (4/5)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 7.0 (TID 19)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_7_4 locally
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 19:
[rdd_7_4]
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 7.0 (TID 19). 1005 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 19) in 2 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 7 (collect at SuccinctJsonRDDSuite.scala:183) finished in 0.015 s
16/11/03 11:37:57 INFO DAGScheduler: Job 3 finished: collect at SuccinctJsonRDDSuite.scala:183, took 0.021208 s
16/11/03 11:37:57 INFO SparkContext: Starting job: collect at SuccinctJsonRDDSuite.scala:184
16/11/03 11:37:57 INFO DAGScheduler: Got job 4 (collect at SuccinctJsonRDDSuite.scala:184) with 5 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 2.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 1516.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:45396 (size: 1516.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 5 missing tasks from ResultStage 8 (SuccinctJsonRDDImpl[12] at RDD at SuccinctJsonRDD.scala:26)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 8.0 with 5 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 20, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 8.0 (TID 20)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_0 stored as values in memory (estimated size 1128.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_0 in memory on localhost:45396 (size: 1128.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 20:
[rdd_11_0]
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 8.0 (TID 20). 1607 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 21, localhost, partition 1, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 1.0 in stage 8.0 (TID 21)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 20) in 13 ms on localhost (1/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_1 stored as values in memory (estimated size 1440.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_1 in memory on localhost:45396 (size: 1440.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 21:
[rdd_11_1]
16/11/03 11:37:57 INFO Executor: Finished task 1.0 in stage 8.0 (TID 21). 1594 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 22, localhost, partition 2, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 2.0 in stage 8.0 (TID 22)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 21) in 13 ms on localhost (2/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_2 stored as values in memory (estimated size 1284.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_2 in memory on localhost:45396 (size: 1284.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 22:
[rdd_11_2]
16/11/03 11:37:57 INFO Executor: Finished task 2.0 in stage 8.0 (TID 22). 1560 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 23, localhost, partition 3, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 3.0 in stage 8.0 (TID 23)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 22) in 14 ms on localhost (3/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_3 stored as values in memory (estimated size 1156.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_3 in memory on localhost:45396 (size: 1156.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 23:
[rdd_11_3]
16/11/03 11:37:57 INFO Executor: Finished task 3.0 in stage 8.0 (TID 23). 1575 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 24, localhost, partition 4, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:57 INFO Executor: Running task 4.0 in stage 8.0 (TID 24)
16/11/03 11:37:57 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 23) in 13 ms on localhost (4/5)
16/11/03 11:37:57 INFO MemoryStore: Block rdd_11_4 stored as values in memory (estimated size 1044.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_11_4 in memory on localhost:45396 (size: 1044.0 B, free: 15.8 GB)
16/11/03 11:37:57 WARN Executor: 1 block locks were not released by TID = 24:
[rdd_11_4]
16/11/03 11:37:57 INFO Executor: Finished task 4.0 in stage 8.0 (TID 24). 1565 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 24) in 12 ms on localhost (5/5)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 8 (collect at SuccinctJsonRDDSuite.scala:184) finished in 0.065 s
16/11/03 11:37:57 INFO DAGScheduler: Job 4 finished: collect at SuccinctJsonRDDSuite.scala:184, took 0.068656 s
- Test save and load in memory 2
16/11/03 11:37:57 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/11/03 11:37:57 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/11/03 11:37:57 INFO MemoryStore: MemoryStore cleared
16/11/03 11:37:57 INFO BlockManager: BlockManager stopped
16/11/03 11:37:57 INFO BlockManagerMaster: BlockManagerMaster stopped
16/11/03 11:37:57 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/11/03 11:37:57 INFO SparkContext: Successfully stopped SparkContext
SuccinctTableRDDSuite:
16/11/03 11:37:57 INFO SparkContext: Running Spark version 2.0.1
16/11/03 11:37:57 INFO SecurityManager: Changing view acls to: jenkins
16/11/03 11:37:57 INFO SecurityManager: Changing modify acls to: jenkins
16/11/03 11:37:57 INFO SecurityManager: Changing view acls groups to: 
16/11/03 11:37:57 INFO SecurityManager: Changing modify acls groups to: 
16/11/03 11:37:57 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
16/11/03 11:37:57 INFO Utils: Successfully started service 'sparkDriver' on port 60416.
16/11/03 11:37:57 INFO SparkEnv: Registering MapOutputTracker
16/11/03 11:37:57 INFO SparkEnv: Registering BlockManagerMaster
16/11/03 11:37:57 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-565f6620-d549-405b-825c-211fd9bfbba2
16/11/03 11:37:57 INFO MemoryStore: MemoryStore started with capacity 15.8 GB
16/11/03 11:37:57 INFO SparkEnv: Registering OutputCommitCoordinator
16/11/03 11:37:57 INFO Utils: Successfully started service 'SparkUI' on port 4040.
16/11/03 11:37:57 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://localhost:4040
16/11/03 11:37:57 INFO Executor: Starting executor ID driver on host localhost
16/11/03 11:37:57 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 47782.
16/11/03 11:37:57 INFO NettyBlockTransferService: Server created on localhost:47782
16/11/03 11:37:57 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, localhost, 47782)
16/11/03 11:37:57 INFO BlockManagerMasterEndpoint: Registering block manager localhost:47782 with 15.8 GB RAM, BlockManagerId(driver, localhost, 47782)
16/11/03 11:37:57 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, localhost, 47782)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 144.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.3 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:47782 (size: 14.3 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 0 from textFile at SuccinctTableRDDSuite.scala:19
16/11/03 11:37:57 INFO FileInputFormat: Total input paths to process : 1
16/11/03 11:37:57 INFO SparkContext: Starting job: first at SuccinctTableRDDSuite.scala:21
16/11/03 11:37:57 INFO DAGScheduler: Got job 0 (first at SuccinctTableRDDSuite.scala:21) with 1 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.3 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2021.0 B, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:47782 (size: 2021.0 B, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[2] at map at SuccinctTableRDDSuite.scala:20)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5466 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/11/03 11:37:57 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1291 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 6 ms on localhost (1/1)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 0 (first at SuccinctTableRDDSuite.scala:21) finished in 0.006 s
16/11/03 11:37:57 INFO DAGScheduler: Job 0 finished: first at SuccinctTableRDDSuite.scala:21, took 0.009685 s
16/11/03 11:37:57 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:226
16/11/03 11:37:57 INFO DAGScheduler: Got job 1 (fold at SuccinctTableRDD.scala:226) with 1 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 1 (fold at SuccinctTableRDD.scala:226)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:47782 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, localhost, partition 0, PROCESS_LOCAL, 5465 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
16/11/03 11:37:57 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1178 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 9 ms on localhost (1/1)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 1 (fold at SuccinctTableRDD.scala:226) finished in 0.010 s
16/11/03 11:37:57 INFO DAGScheduler: Job 1 finished: fold at SuccinctTableRDD.scala:226, took 0.012903 s
16/11/03 11:37:57 INFO SparkContext: Starting job: fold at SuccinctTableRDD.scala:244
16/11/03 11:37:57 INFO DAGScheduler: Got job 2 (fold at SuccinctTableRDD.scala:244) with 1 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 2 (fold at SuccinctTableRDD.scala:244)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:47782 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[4] at map at SuccinctTableRDDSuite.scala:23)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 2.0 with 1 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 2, localhost, partition 0, PROCESS_LOCAL, 5465 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 2.0 (TID 2)
16/11/03 11:37:57 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 2.0 (TID 2). 1181 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 2) in 9 ms on localhost (1/1)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 2 (fold at SuccinctTableRDD.scala:244) finished in 0.009 s
16/11/03 11:37:57 INFO DAGScheduler: Job 2 finished: fold at SuccinctTableRDD.scala:244, took 0.011928 s
16/11/03 11:37:57 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
16/11/03 11:37:57 INFO DAGScheduler: Got job 3 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 6.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.5 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:47782 (size: 3.5 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 3 (MapPartitionsRDD[7] at map at SuccinctTableRDDImpl.scala:37)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 3.0 with 1 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 3, localhost, partition 0, PROCESS_LOCAL, 5470 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 3.0 (TID 3)
16/11/03 11:37:57 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/Succinct/spark/target/scala-2.11/test-classes/table.dat:0+128772
16/11/03 11:37:57 INFO MemoryStore: Block rdd_5_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added rdd_5_0 in memory on localhost:47782 (size: 81.1 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO Executor: Finished task 0.0 in stage 3.0 (TID 3). 1682 bytes result sent to driver
16/11/03 11:37:57 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 3) in 45 ms on localhost (1/1)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
16/11/03 11:37:57 INFO DAGScheduler: ResultStage 3 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.045 s
16/11/03 11:37:57 INFO DAGScheduler: Job 3 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.048226 s
16/11/03 11:37:57 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:26
16/11/03 11:37:57 INFO DAGScheduler: Got job 4 (collect at SuccinctTableRDDSuite.scala:26) with 1 output partitions
16/11/03 11:37:57 INFO DAGScheduler: Final stage: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26)
16/11/03 11:37:57 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:57 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:57 INFO DAGScheduler: Submitting ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.7 KB, free 15.8 GB)
16/11/03 11:37:57 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 3.8 KB, free 15.8 GB)
16/11/03 11:37:57 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:47782 (size: 3.8 KB, free: 15.8 GB)
16/11/03 11:37:57 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:57 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 4 (SuccinctTableRDDImpl[6] at RDD at SuccinctTableRDD.scala:31)
16/11/03 11:37:57 INFO TaskSchedulerImpl: Adding task set 4.0 with 1 tasks
16/11/03 11:37:57 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 4, localhost, partition 0, PROCESS_LOCAL, 5468 bytes)
16/11/03 11:37:57 INFO Executor: Running task 0.0 in stage 4.0 (TID 4)
16/11/03 11:37:57 INFO BlockManager: Found block rdd_5_0 locally
16/11/03 11:37:58 WARN Executor: 1 block locks were not released by TID = 4:
[rdd_5_0]
16/11/03 11:37:58 INFO Executor: Finished task 0.0 in stage 4.0 (TID 4). 177609 bytes result sent to driver
16/11/03 11:37:58 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 4) in 164 ms on localhost (1/1)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 
16/11/03 11:37:58 INFO DAGScheduler: ResultStage 4 (collect at SuccinctTableRDDSuite.scala:26) finished in 0.165 s
16/11/03 11:37:58 INFO DAGScheduler: Job 4 finished: collect at SuccinctTableRDDSuite.scala:26, took 0.168164 s
16/11/03 11:37:58 INFO SparkContext: Starting job: foreach at SuccinctTableRDDImpl.scala:111
16/11/03 11:37:58 INFO DAGScheduler: Got job 5 (foreach at SuccinctTableRDDImpl.scala:111) with 1 output partitions
16/11/03 11:37:58 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111)
16/11/03 11:37:58 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:58 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:58 INFO DAGScheduler: Submitting ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111), which has no missing parents
16/11/03 11:37:58 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.1 KB, free 15.8 GB)
16/11/03 11:37:58 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 3.3 KB, free 15.8 GB)
16/11/03 11:37:58 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:47782 (size: 3.3 KB, free: 15.8 GB)
16/11/03 11:37:58 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:58 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 5 (ZippedWithIndexRDD[8] at zipWithIndex at SuccinctTableRDDImpl.scala:111)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Adding task set 5.0 with 1 tasks
16/11/03 11:37:58 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 5, localhost, partition 0, PROCESS_LOCAL, 5578 bytes)
16/11/03 11:37:58 INFO Executor: Running task 0.0 in stage 5.0 (TID 5)
16/11/03 11:37:58 INFO BlockManager: Found block rdd_5_0 locally
16/11/03 11:37:58 INFO Executor: Finished task 0.0 in stage 5.0 (TID 5). 916 bytes result sent to driver
16/11/03 11:37:58 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 5) in 20 ms on localhost (1/1)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
16/11/03 11:37:58 INFO DAGScheduler: ResultStage 5 (foreach at SuccinctTableRDDImpl.scala:111) finished in 0.020 s
16/11/03 11:37:58 INFO DAGScheduler: Job 5 finished: foreach at SuccinctTableRDDImpl.scala:111, took 0.026367 s
16/11/03 11:37:58 INFO SparkContext: Starting job: aggregate at SuccinctTableRDDImpl.scala:37
16/11/03 11:37:58 INFO DAGScheduler: Got job 6 (aggregate at SuccinctTableRDDImpl.scala:37) with 1 output partitions
16/11/03 11:37:58 INFO DAGScheduler: Final stage: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37)
16/11/03 11:37:58 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:58 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:58 INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37), which has no missing parents
16/11/03 11:37:58 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.4 KB, free 15.8 GB)
16/11/03 11:37:58 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.5 KB, free 15.8 GB)
16/11/03 11:37:58 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:47782 (size: 2.5 KB, free: 15.8 GB)
16/11/03 11:37:58 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:58 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 6 (MapPartitionsRDD[12] at map at SuccinctTableRDDImpl.scala:37)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Adding task set 6.0 with 1 tasks
16/11/03 11:37:58 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 6, localhost, partition 0, PROCESS_LOCAL, 5392 bytes)
16/11/03 11:37:58 INFO Executor: Running task 0.0 in stage 6.0 (TID 6)
16/11/03 11:37:58 INFO MemoryStore: Block rdd_10_0 stored as values in memory (estimated size 81.1 KB, free 15.8 GB)
16/11/03 11:37:58 INFO BlockManagerInfo: Added rdd_10_0 in memory on localhost:47782 (size: 81.1 KB, free: 15.8 GB)
16/11/03 11:37:58 INFO Executor: Finished task 0.0 in stage 6.0 (TID 6). 1522 bytes result sent to driver
16/11/03 11:37:58 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 6) in 17 ms on localhost (1/1)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 
16/11/03 11:37:58 INFO DAGScheduler: ResultStage 6 (aggregate at SuccinctTableRDDImpl.scala:37) finished in 0.017 s
16/11/03 11:37:58 INFO DAGScheduler: Job 6 finished: aggregate at SuccinctTableRDDImpl.scala:37, took 0.021122 s
16/11/03 11:37:58 INFO SparkContext: Starting job: collect at SuccinctTableRDDSuite.scala:32
16/11/03 11:37:58 INFO DAGScheduler: Got job 7 (collect at SuccinctTableRDDSuite.scala:32) with 1 output partitions
16/11/03 11:37:58 INFO DAGScheduler: Final stage: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32)
16/11/03 11:37:58 INFO DAGScheduler: Parents of final stage: List()
16/11/03 11:37:58 INFO DAGScheduler: Missing parents: List()
16/11/03 11:37:58 INFO DAGScheduler: Submitting ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31), which has no missing parents
16/11/03 11:37:58 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 4.6 KB, free 15.8 GB)
16/11/03 11:37:58 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.8 KB, free 15.8 GB)
16/11/03 11:37:58 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:47782 (size: 2.8 KB, free: 15.8 GB)
16/11/03 11:37:58 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012
16/11/03 11:37:58 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 7 (SuccinctTableRDDImpl[11] at RDD at SuccinctTableRDD.scala:31)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Adding task set 7.0 with 1 tasks
16/11/03 11:37:58 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 7, localhost, partition 0, PROCESS_LOCAL, 5390 bytes)
16/11/03 11:37:58 INFO Executor: Running task 0.0 in stage 7.0 (TID 7)
16/11/03 11:37:58 INFO BlockManager: Found block rdd_10_0 locally
16/11/03 11:37:58 WARN Executor: 1 block locks were not released by TID = 7:
[rdd_10_0]
16/11/03 11:37:58 INFO Executor: Finished task 0.0 in stage 7.0 (TID 7). 177609 bytes result sent to driver
16/11/03 11:37:58 INFO DAGScheduler: ResultStage 7 (collect at SuccinctTableRDDSuite.scala:32) finished in 0.121 s
16/11/03 11:37:58 INFO DAGScheduler: Job 7 finished: collect at SuccinctTableRDDSuite.scala:32, took 0.124783 s
16/11/03 11:37:58 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 7) in 120 ms on localhost (1/1)
16/11/03 11:37:58 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 
- Test save and retrieve in memory
16/11/03 11:37:58 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
16/11/03 11:37:58 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/11/03 11:37:58 INFO MemoryStore: MemoryStore cleared
16/11/03 11:37:58 INFO BlockManager: BlockManager stopped
16/11/03 11:37:58 INFO BlockManagerMaster: BlockManagerMaster stopped
16/11/03 11:37:58 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/11/03 11:37:58 INFO SparkContext: Successfully stopped SparkContext
Run completed in 53 seconds, 407 milliseconds.
Total number of tests run: 32
Suites: completed 6, aborted 0
Tests: succeeded 32, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
16/11/03 11:37:58 INFO ShutdownHookManager: Shutdown hook called
16/11/03 11:37:58 INFO ShutdownHookManager: Deleting directory /tmp/spark-8ae95610-f17e-4ac1-8688-1f0c78e33b52
[JENKINS] Recording test results
[INFO] 
[INFO] --- maven-jar-plugin:2.3.2:jar (default-jar) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-spark ---
[INFO] Configured Artifact: amplab:succinct-spark:0.1.8:jar
[INFO] amplab:succinct-spark:0.1.8:jar already exists in /home/jenkins/workspace/Succinct/spark/target
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (make-assembly) @ succinct-spark ---
[INFO] Building jar: /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ succinct-spark ---
[INFO] Installing /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[INFO] Installing /home/jenkins/workspace/Succinct/spark/pom.xml to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[INFO] Installing /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to /home/jenkins/.m2/repository/amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Succinct Assembly 0.1.8
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ succinct-assembly ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.5.5:single (package-all) @ succinct-assembly ---
[INFO] Reading assembly descriptor: src/main/assembly/assembly.xml
[INFO] Building jar: /home/jenkins/workspace/Succinct/assembly/../target/succinct-0.1.8.jar
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (copy-artifact) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:pom
[INFO] Copying pom.xml to /home/jenkins/workspace/Succinct/assembly/target/pom.xml
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ succinct-assembly ---
[INFO] Skipping artifact installation
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:copy (install-assembly-jar) @ succinct-assembly ---
[INFO] Configured Artifact: amplab:succinct-assembly:0.1.8:jar
[INFO] Copying succinct-0.1.8.jar to /home/jenkins/.m2/repository/amplab/succinct/0.1.8/succinct-0.1.8.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Succinct .......................................... SUCCESS [1.715s]
[INFO] Succinct Core ..................................... SUCCESS [27.673s]
[INFO] Succinct Serialization/Deserialization ............ SUCCESS [1.113s]
[INFO] Succinct on Apache Spark .......................... SUCCESS [1:56.369s]
[INFO] Succinct Assembly ................................. SUCCESS [0.581s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:28.412s
[INFO] Finished at: Thu Nov 03 11:38:02 PDT 2016
[INFO] Final Memory: 96M/2435M
[INFO] ------------------------------------------------------------------------
Waiting for Jenkins to finish collecting data
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/pom.xml to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/spark/target/succinct-spark-0.1.8-jar-with-dependencies.jar to amplab/succinct-spark/0.1.8/succinct-spark-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/pom.xml to amplab/succinct-core/0.1.8/succinct-core-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8-tests.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/core/target/succinct-core-0.1.8-jar-with-dependencies.jar to amplab/succinct-core/0.1.8/succinct-core-0.1.8-jar-with-dependencies.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/assembly/pom.xml to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/assembly/../target/succinct-0.1.8.jar to amplab/succinct-assembly/0.1.8/succinct-assembly-0.1.8.jar
/home/jenkins/workspace/Succinct/target/succinct-0.1.8.jar is not inside /home/jenkins/workspace/Succinct/assembly/; will archive in a separate pass
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/pom.xml to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.pom
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/target/succinct-serde-0.1.8.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/serde/target/succinct-serde-0.1.8-tests.jar to amplab/succinct-serde/0.1.8/succinct-serde-0.1.8-tests.jar
[JENKINS] Archiving /home/jenkins/workspace/Succinct/pom.xml to amplab/succinct/0.1.8/succinct-0.1.8.pom
channel stopped
Finished: SUCCESS