:26:46 INFO ContextCleaner: Cleaned accumulator 4023
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4540
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3841
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3854
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3857
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3990
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4233
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3492
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4463
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3639
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3853
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4145
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4493
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4139
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3976
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3648
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3865
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4323
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4243
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4491
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4473
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4034
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4539
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3481
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4055
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3637
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3529
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3948
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4142
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3692
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4552
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4431
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3603
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4262
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4327
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3800
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3977
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4036
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4166
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4123
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3624
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3915
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3930
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4070
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4207
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4052
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4317
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3397
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4105
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3475
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3502
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3978
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3923
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3416
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3594
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3913
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3689
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3625
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4299
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3760
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4534
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3422
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3497
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4288
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4390
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4292
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4439
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3801
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3931
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3414
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3714
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4308
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3527
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3482
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3528
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3629
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3677
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3736
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3943
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4138
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3433
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3520
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3423
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3771
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3957
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3588
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4255
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4322
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3613
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4189
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3487
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3963
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3955
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3597
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4061
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4301
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4082
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3844
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4104
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3779
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3811
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4467
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3402
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4211
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3975
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4096
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4218
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3568
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4238
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4406
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4172
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4170
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3660
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4040
18/11/12 12:26:46 INFO BlockManager: Removing RDD 627
18/11/12 12:26:46 INFO ContextCleaner: Cleaned RDD 627
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4119
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3599
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4249
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4316
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3840
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3846
18/11/12 12:26:46 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_147_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2000.2 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3656
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3685
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4506
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4318
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3405
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3831
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_134_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 2000.3 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4434
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3554
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3968
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4464
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3581
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3669
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4294
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4445
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3586
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3546
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4541
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4183
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4312
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4372
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4339
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3406
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3605
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3964
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3819
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3782
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4488
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3495
18/11/12 12:26:46 INFO ContextCleaner: Cleaned shuffle 33
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3777
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4147
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3914
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4386
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3522
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4193
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3984
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3490
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3873
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4436
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3922
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3400
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3691
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3537
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3824
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3832
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4325
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3769
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4254
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4257
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4056
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4000
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_141_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.5 MB)
18/11/12 12:26:46 INFO MemoryStore: Block broadcast_157 stored as values in memory (estimated size 543.8 KB, free 1993.3 MB)
18/11/12 12:26:46 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_152_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.6 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned shuffle 37
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3979
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4337
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3953
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4160
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3504
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3395
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3866
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4311
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4342
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3451
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3649
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4158
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3458
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3567
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4205
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3608
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3620
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4090
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3884
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4344
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4376
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4505
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3890
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4375
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4421
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3896
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4130
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4336
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3980
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3503
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4136
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4064
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4225
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4077
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3610
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4507
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3798
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3575
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3918
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4149
18/11/12 12:26:46 INFO MemoryStore: Block broadcast_157_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1994.4 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4031
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4481
18/11/12 12:26:46 INFO ContextCleaner: Cleaned shuffle 35
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3643
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4332
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3600
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3572
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4005
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4438
18/11/12 12:26:46 INFO BlockManagerInfo: Added broadcast_157_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 2000.5 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3653
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3667
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3794
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4277
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4387
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3462
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3868
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3545
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3767
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3536
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4025
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3756
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3519
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3909
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4512
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4393
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3511
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4425
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3602
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3758
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3557
18/11/12 12:26:46 INFO SparkContext: Created broadcast 157 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4476
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4363
18/11/12 12:26:46 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 153 (MapPartitionsRDD[733] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:46 INFO TaskSchedulerImpl: Adding task set 153.0 with 1 tasks
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_153_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2000.5 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3835
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3871
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4358
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3565
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4252
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4453
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4508
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3941
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3618
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3741
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4364
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3445
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3804
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3645
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3681
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4071
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4271
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4198
18/11/12 12:26:46 INFO DAGScheduler: Got job 113 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:26:46 INFO DAGScheduler: Final stage: ResultStage 154 (foreachPartition at XGBoost.scala:287)
18/11/12 12:26:46 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:46 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_121_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 2000.6 MB)
18/11/12 12:26:46 INFO DAGScheduler: Submitting ResultStage 154 (MapPartitionsRDD[741] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4141
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4116
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3859
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4326
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3409
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3894
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3441
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3885
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4181
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3501
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4310
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4182
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3987
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3499
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3917
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4426
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3417
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3477
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3493
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4125
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_135_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2000.6 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4049
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3631
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4013
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3966
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4279
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4178
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3730
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3928
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4027
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4253
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4101
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4164
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4384
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3830
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3961
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4485
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3967
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4367
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4334
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3743
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4134
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4185
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4496
18/11/12 12:26:46 INFO Executor: Finished task 0.0 in stage 151.0 (TID 349). 3861 bytes result sent to driver
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_117_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2000.6 MB)
18/11/12 12:26:46 INFO TaskSetManager: Starting task 0.0 in stage 153.0 (TID 350, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:46 INFO TaskSetManager: Finished task 0.0 in stage 151.0 (TID 349) in 23 ms on localhost (executor driver) (1/1)
18/11/12 12:26:46 INFO TaskSchedulerImpl: Removed TaskSet 151.0, whose tasks have all completed, from pool 
18/11/12 12:26:46 INFO Executor: Running task 0.0 in stage 153.0 (TID 350)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3403
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3825
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3893
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3776
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3429
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4209
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3761
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4265
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4480
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3973
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3972
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4192
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3707
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4033
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4003
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4111
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4191
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4470
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3904
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3549
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3553
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4008
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3858
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4302
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4016
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3739
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3783
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4161
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4120
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4093
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_126_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.8 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3633
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4009
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3671
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4300
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4171
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3749
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3869
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3491
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4159
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3936
18/11/12 12:26:46 INFO BlockManager: Removing RDD 689
18/11/12 12:26:46 INFO ContextCleaner: Cleaned RDD 689
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3888
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4042
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3628
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3946
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4224
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4441
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3473
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3538
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4227
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3833
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4448
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3544
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4420
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3547
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3877
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_145_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.9 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4274
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3986
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4466
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3706
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3983
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3981
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4195
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4213
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3862
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4306
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4345
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3627
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3646
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4079
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4078
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4039
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3437
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3725
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3394
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4143
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4285
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4041
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4321
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4379
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3621
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4543
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3965
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4190
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4328
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3642
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4232
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4278
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3647
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4066
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_144_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 2001.1 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4511
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3753
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4165
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_149_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2001.2 MB)
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3457
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4462
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3958
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4204
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3696
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4392
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3452
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3954
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3494
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3460
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3661
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4394
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3463
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3809
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3950
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4465
18/11/12 12:26:46 INFO BlockManager: Removing RDD 588
18/11/12 12:26:46 INFO ContextCleaner: Cleaned RDD 588
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4029
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4341
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3464
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3996
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3886
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4094
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3951
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3509
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4099
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3523
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3640
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3786
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3908
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3411
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3701
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3657
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3705
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3521
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4319
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3703
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3466
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4280
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3609
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3672
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3974
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3900
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4157
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3562
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3678
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4156
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4497
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4030
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3532
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4201
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3684
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3708
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3788
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3912
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3985
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4200
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4122
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3533
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3989
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4356
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4486
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4080
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3626
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3864
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4458
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3721
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4290
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3525
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3740
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4415
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3439
18/11/12 12:26:46 INFO BlockManagerInfo: Removed broadcast_138_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2001.4 MB)
18/11/12 12:26:46 INFO BlockManager: Removing RDD 596
18/11/12 12:26:46 INFO ContextCleaner: Cleaned RDD 596
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3515
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3476
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3903
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4432
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4460
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3722
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4366
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3821
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3542
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4131
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3543
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3650
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4428
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 3719
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4298
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4483
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4291
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4129
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4536
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4261
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4475
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4047
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4272
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4547
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4343
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4451
18/11/12 12:26:46 INFO ContextCleaner: Cleaned accumulator 4411
18/11/12 12:26:46 INFO MemoryStore: Block broadcast_158 stored as values in memory (estimated size 543.8 KB, free 1998.0 MB)
18/11/12 12:26:46 INFO MemoryStore: Block broadcast_158_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1997.8 MB)
18/11/12 12:26:46 INFO BlockManagerInfo: Added broadcast_158_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 2001.2 MB)
18/11/12 12:26:46 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:26:46 INFO SparkContext: Created broadcast 158 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:46 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 154 (MapPartitionsRDD[741] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:46 INFO TaskSchedulerImpl: Adding task set 154.0 with 1 tasks
18/11/12 12:26:46 INFO DAGScheduler: ShuffleMapStage 151 (take at Classifier.scala:111) finished in 0.061 s
18/11/12 12:26:46 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:26:46 INFO DAGScheduler: running: Set(ResultStage 153, ResultStage 154)
18/11/12 12:26:46 INFO DAGScheduler: waiting: Set(ResultStage 152)
18/11/12 12:26:46 INFO DAGScheduler: failed: Set()
18/11/12 12:26:46 INFO DAGScheduler: Submitting ResultStage 152 (MapPartitionsRDD[732] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:26:46 INFO MemoryStore: Block broadcast_159 stored as values in memory (estimated size 8.2 KB, free 1997.8 MB)
18/11/12 12:26:46 INFO MemoryStore: Block broadcast_159_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1997.8 MB)
18/11/12 12:26:46 INFO BlockManagerInfo: Added broadcast_159_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 2001.2 MB)
18/11/12 12:26:46 INFO SparkContext: Created broadcast 159 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:46 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 152 (MapPartitionsRDD[732] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:46 INFO TaskSchedulerImpl: Adding task set 152.0 with 1 tasks
[INFO] [11/12/2018 12:26:46.414] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[12:26:46] Tree method is automatically selected to be 'approx' for distributed training.
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.416] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:26:46.416] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
[INFO] [11/12/2018 12:26:46.421] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [0]	train-error:0.111732
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.425] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [1]	train-error:0.093110
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.431] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [2]	train-error:0.083799
[INFO] [11/12/2018 12:26:46.436] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [3]	train-error:0.070763
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.441] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [4]	train-error:0.070763
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.446] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [5]	train-error:0.070763
[INFO] [11/12/2018 12:26:46.451] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.065177
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.458] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [7]	train-error:0.059590
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.464] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [8]	train-error:0.055866
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.469] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [9]	train-error:0.057728
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.476] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [10]	train-error:0.054004
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.482] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [11]	train-error:0.052142
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.491] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [12]	train-error:0.052142
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.501] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [13]	train-error:0.052142
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.510] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [14]	train-error:0.050279
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.517] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [15]	train-error:0.050279
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.524] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [16]	train-error:0.050279
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.533] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [17]	train-error:0.048417
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.538] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [18]	train-error:0.048417
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.550] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.557] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [20]	train-error:0.046555
[INFO] [11/12/2018 12:26:46.567] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [21]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.576] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.588] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.595] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [24]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.604] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [25]	train-error:0.046555
[INFO] [11/12/2018 12:26:46.610] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [26]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.615] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [27]	train-error:0.046555
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.620] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [28]	train-error:0.048417
[INFO] [11/12/2018 12:26:46.624] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [29]	train-error:0.044693
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.628] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [30]	train-error:0.042831
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.633] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [31]	train-error:0.042831
[INFO] [11/12/2018 12:26:46.637] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [32]	train-error:0.042831
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.642] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [33]	train-error:0.040968
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.656] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [34]	train-error:0.040968
[INFO] [11/12/2018 12:26:46.658] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [35]	train-error:0.039106
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.669] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [36]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.678] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [37]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.688] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [38]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.697] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [39]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.707] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [40]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.721] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [41]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.729] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [42]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.741] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [43]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.752] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [44]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.766] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [45]	train-error:0.037244
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.775] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [46]	train-error:0.037244
[INFO] [11/12/2018 12:26:46.786] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [47]	train-error:0.035382
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.791] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [48]	train-error:0.035382
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.798] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [49]	train-error:0.027933
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.802] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [50]	train-error:0.026071
[INFO] [11/12/2018 12:26:46.807] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [51]	train-error:0.026071
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.811] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [52]	train-error:0.026071
[INFO] [11/12/2018 12:26:46.815] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [53]	train-error:0.026071
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.820] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [54]	train-error:0.026071
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.825] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [55]	train-error:0.024209
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.832] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [56]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.843] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [57]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.851] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [58]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.858] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [59]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.869] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [60]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.875] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [61]	train-error:0.022346
[INFO] [11/12/2018 12:26:46.886] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [62]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.896] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [63]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.905] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [64]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.917] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [65]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.927] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [66]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.939] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [67]	train-error:0.022346
[INFO] [11/12/2018 12:26:46.952] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [68]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.965] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [69]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.976] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [70]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.986] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [71]	train-error:0.022346
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.994] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [72]	train-error:0.018622
[INFO] [11/12/2018 12:26:46.994] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/system/IO-TCP/selectors/$a/74] Message [akka.io.SelectionHandler$ChannelReadable$] from Actor[akka://RabitTracker/deadLetters] to Actor[akka://RabitTracker/system/IO-TCP/selectors/$a/74#-1579811992] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[12:26:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:46.999] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [73]	train-error:0.020484
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.004] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [74]	train-error:0.020484
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=6
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.010] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [75]	train-error:0.018622
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.014] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [76]	train-error:0.016760
[INFO] [11/12/2018 12:26:47.019] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [77]	train-error:0.014898
[INFO] [11/12/2018 12:26:47.023] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [78]	train-error:0.016760
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.028] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [79]	train-error:0.016760
[INFO] [11/12/2018 12:26:47.033] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [80]	train-error:0.016760
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.037] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [81]	train-error:0.016760
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.042] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.013035
[INFO] [11/12/2018 12:26:47.049] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [83]	train-error:0.013035
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.057] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [84]	train-error:0.013035
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.067] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [85]	train-error:0.011173
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.076] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [86]	train-error:0.011173
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.091] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [87]	train-error:0.011173
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.105] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [88]	train-error:0.011173
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.119] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [89]	train-error:0.011173
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.131] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [90]	train-error:0.011173
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.140] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [91]	train-error:0.007449
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.152] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [92]	train-error:0.007449
[INFO] [11/12/2018 12:26:47.162] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [93]	train-error:0.007449
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.174] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [94]	train-error:0.007449
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.180] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [95]	train-error:0.007449
[INFO] [11/12/2018 12:26:47.185] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [96]	train-error:0.007449
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.190] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [97]	train-error:0.007449
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.195] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [98]	train-error:0.007449
[12:26:47] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:47.200] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [99]	train-error:0.007449
18/11/12 12:26:49 INFO MemoryStore: Block rdd_733_0 stored as values in memory (estimated size 584.0 B, free 1997.8 MB)
18/11/12 12:26:49 INFO BlockManagerInfo: Added rdd_733_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 2001.2 MB)
18/11/12 12:26:49 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:26:49 INFO Executor: 1 block locks were not released by TID = 350:
[rdd_733_0]
18/11/12 12:26:49 INFO Executor: Finished task 0.0 in stage 153.0 (TID 350). 3428 bytes result sent to driver
18/11/12 12:26:49 INFO TaskSetManager: Starting task 0.0 in stage 152.0 (TID 351, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:26:49 INFO TaskSetManager: Finished task 0.0 in stage 153.0 (TID 350) in 2811 ms on localhost (executor driver) (1/1)
[INFO] [11/12/2018 12:26:49.204] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:26:49 INFO Executor: Running task 0.0 in stage 152.0 (TID 351)
18/11/12 12:26:49 INFO TaskSchedulerImpl: Removed TaskSet 153.0, whose tasks have all completed, from pool 
18/11/12 12:26:49 INFO DAGScheduler: ResultStage 153 (foreachPartition at XGBoost.scala:287) finished in 2.833 s
18/11/12 12:26:49 INFO DAGScheduler: Job 112 finished: foreachPartition at XGBoost.scala:287, took 2.845097 s
18/11/12 12:26:49 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:26:49 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:26:49 INFO Executor: Finished task 0.0 in stage 152.0 (TID 351). 1551 bytes result sent to driver
18/11/12 12:26:49 INFO TaskSetManager: Starting task 0.0 in stage 154.0 (TID 352, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:49 INFO Executor: Running task 0.0 in stage 154.0 (TID 352)
18/11/12 12:26:49 INFO TaskSetManager: Finished task 0.0 in stage 152.0 (TID 351) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:26:49 INFO TaskSchedulerImpl: Removed TaskSet 152.0, whose tasks have all completed, from pool 
18/11/12 12:26:49 INFO DAGScheduler: ResultStage 152 (take at Classifier.scala:111) finished in 2.797 s
18/11/12 12:26:49 INFO DAGScheduler: Job 111 finished: take at Classifier.scala:111, took 2.862498 s
18/11/12 12:26:49 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_2e0fbaba5c35__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:26:49 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:26:49.221] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:26:49.222] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:26:49.222] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] All workers have started.
[12:26:49] Tree method is automatically selected to be 'approx' for distributed training.
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.232] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [0]	train-error:0.118705
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:49 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:26:49 INFO DAGScheduler: Got job 114 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:26:49 INFO DAGScheduler: Final stage: ResultStage 155 (first at XGBoost.scala:352)
18/11/12 12:26:49 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:49 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:49 INFO DAGScheduler: Submitting ResultStage 155 (MapPartitionsRDD[733] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.243] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [1]	train-error:0.102518
[INFO] [11/12/2018 12:26:49.243] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:57491
[INFO] [11/12/2018 12:26:49.243] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:26:49.247] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [2]	train-error:0.098921
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.253] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [3]	train-error:0.086331
18/11/12 12:26:49 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:49 INFO MemoryStore: Block broadcast_160 stored as values in memory (estimated size 543.8 KB, free 1997.3 MB)
18/11/12 12:26:49 INFO MemoryStore: Block broadcast_160_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1997.1 MB)
18/11/12 12:26:49 INFO BlockManagerInfo: Added broadcast_160_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2001.1 MB)
18/11/12 12:26:49 INFO SparkContext: Created broadcast 160 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:49 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 155 (MapPartitionsRDD[733] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:49 INFO TaskSchedulerImpl: Adding task set 155.0 with 1 tasks
18/11/12 12:26:49 INFO DAGScheduler: Got job 115 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:26:49 INFO DAGScheduler: Final stage: ResultStage 156 (foreachPartition at XGBoost.scala:287)
18/11/12 12:26:49 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:49 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:49 INFO DAGScheduler: Submitting ResultStage 156 (MapPartitionsRDD[749] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.258] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [4]	train-error:0.082734
[INFO] [11/12/2018 12:26:49.262] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [5]	train-error:0.077338
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.265] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.075540
[INFO] [11/12/2018 12:26:49.268] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [7]	train-error:0.071942
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:49 INFO MemoryStore: Block broadcast_161 stored as values in memory (estimated size 543.8 KB, free 1996.6 MB)
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:49 INFO MemoryStore: Block broadcast_161_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1996.4 MB)
18/11/12 12:26:49 INFO BlockManagerInfo: Added broadcast_161_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2000.9 MB)
18/11/12 12:26:49 INFO SparkContext: Created broadcast 161 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:49 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 156 (MapPartitionsRDD[749] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:49 INFO TaskSchedulerImpl: Adding task set 156.0 with 1 tasks
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.273] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.073741
[INFO] [11/12/2018 12:26:49.275] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [9]	train-error:0.073741
[INFO] [11/12/2018 12:26:49.278] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [10]	train-error:0.071942
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.281] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [11]	train-error:0.068345
[INFO] [11/12/2018 12:26:49.283] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [12]	train-error:0.064748
[INFO] [11/12/2018 12:26:49.286] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [13]	train-error:0.064748
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.289] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [14]	train-error:0.062950
[INFO] [11/12/2018 12:26:49.291] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [15]	train-error:0.055755
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.294] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [16]	train-error:0.055755
[INFO] [11/12/2018 12:26:49.296] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [17]	train-error:0.055755
[INFO] [11/12/2018 12:26:49.299] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [18]	train-error:0.052158
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.301] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [19]	train-error:0.050360
[INFO] [11/12/2018 12:26:49.304] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [20]	train-error:0.044964
[INFO] [11/12/2018 12:26:49.306] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [21]	train-error:0.043165
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.308] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22]	train-error:0.043165
[INFO] [11/12/2018 12:26:49.310] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [23]	train-error:0.043165
[INFO] [11/12/2018 12:26:49.312] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [24]	train-error:0.039568
[INFO] [11/12/2018 12:26:49.315] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [25]	train-error:0.039568
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.317] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [26]	train-error:0.037770
[INFO] [11/12/2018 12:26:49.319] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.035971
[INFO] [11/12/2018 12:26:49.321] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [28]	train-error:0.035971
[INFO] [11/12/2018 12:26:49.323] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [29]	train-error:0.035971
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.326] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [30]	train-error:0.032374
[INFO] [11/12/2018 12:26:49.328] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [31]	train-error:0.032374
[INFO] [11/12/2018 12:26:49.330] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [32]	train-error:0.032374
[INFO] [11/12/2018 12:26:49.332] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [33]	train-error:0.030576
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.334] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [34]	train-error:0.030576
[INFO] [11/12/2018 12:26:49.336] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [35]	train-error:0.030576
[INFO] [11/12/2018 12:26:49.338] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [36]	train-error:0.028777
[INFO] [11/12/2018 12:26:49.340] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [37]	train-error:0.028777
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.342] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [38]	train-error:0.028777
[INFO] [11/12/2018 12:26:49.346] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [39]	train-error:0.026978
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.354] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [40]	train-error:0.023381
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.356] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [41]	train-error:0.019784
[INFO] [11/12/2018 12:26:49.359] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [42]	train-error:0.016187
[INFO] [11/12/2018 12:26:49.362] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [43]	train-error:0.012590
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.366] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [44]	train-error:0.012590
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.370] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [45]	train-error:0.014388
[INFO] [11/12/2018 12:26:49.372] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [46]	train-error:0.012590
[INFO] [11/12/2018 12:26:49.375] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [47]	train-error:0.012590
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.378] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [48]	train-error:0.010791
[INFO] [11/12/2018 12:26:49.380] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [49]	train-error:0.010791
[INFO] [11/12/2018 12:26:49.383] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [50]	train-error:0.008993
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.385] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [51]	train-error:0.008993
[INFO] [11/12/2018 12:26:49.387] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [52]	train-error:0.008993
[INFO] [11/12/2018 12:26:49.390] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [53]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.392] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [54]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.395] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [55]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.397] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [56]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.399] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [57]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.402] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [58]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.404] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [59]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.406] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [60]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.409] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [61]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.411] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [62]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.414] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [63]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.417] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [64]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.420] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [65]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.426] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [66]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.430] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [67]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.435] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [68]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.439] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [69]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.447] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [70]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.453] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [71]	train-error:0.005396
[INFO] [11/12/2018 12:26:49.456] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.463] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [73]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.467] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [74]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.473] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [75]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.478] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [76]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.484] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [77]	train-error:0.007194
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.490] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [78]	train-error:0.007194
[INFO] [11/12/2018 12:26:49.494] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [79]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.501] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [80]	train-error:0.005396
[INFO] [11/12/2018 12:26:49.508] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.513] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [82]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.519] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [83]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.525] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [84]	train-error:0.005396
[INFO] [11/12/2018 12:26:49.531] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [85]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.537] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [86]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.542] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [87]	train-error:0.005396
[INFO] [11/12/2018 12:26:49.547] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [88]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.554] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [89]	train-error:0.005396
[INFO] [11/12/2018 12:26:49.558] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [90]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.562] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [91]	train-error:0.003597
[INFO] [11/12/2018 12:26:49.565] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [92]	train-error:0.005396
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.568] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [93]	train-error:0.003597
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.571] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [94]	train-error:0.003597
[INFO] [11/12/2018 12:26:49.574] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [95]	train-error:0.003597
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.577] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [96]	train-error:0.003597
[INFO] [11/12/2018 12:26:49.579] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [97]	train-error:0.003597
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.582] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [98]	train-error:0.003597
[12:26:49] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:49.585] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [99]	train-error:0.001799
[INFO] [11/12/2018 12:26:51.589] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:26:51 INFO MemoryStore: Block rdd_741_0 stored as values in memory (estimated size 584.0 B, free 1996.4 MB)
18/11/12 12:26:51 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:26:51 INFO BlockManagerInfo: Added rdd_741_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 2000.9 MB)
18/11/12 12:26:51 INFO Executor: 1 block locks were not released by TID = 352:
[rdd_741_0]
18/11/12 12:26:51 INFO Executor: Finished task 0.0 in stage 154.0 (TID 352). 3428 bytes result sent to driver
18/11/12 12:26:51 INFO TaskSetManager: Starting task 0.0 in stage 155.0 (TID 353, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:51 INFO TaskSetManager: Finished task 0.0 in stage 154.0 (TID 352) in 2383 ms on localhost (executor driver) (1/1)
18/11/12 12:26:51 INFO TaskSchedulerImpl: Removed TaskSet 154.0, whose tasks have all completed, from pool 
18/11/12 12:26:51 INFO Executor: Running task 0.0 in stage 155.0 (TID 353)
18/11/12 12:26:51 INFO DAGScheduler: ResultStage 154 (foreachPartition at XGBoost.scala:287) finished in 5.199 s
18/11/12 12:26:51 INFO DAGScheduler: Job 113 finished: foreachPartition at XGBoost.scala:287, took 5.207748 s
18/11/12 12:26:51 INFO BlockManager: Found block rdd_733_0 locally
18/11/12 12:26:51 INFO Executor: 1 block locks were not released by TID = 353:
[rdd_733_0]
18/11/12 12:26:51 INFO Executor: Finished task 0.0 in stage 155.0 (TID 353). 105842 bytes result sent to driver
18/11/12 12:26:51 INFO TaskSetManager: Starting task 0.0 in stage 156.0 (TID 354, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:51 INFO Executor: Running task 0.0 in stage 156.0 (TID 354)
18/11/12 12:26:51 INFO TaskSetManager: Finished task 0.0 in stage 155.0 (TID 353) in 10 ms on localhost (executor driver) (1/1)
18/11/12 12:26:51 INFO TaskSchedulerImpl: Removed TaskSet 155.0, whose tasks have all completed, from pool 
18/11/12 12:26:51 INFO DAGScheduler: ResultStage 155 (first at XGBoost.scala:352) finished in 2.362 s
18/11/12 12:26:51 INFO DAGScheduler: Job 114 finished: first at XGBoost.scala:352, took 2.364239 s
18/11/12 12:26:51 INFO MapPartitionsRDD: Removing RDD 733 from persistence list
18/11/12 12:26:51 INFO BlockManager: Removing RDD 733
18/11/12 12:26:51 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:26:51 INFO DAGScheduler: Got job 116 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:26:51 INFO DAGScheduler: Final stage: ResultStage 157 (first at XGBoost.scala:352)
18/11/12 12:26:51 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:51 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:51 INFO DAGScheduler: Submitting ResultStage 157 (MapPartitionsRDD[741] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:26:51 INFO BlockManager: Found block rdd_184_0 locally
[12:26:51] Tree method is automatically selected to be 'approx' for distributed training.
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.618] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:26:51.621] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:26:51.622] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] All workers have started.
18/11/12 12:26:51 INFO MemoryStore: Block broadcast_162 stored as values in memory (estimated size 543.8 KB, free 1995.9 MB)
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:51 INFO MemoryStore: Block broadcast_162_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1995.8 MB)
18/11/12 12:26:51 INFO BlockManagerInfo: Added broadcast_162_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2000.8 MB)
18/11/12 12:26:51 INFO SparkContext: Created broadcast 162 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:51 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 157 (MapPartitionsRDD[741] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:51 INFO TaskSchedulerImpl: Adding task set 157.0 with 1 tasks
[INFO] [11/12/2018 12:26:51.626] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [0]	train-error:0.123791
[INFO] [11/12/2018 12:26:51.630] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [1]	train-error:0.114120
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:51 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:26:51 INFO DAGScheduler: Registering RDD 754 (take at Classifier.scala:111)
18/11/12 12:26:51 INFO DAGScheduler: Got job 117 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:26:51 INFO DAGScheduler: Final stage: ResultStage 159 (take at Classifier.scala:111)
18/11/12 12:26:51 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 158)
18/11/12 12:26:51 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 158)
18/11/12 12:26:51 INFO DAGScheduler: Submitting ShuffleMapStage 158 (MapPartitionsRDD[754] at take at Classifier.scala:111), which has no missing parents
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.634] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [2]	train-error:0.108317
[INFO] [11/12/2018 12:26:51.638] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [3]	train-error:0.098646
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:51 INFO MemoryStore: Block broadcast_163 stored as values in memory (estimated size 537.6 KB, free 1995.2 MB)
[INFO] [11/12/2018 12:26:51.641] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [4]	train-error:0.090909
[INFO] [11/12/2018 12:26:51.645] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [5]	train-error:0.085106
18/11/12 12:26:51 INFO MemoryStore: Block broadcast_163_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1995.1 MB)
18/11/12 12:26:51 INFO BlockManagerInfo: Added broadcast_163_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 2000.6 MB)
18/11/12 12:26:51 INFO SparkContext: Created broadcast 163 from broadcast at DAGScheduler.scala:1039
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:26:51 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 158 (MapPartitionsRDD[754] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
[INFO] [11/12/2018 12:26:51.648] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [6]	train-error:0.083172
18/11/12 12:26:51 INFO TaskSchedulerImpl: Adding task set 158.0 with 1 tasks
[INFO] [11/12/2018 12:26:51.651] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [7]	train-error:0.083172
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.653] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [8]	train-error:0.083172
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.656] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [9]	train-error:0.079304
[INFO] [11/12/2018 12:26:51.658] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [10]	train-error:0.079304
[INFO] [11/12/2018 12:26:51.660] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [11]	train-error:0.077369
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.663] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [12]	train-error:0.077369
[INFO] [11/12/2018 12:26:51.665] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [13]	train-error:0.077369
[INFO] [11/12/2018 12:26:51.667] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [14]	train-error:0.077369
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.670] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [15]	train-error:0.081238
[INFO] [11/12/2018 12:26:51.672] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.075435
[INFO] [11/12/2018 12:26:51.675] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [17]	train-error:0.067698
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.677] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [18]	train-error:0.067698
[INFO] [11/12/2018 12:26:51.679] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.067698
[INFO] [11/12/2018 12:26:51.682] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [20]	train-error:0.061896
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.684] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [21]	train-error:0.056093
[INFO] [11/12/2018 12:26:51.686] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [22]	train-error:0.056093
[INFO] [11/12/2018 12:26:51.688] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.056093
[INFO] [11/12/2018 12:26:51.691] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [24]	train-error:0.052224
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.693] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [25]	train-error:0.050290
[INFO] [11/12/2018 12:26:51.695] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.048356
[INFO] [11/12/2018 12:26:51.697] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [27]	train-error:0.042553
[INFO] [11/12/2018 12:26:51.699] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [28]	train-error:0.042553
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.702] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [29]	train-error:0.036750
[INFO] [11/12/2018 12:26:51.704] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30]	train-error:0.038685
[INFO] [11/12/2018 12:26:51.706] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [31]	train-error:0.034816
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.709] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [32]	train-error:0.034816
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.711] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [33]	train-error:0.030948
[INFO] [11/12/2018 12:26:51.713] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [34]	train-error:0.029014
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.716] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [35]	train-error:0.027079
[INFO] [11/12/2018 12:26:51.718] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [36]	train-error:0.027079
[INFO] [11/12/2018 12:26:51.720] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [37]	train-error:0.027079
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.722] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [38]	train-error:0.027079
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.725] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [39]	train-error:0.027079
[INFO] [11/12/2018 12:26:51.727] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [40]	train-error:0.025145
[INFO] [11/12/2018 12:26:51.729] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [41]	train-error:0.021277
[INFO] [11/12/2018 12:26:51.731] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [42]	train-error:0.021277
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.734] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [43]	train-error:0.021277
[INFO] [11/12/2018 12:26:51.736] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [44]	train-error:0.021277
[INFO] [11/12/2018 12:26:51.738] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [45]	train-error:0.021277
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.740] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [46]	train-error:0.021277
[INFO] [11/12/2018 12:26:51.745] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [47]	train-error:0.021277
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.748] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [48]	train-error:0.023211
[INFO] [11/12/2018 12:26:51.750] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [49]	train-error:0.021277
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.755] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [50]	train-error:0.019342
[INFO] [11/12/2018 12:26:51.758] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [51]	train-error:0.021277
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.761] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [52]	train-error:0.019342
[INFO] [11/12/2018 12:26:51.763] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [53]	train-error:0.019342
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.766] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [54]	train-error:0.017408
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.769] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [55]	train-error:0.017408
[INFO] [11/12/2018 12:26:51.771] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [56]	train-error:0.015474
[INFO] [11/12/2018 12:26:51.774] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [57]	train-error:0.015474
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.776] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [58]	train-error:0.015474
[INFO] [11/12/2018 12:26:51.779] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [59]	train-error:0.013540
[INFO] [11/12/2018 12:26:51.782] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [60]	train-error:0.013540
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.785] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [61]	train-error:0.011605
[INFO] [11/12/2018 12:26:51.787] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [62]	train-error:0.011605
[INFO] [11/12/2018 12:26:51.789] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [63]	train-error:0.011605
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.792] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [64]	train-error:0.011605
[INFO] [11/12/2018 12:26:51.794] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [65]	train-error:0.011605
[INFO] [11/12/2018 12:26:51.797] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [66]	train-error:0.011605
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.800] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [67]	train-error:0.011605
[INFO] [11/12/2018 12:26:51.803] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [68]	train-error:0.009671
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.806] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [69]	train-error:0.009671
[INFO] [11/12/2018 12:26:51.809] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [70]	train-error:0.009671
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.814] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [71]	train-error:0.009671
[INFO] [11/12/2018 12:26:51.821] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [72]	train-error:0.007737
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.826] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [73]	train-error:0.005803
[INFO] [11/12/2018 12:26:51.830] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [74]	train-error:0.005803
[INFO] [11/12/2018 12:26:51.834] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [75]	train-error:0.005803
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.839] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [76]	train-error:0.005803
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.843] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [77]	train-error:0.005803
[INFO] [11/12/2018 12:26:51.847] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [78]	train-error:0.005803
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.851] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [79]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.857] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [80]	train-error:0.003868
[INFO] [11/12/2018 12:26:51.860] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [81]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.867] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [82]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.870] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [83]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.879] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [84]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.885] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [85]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.892] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [86]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.896] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [87]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.903] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [88]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.909] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [89]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.914] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [90]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.920] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [91]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.927] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [92]	train-error:0.003868
[INFO] [11/12/2018 12:26:51.931] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [93]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.939] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [94]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.947] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [95]	train-error:0.003868
[INFO] [11/12/2018 12:26:51.950] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [96]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.954] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [97]	train-error:0.003868
[INFO] [11/12/2018 12:26:51.957] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [98]	train-error:0.003868
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:26:51] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:26:51.960] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [99]	train-error:0.003868
[INFO] [11/12/2018 12:26:53.963] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:26:53 INFO MemoryStore: Block rdd_749_0 stored as values in memory (estimated size 584.0 B, free 1995.1 MB)
18/11/12 12:26:53 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:26:53 INFO BlockManagerInfo: Added rdd_749_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 2000.6 MB)
18/11/12 12:26:53 INFO Executor: 1 block locks were not released by TID = 354:
[rdd_749_0]
18/11/12 12:26:53 INFO Executor: Finished task 0.0 in stage 156.0 (TID 354). 3428 bytes result sent to driver
18/11/12 12:26:53 INFO TaskSetManager: Starting task 0.0 in stage 157.0 (TID 355, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:53 INFO TaskSetManager: Finished task 0.0 in stage 156.0 (TID 354) in 2365 ms on localhost (executor driver) (1/1)
18/11/12 12:26:53 INFO Executor: Running task 0.0 in stage 157.0 (TID 355)
18/11/12 12:26:53 INFO TaskSchedulerImpl: Removed TaskSet 156.0, whose tasks have all completed, from pool 
18/11/12 12:26:53 INFO DAGScheduler: ResultStage 156 (foreachPartition at XGBoost.scala:287) finished in 4.705 s
18/11/12 12:26:53 INFO DAGScheduler: Job 115 finished: foreachPartition at XGBoost.scala:287, took 4.708844 s
18/11/12 12:26:53 INFO BlockManager: Found block rdd_741_0 locally
18/11/12 12:26:53 INFO Executor: 1 block locks were not released by TID = 355:
[rdd_741_0]
18/11/12 12:26:53 INFO Executor: Finished task 0.0 in stage 157.0 (TID 355). 106058 bytes result sent to driver
18/11/12 12:26:53 INFO TaskSetManager: Starting task 0.0 in stage 158.0 (TID 356, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:26:53 INFO Executor: Running task 0.0 in stage 158.0 (TID 356)
18/11/12 12:26:53 INFO TaskSetManager: Finished task 0.0 in stage 157.0 (TID 355) in 14 ms on localhost (executor driver) (1/1)
18/11/12 12:26:53 INFO TaskSchedulerImpl: Removed TaskSet 157.0, whose tasks have all completed, from pool 
18/11/12 12:26:53 INFO DAGScheduler: ResultStage 157 (first at XGBoost.scala:352) finished in 2.366 s
18/11/12 12:26:53 INFO DAGScheduler: Job 116 finished: first at XGBoost.scala:352, took 2.367066 s
18/11/12 12:26:53 INFO MapPartitionsRDD: Removing RDD 741 from persistence list
18/11/12 12:26:53 INFO BlockManager: Removing RDD 741
18/11/12 12:26:53 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:26:53 INFO DAGScheduler: Got job 118 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:26:53 INFO DAGScheduler: Final stage: ResultStage 160 (first at XGBoost.scala:352)
18/11/12 12:26:53 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:53 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:53 INFO DAGScheduler: Submitting ResultStage 160 (MapPartitionsRDD[749] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:26:53 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:26:53 INFO Executor: Finished task 0.0 in stage 158.0 (TID 356). 3861 bytes result sent to driver
18/11/12 12:26:53 INFO TaskSetManager: Finished task 0.0 in stage 158.0 (TID 356) in 19 ms on localhost (executor driver) (1/1)
18/11/12 12:26:53 INFO TaskSchedulerImpl: Removed TaskSet 158.0, whose tasks have all completed, from pool 
18/11/12 12:26:53 INFO MemoryStore: Block broadcast_164 stored as values in memory (estimated size 543.8 KB, free 1994.6 MB)
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_164_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1994.4 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_164_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2000.5 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 164 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 160 (MapPartitionsRDD[749] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 160.0 with 1 tasks
18/11/12 12:26:54 INFO DAGScheduler: ShuffleMapStage 158 (take at Classifier.scala:111) finished in 2.366 s
18/11/12 12:26:54 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:26:54 INFO DAGScheduler: running: Set(ResultStage 160)
18/11/12 12:26:54 INFO DAGScheduler: waiting: Set(ResultStage 159)
18/11/12 12:26:54 INFO DAGScheduler: failed: Set()
18/11/12 12:26:54 INFO TaskSetManager: Starting task 0.0 in stage 160.0 (TID 357, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:54 INFO DAGScheduler: Submitting ResultStage 159 (MapPartitionsRDD[758] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:26:54 INFO Executor: Running task 0.0 in stage 160.0 (TID 357)
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_165 stored as values in memory (estimated size 8.2 KB, free 1994.4 MB)
18/11/12 12:26:54 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_165_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1994.4 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_165_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 2000.5 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 165 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 159 (MapPartitionsRDD[758] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 159.0 with 1 tasks
18/11/12 12:26:54 INFO DAGScheduler: Registering RDD 763 (take at Classifier.scala:111)
18/11/12 12:26:54 INFO DAGScheduler: Got job 119 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:26:54 INFO DAGScheduler: Final stage: ResultStage 162 (take at Classifier.scala:111)
18/11/12 12:26:54 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 161)
18/11/12 12:26:54 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 161)
18/11/12 12:26:54 INFO DAGScheduler: Submitting ShuffleMapStage 161 (MapPartitionsRDD[763] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:26:54 INFO BlockManager: Found block rdd_749_0 locally
18/11/12 12:26:54 INFO Executor: 1 block locks were not released by TID = 357:
[rdd_749_0]
18/11/12 12:26:54 INFO Executor: Finished task 0.0 in stage 160.0 (TID 357). 104032 bytes result sent to driver
18/11/12 12:26:54 INFO TaskSetManager: Starting task 0.0 in stage 159.0 (TID 358, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:26:54 INFO Executor: Running task 0.0 in stage 159.0 (TID 358)
18/11/12 12:26:54 INFO TaskSetManager: Finished task 0.0 in stage 160.0 (TID 357) in 11 ms on localhost (executor driver) (1/1)
18/11/12 12:26:54 INFO TaskSchedulerImpl: Removed TaskSet 160.0, whose tasks have all completed, from pool 
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_166 stored as values in memory (estimated size 537.6 KB, free 1993.9 MB)
18/11/12 12:26:54 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:26:54 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:26:54 INFO Executor: Finished task 0.0 in stage 159.0 (TID 358). 1551 bytes result sent to driver
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_166_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1993.7 MB)
18/11/12 12:26:54 INFO TaskSetManager: Finished task 0.0 in stage 159.0 (TID 358) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:26:54 INFO TaskSchedulerImpl: Removed TaskSet 159.0, whose tasks have all completed, from pool 
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_166_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 2000.3 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 166 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 161 (MapPartitionsRDD[763] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 161.0 with 1 tasks
18/11/12 12:26:54 INFO TaskSetManager: Starting task 0.0 in stage 161.0 (TID 359, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:26:54 INFO DAGScheduler: ResultStage 160 (first at XGBoost.scala:352) finished in 0.026 s
18/11/12 12:26:54 INFO DAGScheduler: ResultStage 159 (take at Classifier.scala:111) finished in 0.014 s
18/11/12 12:26:54 INFO DAGScheduler: Job 118 finished: first at XGBoost.scala:352, took 0.026498 s
18/11/12 12:26:54 INFO Executor: Running task 0.0 in stage 161.0 (TID 359)
18/11/12 12:26:54 INFO DAGScheduler: Job 117 finished: take at Classifier.scala:111, took 2.380987 s
18/11/12 12:26:54 INFO MapPartitionsRDD: Removing RDD 749 from persistence list
18/11/12 12:26:54 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_a34ba31e67bb__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:26:54 INFO BlockManager: Removing RDD 749
18/11/12 12:26:54 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:26:54 INFO Executor: Finished task 0.0 in stage 161.0 (TID 359). 3861 bytes result sent to driver
18/11/12 12:26:54 INFO TaskSetManager: Finished task 0.0 in stage 161.0 (TID 359) in 16 ms on localhost (executor driver) (1/1)
18/11/12 12:26:54 INFO TaskSchedulerImpl: Removed TaskSet 161.0, whose tasks have all completed, from pool 
18/11/12 12:26:54 INFO DAGScheduler: ShuffleMapStage 161 (take at Classifier.scala:111) finished in 0.027 s
18/11/12 12:26:54 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:26:54 INFO DAGScheduler: running: Set()
18/11/12 12:26:54 INFO DAGScheduler: waiting: Set(ResultStage 162)
18/11/12 12:26:54 INFO DAGScheduler: failed: Set()
18/11/12 12:26:54 INFO DAGScheduler: Submitting ResultStage 162 (MapPartitionsRDD[767] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_167 stored as values in memory (estimated size 8.2 KB, free 1993.7 MB)
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_167_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1993.7 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_167_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 2000.3 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 167 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 162 (MapPartitionsRDD[767] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 162.0 with 1 tasks
18/11/12 12:26:54 INFO TaskSetManager: Starting task 0.0 in stage 162.0 (TID 360, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:26:54 INFO Executor: Running task 0.0 in stage 162.0 (TID 360)
18/11/12 12:26:54 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:26:54 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:26:54 INFO Executor: Finished task 0.0 in stage 162.0 (TID 360). 1594 bytes result sent to driver
18/11/12 12:26:54 INFO TaskSetManager: Finished task 0.0 in stage 162.0 (TID 360) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:26:54 INFO TaskSchedulerImpl: Removed TaskSet 162.0, whose tasks have all completed, from pool 
18/11/12 12:26:54 INFO DAGScheduler: ResultStage 162 (take at Classifier.scala:111) finished in 0.005 s
18/11/12 12:26:54 INFO DAGScheduler: Job 119 finished: take at Classifier.scala:111, took 0.034813 s
18/11/12 12:26:54 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_450055440f5e__labelCol since numClasses was not specified in the column metadata.
[INFO] [11/12/2018 12:26:54.041] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:38352
[INFO] [11/12/2018 12:26:54.041] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:26:54 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:26:54 INFO DAGScheduler: Registering RDD 779 (take at Classifier.scala:111)
18/11/12 12:26:54 INFO DAGScheduler: Got job 120 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:26:54 INFO DAGScheduler: Final stage: ResultStage 164 (take at Classifier.scala:111)
18/11/12 12:26:54 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 163)
18/11/12 12:26:54 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 163)
18/11/12 12:26:54 INFO DAGScheduler: Submitting ShuffleMapStage 163 (MapPartitionsRDD[779] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:26:54 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_168 stored as values in memory (estimated size 537.6 KB, free 1993.2 MB)
[INFO] [11/12/2018 12:26:54.058] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:47867
[INFO] [11/12/2018 12:26:54.058] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_168_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1993.0 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_168_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 2000.2 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 168 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 163 (MapPartitionsRDD[779] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 163.0 with 1 tasks
18/11/12 12:26:54 INFO TaskSetManager: Starting task 0.0 in stage 163.0 (TID 361, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:26:54 INFO DAGScheduler: Got job 121 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:26:54 INFO DAGScheduler: Final stage: ResultStage 165 (foreachPartition at XGBoost.scala:287)
18/11/12 12:26:54 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:54 INFO Executor: Running task 0.0 in stage 163.0 (TID 361)
18/11/12 12:26:54 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:54 INFO DAGScheduler: Submitting ResultStage 165 (MapPartitionsRDD[784] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:26:54 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:26:54 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_169 stored as values in memory (estimated size 543.8 KB, free 1992.5 MB)
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_169_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1992.4 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_169_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 2000.0 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 169 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO Executor: Finished task 0.0 in stage 163.0 (TID 361). 3861 bytes result sent to driver
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 165 (MapPartitionsRDD[784] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 165.0 with 1 tasks
18/11/12 12:26:54 INFO TaskSetManager: Starting task 0.0 in stage 165.0 (TID 362, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:54 INFO DAGScheduler: Got job 122 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:26:54 INFO TaskSetManager: Finished task 0.0 in stage 163.0 (TID 361) in 18 ms on localhost (executor driver) (1/1)
18/11/12 12:26:54 INFO DAGScheduler: Final stage: ResultStage 166 (foreachPartition at XGBoost.scala:287)
18/11/12 12:26:54 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:54 INFO Executor: Running task 0.0 in stage 165.0 (TID 362)
18/11/12 12:26:54 INFO TaskSchedulerImpl: Removed TaskSet 163.0, whose tasks have all completed, from pool 
18/11/12 12:26:54 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:54 INFO DAGScheduler: Submitting ResultStage 166 (MapPartitionsRDD[792] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:26:54 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_170 stored as values in memory (estimated size 543.8 KB, free 1991.8 MB)
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_170_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1991.7 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_170_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1999.9 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 170 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 166 (MapPartitionsRDD[792] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 166.0 with 1 tasks
18/11/12 12:26:54 INFO DAGScheduler: ShuffleMapStage 163 (take at Classifier.scala:111) finished in 0.044 s
18/11/12 12:26:54 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:26:54 INFO DAGScheduler: running: Set(ResultStage 165, ResultStage 166)
18/11/12 12:26:54 INFO DAGScheduler: waiting: Set(ResultStage 164)
18/11/12 12:26:54 INFO DAGScheduler: failed: Set()
18/11/12 12:26:54 INFO DAGScheduler: Submitting ResultStage 164 (MapPartitionsRDD[783] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_171 stored as values in memory (estimated size 8.2 KB, free 1991.7 MB)
[12:26:54] Tree method is automatically selected to be 'approx' for distributed training.
18/11/12 12:26:54 INFO MemoryStore: Block broadcast_171_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1991.7 MB)
18/11/12 12:26:54 INFO BlockManagerInfo: Added broadcast_171_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1999.9 MB)
18/11/12 12:26:54 INFO SparkContext: Created broadcast 171 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:54 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 164 (MapPartitionsRDD[783] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:54 INFO TaskSchedulerImpl: Adding task set 164.0 with 1 tasks
[INFO] [11/12/2018 12:26:54.088] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:26:54.089] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:26:54.089] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] All workers have started.
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.096] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [0]	train-error:0.104283
[INFO] [11/12/2018 12:26:54.101] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [1]	train-error:0.081937
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 88 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.105] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [2]	train-error:0.074488
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.110] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.065177
[INFO] [11/12/2018 12:26:54.115] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [4]	train-error:0.061453
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 108 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.120] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [5]	train-error:0.055866
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 98 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.124] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.052142
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.128] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [7]	train-error:0.048417
[INFO] [11/12/2018 12:26:54.132] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.039106
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.137] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [9]	train-error:0.037244
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.141] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [10]	train-error:0.029795
[INFO] [11/12/2018 12:26:54.145] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [11]	train-error:0.029795
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.149] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [12]	train-error:0.029795
[INFO] [11/12/2018 12:26:54.152] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [13]	train-error:0.026071
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.155] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [14]	train-error:0.024209
[INFO] [11/12/2018 12:26:54.159] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [15]	train-error:0.022346
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.162] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [16]	train-error:0.018622
[INFO] [11/12/2018 12:26:54.166] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [17]	train-error:0.018622
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.170] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [18]	train-error:0.014898
[INFO] [11/12/2018 12:26:54.174] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [19]	train-error:0.014898
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.179] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [20]	train-error:0.013035
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 94 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.183] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [21]	train-error:0.009311
[INFO] [11/12/2018 12:26:54.188] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [22]	train-error:0.009311
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.195] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.009311
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.199] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [24]	train-error:0.007449
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 98 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.205] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [25]	train-error:0.007449
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.212] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.005587
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.218] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.003724
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 160 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.228] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [28]	train-error:0.001862
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.234] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [29]	train-error:0.001862
[INFO] [11/12/2018 12:26:54.245] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [30]	train-error:0.001862
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 154 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.252] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [31]	train-error:0.001862
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.259] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [32]	train-error:0.001862
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 94 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.266] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [33]	train-error:0.001862
[INFO] [11/12/2018 12:26:54.277] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [34]	train-error:0.001862
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 150 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.286] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [35]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 142 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.298] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [36]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.305] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [37]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.314] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [38]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.323] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [39]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.329] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [40]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.338] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [41]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.344] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [42]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.348] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [43]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.353] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [44]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.359] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [45]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.364] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [46]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 94 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.370] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [47]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.375] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [48]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.379] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [49]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.385] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [50]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.393] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [51]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.401] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [52]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.410] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [53]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 90 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.419] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [54]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.427] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [55]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.435] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [56]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.442] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [57]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.450] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [58]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.458] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [59]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.466] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [60]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.474] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [61]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.481] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [62]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.490] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [63]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.497] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [64]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.505] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [65]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.513] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [66]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.520] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [67]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.530] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [68]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.536] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [69]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 88 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 88 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.542] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [70]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 94 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.548] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [71]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.552] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [72]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.558] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [73]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 98 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.563] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [74]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.568] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.573] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 114 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.577] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.581] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 164 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.593] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 108 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.600] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.611] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.619] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.628] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.639] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.647] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.659] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.671] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.679] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.690] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 122 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.698] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.707] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.713] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.718] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 146 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.725] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.729] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[INFO] [11/12/2018 12:26:54.734] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 140 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.740] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.745] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[12:26:54] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:54.751] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
18/11/12 12:26:56 INFO MemoryStore: Block rdd_784_0 stored as values in memory (estimated size 584.0 B, free 1991.7 MB)
18/11/12 12:26:56 INFO BlockManagerInfo: Added rdd_784_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1999.9 MB)
18/11/12 12:26:56 INFO Executor: 1 block locks were not released by TID = 362:
[rdd_784_0]
18/11/12 12:26:56 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:26:56 INFO Executor: Finished task 0.0 in stage 165.0 (TID 362). 3428 bytes result sent to driver
18/11/12 12:26:56 INFO TaskSetManager: Starting task 0.0 in stage 164.0 (TID 363, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:26:56 INFO TaskSetManager: Finished task 0.0 in stage 165.0 (TID 362) in 2681 ms on localhost (executor driver) (1/1)
18/11/12 12:26:56 INFO Executor: Running task 0.0 in stage 164.0 (TID 363)
18/11/12 12:26:56 INFO TaskSchedulerImpl: Removed TaskSet 165.0, whose tasks have all completed, from pool 
18/11/12 12:26:56 INFO DAGScheduler: ResultStage 165 (foreachPartition at XGBoost.scala:287) finished in 2.698 s
18/11/12 12:26:56 INFO DAGScheduler: Job 121 finished: foreachPartition at XGBoost.scala:287, took 2.709107 s
[INFO] [11/12/2018 12:26:56.754] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:26:56 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:26:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:26:56 INFO Executor: Finished task 0.0 in stage 164.0 (TID 363). 1594 bytes result sent to driver
18/11/12 12:26:56 INFO TaskSetManager: Starting task 0.0 in stage 166.0 (TID 364, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:56 INFO TaskSetManager: Finished task 0.0 in stage 164.0 (TID 363) in 8 ms on localhost (executor driver) (1/1)
18/11/12 12:26:56 INFO Executor: Running task 0.0 in stage 166.0 (TID 364)
18/11/12 12:26:56 INFO TaskSchedulerImpl: Removed TaskSet 164.0, whose tasks have all completed, from pool 
18/11/12 12:26:56 INFO DAGScheduler: ResultStage 164 (take at Classifier.scala:111) finished in 2.674 s
18/11/12 12:26:56 INFO DAGScheduler: Job 120 finished: take at Classifier.scala:111, took 2.721038 s
18/11/12 12:26:56 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_2afaee8e4dca__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:26:56 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:26:56.783] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[12:26:56] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:26:56.784] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:26:56.785] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] All workers have started.
[INFO] [11/12/2018 12:26:56.792] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [0]	train-error:0.111511
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:26:56 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:26:56 INFO DAGScheduler: Got job 123 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:26:56 INFO DAGScheduler: Final stage: ResultStage 167 (first at XGBoost.scala:352)
18/11/12 12:26:56 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:56 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:56 INFO DAGScheduler: Submitting ResultStage 167 (MapPartitionsRDD[784] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:26:56.795] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:38407
[INFO] [11/12/2018 12:26:56.795] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:26:56.800] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [1]	train-error:0.073741
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 94 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:26:56 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 98 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:26:56 INFO MemoryStore: Block broadcast_172 stored as values in memory (estimated size 543.8 KB, free 1991.1 MB)
18/11/12 12:26:56 INFO MemoryStore: Block broadcast_172_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1991.0 MB)
[INFO] [11/12/2018 12:26:56.806] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [2]	train-error:0.064748
18/11/12 12:26:56 INFO BlockManagerInfo: Added broadcast_172_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.7 MB)
18/11/12 12:26:56 INFO SparkContext: Created broadcast 172 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:56 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 167 (MapPartitionsRDD[784] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:56 INFO TaskSchedulerImpl: Adding task set 167.0 with 1 tasks
18/11/12 12:26:56 INFO DAGScheduler: Got job 124 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:26:56 INFO DAGScheduler: Final stage: ResultStage 168 (foreachPartition at XGBoost.scala:287)
18/11/12 12:26:56 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:56 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:56 INFO DAGScheduler: Submitting ResultStage 168 (MapPartitionsRDD[800] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:26:56.812] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.068345
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 96 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.818] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [4]	train-error:0.062950
18/11/12 12:26:56 INFO MemoryStore: Block broadcast_173 stored as values in memory (estimated size 543.8 KB, free 1990.5 MB)
18/11/12 12:26:56 INFO MemoryStore: Block broadcast_173_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1990.3 MB)
18/11/12 12:26:56 INFO BlockManagerInfo: Added broadcast_173_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.6 MB)
18/11/12 12:26:56 INFO SparkContext: Created broadcast 173 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:56 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 168 (MapPartitionsRDD[800] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:56 INFO TaskSchedulerImpl: Adding task set 168.0 with 1 tasks
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 112 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.823] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [5]	train-error:0.044964
[INFO] [11/12/2018 12:26:56.829] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.035971
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.834] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [7]	train-error:0.026978
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 124 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 120 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.839] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [8]	train-error:0.025180
[INFO] [11/12/2018 12:26:56.843] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [9]	train-error:0.019784
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.846] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [10]	train-error:0.016187
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 96 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.849] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [11]	train-error:0.016187
[INFO] [11/12/2018 12:26:56.853] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [12]	train-error:0.014388
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.857] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [13]	train-error:0.012590
[INFO] [11/12/2018 12:26:56.862] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [14]	train-error:0.003597
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 150 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.866] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [15]	train-error:0.003597
[INFO] [11/12/2018 12:26:56.869] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [16]	train-error:0.003597
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.873] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [17]	train-error:0.003597
[INFO] [11/12/2018 12:26:56.877] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [18]	train-error:0.001799
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 98 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.881] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [19]	train-error:0.001799
[INFO] [11/12/2018 12:26:56.885] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [20]	train-error:0.001799
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.889] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [21]	train-error:0.001799
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.892] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [22]	train-error:0.001799
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.896] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [23]	train-error:0.001799
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.901] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [24]	train-error:0.001799
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.909] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [25]	train-error:0.000000
[INFO] [11/12/2018 12:26:56.915] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [26]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.921] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [27]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 126 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.928] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [28]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.934] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [29]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.938] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [30]	train-error:0.000000
[INFO] [11/12/2018 12:26:56.942] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [31]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.946] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [32]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 106 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.952] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [33]	train-error:0.000000
[INFO] [11/12/2018 12:26:56.956] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [34]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 110 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.961] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [35]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.966] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [36]	train-error:0.000000
[INFO] [11/12/2018 12:26:56.971] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [37]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.977] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [38]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.983] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [39]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.989] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [40]	train-error:0.000000
[12:26:56] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:56.997] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [41]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.005] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [42]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.014] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [43]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.020] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [44]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.028] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [45]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.036] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [46]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.045] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [47]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.054] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [48]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.059] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [49]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.067] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [50]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.074] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [51]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.081] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [52]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.089] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [53]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.096] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [54]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 90 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.107] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [55]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.111] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [56]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.117] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [57]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 96 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.123] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [58]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.127] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [59]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.132] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [60]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.136] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [61]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 104 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.142] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [62]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.147] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [63]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.151] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [64]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.155] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [65]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.159] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [66]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.162] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [67]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.167] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [68]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.171] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [69]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 138 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.179] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [70]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.185] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [71]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.191] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.200] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [73]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.205] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [74]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 140 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.217] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 108 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.225] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.235] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 106 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.247] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.253] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.263] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 98 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.273] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 88 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.286] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 94 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.297] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.306] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.315] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.320] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.326] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 88 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.331] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.335] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.340] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 166 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.348] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.353] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.358] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.362] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.366] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.371] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.376] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[INFO] [11/12/2018 12:26:57.385] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:26:57] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:57.395] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.398] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:26:59 INFO MemoryStore: Block rdd_792_0 stored as values in memory (estimated size 584.0 B, free 1990.3 MB)
18/11/12 12:26:59 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:26:59 INFO BlockManagerInfo: Added rdd_792_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1999.6 MB)
18/11/12 12:26:59 INFO Executor: 1 block locks were not released by TID = 364:
[rdd_792_0]
18/11/12 12:26:59 INFO Executor: Finished task 0.0 in stage 166.0 (TID 364). 3428 bytes result sent to driver
18/11/12 12:26:59 INFO TaskSetManager: Starting task 0.0 in stage 167.0 (TID 365, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:59 INFO TaskSetManager: Finished task 0.0 in stage 166.0 (TID 364) in 2637 ms on localhost (executor driver) (1/1)
18/11/12 12:26:59 INFO Executor: Running task 0.0 in stage 167.0 (TID 365)
18/11/12 12:26:59 INFO TaskSchedulerImpl: Removed TaskSet 166.0, whose tasks have all completed, from pool 
18/11/12 12:26:59 INFO DAGScheduler: ResultStage 166 (foreachPartition at XGBoost.scala:287) finished in 5.325 s
18/11/12 12:26:59 INFO DAGScheduler: Job 122 finished: foreachPartition at XGBoost.scala:287, took 5.332631 s
18/11/12 12:26:59 INFO BlockManager: Found block rdd_784_0 locally
18/11/12 12:26:59 INFO Executor: 1 block locks were not released by TID = 365:
[rdd_784_0]
18/11/12 12:26:59 INFO Executor: Finished task 0.0 in stage 167.0 (TID 365). 302421 bytes result sent to driver
18/11/12 12:26:59 INFO TaskSetManager: Starting task 0.0 in stage 168.0 (TID 366, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:26:59 INFO Executor: Running task 0.0 in stage 168.0 (TID 366)
18/11/12 12:26:59 INFO TaskSetManager: Finished task 0.0 in stage 167.0 (TID 365) in 15 ms on localhost (executor driver) (1/1)
18/11/12 12:26:59 INFO TaskSchedulerImpl: Removed TaskSet 167.0, whose tasks have all completed, from pool 
18/11/12 12:26:59 INFO DAGScheduler: ResultStage 167 (first at XGBoost.scala:352) finished in 2.620 s
18/11/12 12:26:59 INFO DAGScheduler: Job 123 finished: first at XGBoost.scala:352, took 2.621286 s
18/11/12 12:26:59 INFO MapPartitionsRDD: Removing RDD 784 from persistence list
18/11/12 12:26:59 INFO BlockManager: Removing RDD 784
18/11/12 12:26:59 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:26:59 INFO DAGScheduler: Got job 125 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:26:59 INFO DAGScheduler: Final stage: ResultStage 169 (first at XGBoost.scala:352)
18/11/12 12:26:59 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:26:59 INFO DAGScheduler: Missing parents: List()
18/11/12 12:26:59 INFO DAGScheduler: Submitting ResultStage 169 (MapPartitionsRDD[792] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:26:59 INFO BlockManager: Found block rdd_184_0 locally
[INFO] [11/12/2018 12:26:59.438] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[12:26:59] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:26:59.438] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:26:59.439] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] All workers have started.
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:26:59 INFO MemoryStore: Block broadcast_174 stored as values in memory (estimated size 543.8 KB, free 1989.8 MB)
18/11/12 12:26:59 INFO MemoryStore: Block broadcast_174_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1989.6 MB)
18/11/12 12:26:59 INFO BlockManagerInfo: Added broadcast_174_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.4 MB)
18/11/12 12:26:59 INFO SparkContext: Created broadcast 174 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:59 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 169 (MapPartitionsRDD[792] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:59 INFO TaskSchedulerImpl: Adding task set 169.0 with 1 tasks
18/11/12 12:26:59 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:26:59 INFO DAGScheduler: Registering RDD 805 (take at Classifier.scala:111)
18/11/12 12:26:59 INFO DAGScheduler: Got job 126 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:26:59 INFO DAGScheduler: Final stage: ResultStage 171 (take at Classifier.scala:111)
18/11/12 12:26:59 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 170)
18/11/12 12:26:59 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 170)
18/11/12 12:26:59 INFO DAGScheduler: Submitting ShuffleMapStage 170 (MapPartitionsRDD[805] at take at Classifier.scala:111), which has no missing parents
[INFO] [11/12/2018 12:26:59.447] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [0]	train-error:0.112186
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.453] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [1]	train-error:0.094778
[INFO] [11/12/2018 12:26:59.459] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [2]	train-error:0.090909
18/11/12 12:26:59 INFO MemoryStore: Block broadcast_175 stored as values in memory (estimated size 537.6 KB, free 1989.1 MB)
18/11/12 12:26:59 INFO MemoryStore: Block broadcast_175_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1989.0 MB)
18/11/12 12:26:59 INFO BlockManagerInfo: Added broadcast_175_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1999.3 MB)
18/11/12 12:26:59 INFO SparkContext: Created broadcast 175 from broadcast at DAGScheduler.scala:1039
18/11/12 12:26:59 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 170 (MapPartitionsRDD[805] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:26:59 INFO TaskSchedulerImpl: Adding task set 170.0 with 1 tasks
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 90 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.465] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [3]	train-error:0.077369
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 110 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:26:59.471] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [4]	train-error:0.067698
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 108 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.476] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [5]	train-error:0.058027
[INFO] [11/12/2018 12:26:59.481] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [6]	train-error:0.050290
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.486] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [7]	train-error:0.046422
[INFO] [11/12/2018 12:26:59.490] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [8]	train-error:0.034816
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 92 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.494] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [9]	train-error:0.025145
[INFO] [11/12/2018 12:26:59.497] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [10]	train-error:0.036750
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.500] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [11]	train-error:0.030948
[INFO] [11/12/2018 12:26:59.503] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [12]	train-error:0.021277
[INFO] [11/12/2018 12:26:59.507] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [13]	train-error:0.017408
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.510] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [14]	train-error:0.015474
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.513] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [15]	train-error:0.013540
[INFO] [11/12/2018 12:26:59.517] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [16]	train-error:0.011605
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.521] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [17]	train-error:0.009671
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.524] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [18]	train-error:0.009671
[INFO] [11/12/2018 12:26:59.528] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.009671
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.531] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [20]	train-error:0.009671
[INFO] [11/12/2018 12:26:59.534] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [21]	train-error:0.007737
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 112 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.538] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [22]	train-error:0.005803
[INFO] [11/12/2018 12:26:59.542] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [23]	train-error:0.003868
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.545] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [24]	train-error:0.003868
[INFO] [11/12/2018 12:26:59.549] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [25]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.553] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [26]	train-error:0.001934
[INFO] [11/12/2018 12:26:59.557] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [27]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.560] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [28]	train-error:0.001934
[INFO] [11/12/2018 12:26:59.565] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [29]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 104 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.568] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30]	train-error:0.001934
[INFO] [11/12/2018 12:26:59.572] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [31]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.575] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [32]	train-error:0.001934
[INFO] [11/12/2018 12:26:59.578] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [33]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.582] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [34]	train-error:0.001934
[INFO] [11/12/2018 12:26:59.586] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [35]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.589] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [36]	train-error:0.001934
[INFO] [11/12/2018 12:26:59.593] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [37]	train-error:0.001934
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.597] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [38]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.600] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [39]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.604] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [40]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.608] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [41]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 112 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.612] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [42]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.616] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [43]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.620] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [44]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 130 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.627] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [45]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 108 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.633] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [46]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 104 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.639] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [47]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.645] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [48]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.652] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [49]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 90 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 122 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.660] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [50]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.667] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [51]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.673] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [52]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.679] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [53]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.685] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [54]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.694] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [55]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.701] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [56]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 106 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.707] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [57]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.715] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [58]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.722] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [59]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.728] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [60]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.736] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [61]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.741] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [62]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 104 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.749] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [63]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.757] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [64]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 96 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.766] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [65]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.771] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [66]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.776] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [67]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.782] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [68]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 96 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.788] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [69]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 100 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.794] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [70]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.798] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [71]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.803] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 128 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.809] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [73]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.814] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [74]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 126 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.824] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 104 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.832] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.837] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.845] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 96 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.854] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.862] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 88 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.871] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.877] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.886] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 90 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.894] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.905] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.917] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 134 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 110 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.929] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.937] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.947] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.957] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 102 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 122 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.969] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.973] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.978] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.982] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[INFO] [11/12/2018 12:26:59.988] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.992] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:26:59] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:26:59.997] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[INFO] [11/12/2018 12:27:00.001] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[12:27:00] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:00.006] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
[12:27:00] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:27:02 INFO MemoryStore: Block rdd_800_0 stored as values in memory (estimated size 584.0 B, free 1989.0 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added rdd_800_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1999.3 MB)
18/11/12 12:27:02 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:02 INFO Executor: 1 block locks were not released by TID = 366:
[rdd_800_0]
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 168.0 (TID 366). 3428 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 169.0 (TID 367, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 168.0 (TID 366) in 2600 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 169.0 (TID 367)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 168.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO DAGScheduler: ResultStage 168 (foreachPartition at XGBoost.scala:287) finished in 5.203 s
18/11/12 12:27:02 INFO DAGScheduler: Job 124 finished: foreachPartition at XGBoost.scala:287, took 5.208226 s
[INFO] [11/12/2018 12:27:02.011] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:02 INFO BlockManager: Found block rdd_792_0 locally
18/11/12 12:27:02 INFO Executor: 1 block locks were not released by TID = 367:
[rdd_792_0]
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 169.0 (TID 367). 277922 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 170.0 (TID 368, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 170.0 (TID 368)
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 169.0 (TID 367) in 13 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 169.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO DAGScheduler: ResultStage 169 (first at XGBoost.scala:352) finished in 2.592 s
18/11/12 12:27:02 INFO DAGScheduler: Job 125 finished: first at XGBoost.scala:352, took 2.594397 s
18/11/12 12:27:02 INFO MapPartitionsRDD: Removing RDD 792 from persistence list
18/11/12 12:27:02 INFO BlockManager: Removing RDD 792
18/11/12 12:27:02 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:02 INFO DAGScheduler: Got job 127 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:02 INFO DAGScheduler: Final stage: ResultStage 172 (first at XGBoost.scala:352)
18/11/12 12:27:02 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:02 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:02 INFO DAGScheduler: Submitting ResultStage 172 (MapPartitionsRDD[800] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:02 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 170.0 (TID 368). 3861 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 170.0 (TID 368) in 18 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 170.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_176 stored as values in memory (estimated size 543.8 KB, free 1988.4 MB)
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_176_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1988.3 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_176_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.1 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 176 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 172 (MapPartitionsRDD[800] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 172.0 with 1 tasks
18/11/12 12:27:02 INFO DAGScheduler: ShuffleMapStage 170 (take at Classifier.scala:111) finished in 2.597 s
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 172.0 (TID 369, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:02 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:02 INFO DAGScheduler: running: Set(ResultStage 172)
18/11/12 12:27:02 INFO DAGScheduler: waiting: Set(ResultStage 171)
18/11/12 12:27:02 INFO DAGScheduler: failed: Set()
18/11/12 12:27:02 INFO DAGScheduler: Submitting ResultStage 171 (MapPartitionsRDD[809] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 172.0 (TID 369)
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_177 stored as values in memory (estimated size 8.2 KB, free 1988.3 MB)
18/11/12 12:27:02 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_177_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1988.3 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_177_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1999.1 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 177 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 171 (MapPartitionsRDD[809] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 171.0 with 1 tasks
18/11/12 12:27:02 INFO DAGScheduler: Registering RDD 814 (take at Classifier.scala:111)
18/11/12 12:27:02 INFO DAGScheduler: Got job 128 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:02 INFO DAGScheduler: Final stage: ResultStage 174 (take at Classifier.scala:111)
18/11/12 12:27:02 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 173)
18/11/12 12:27:02 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 173)
18/11/12 12:27:02 INFO DAGScheduler: Submitting ShuffleMapStage 173 (MapPartitionsRDD[814] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:02 INFO BlockManager: Found block rdd_800_0 locally
18/11/12 12:27:02 INFO Executor: 1 block locks were not released by TID = 369:
[rdd_800_0]
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 172.0 (TID 369). 280092 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 171.0 (TID 370, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 171.0 (TID 370)
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 172.0 (TID 369) in 11 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 172.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:02 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_178 stored as values in memory (estimated size 537.6 KB, free 1987.7 MB)
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 171.0 (TID 370). 1551 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 171.0 (TID 370) in 2 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 171.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_178_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1987.6 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_178_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1999.0 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 178 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 173 (MapPartitionsRDD[814] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 173.0 with 1 tasks
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 173.0 (TID 371, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 173.0 (TID 371)
18/11/12 12:27:02 INFO DAGScheduler: ResultStage 172 (first at XGBoost.scala:352) finished in 0.029 s
18/11/12 12:27:02 INFO DAGScheduler: ResultStage 171 (take at Classifier.scala:111) finished in 0.016 s
18/11/12 12:27:02 INFO DAGScheduler: Job 127 finished: first at XGBoost.scala:352, took 0.029616 s
18/11/12 12:27:02 INFO MapPartitionsRDD: Removing RDD 800 from persistence list
18/11/12 12:27:02 INFO DAGScheduler: Job 126 finished: take at Classifier.scala:111, took 2.613993 s
18/11/12 12:27:02 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_f19c80b8ff3a__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:02 INFO BlockManager: Removing RDD 800
18/11/12 12:27:02 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 173.0 (TID 371). 3861 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 173.0 (TID 371) in 16 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 173.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO DAGScheduler: ShuffleMapStage 173 (take at Classifier.scala:111) finished in 0.029 s
18/11/12 12:27:02 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:02 INFO DAGScheduler: running: Set()
18/11/12 12:27:02 INFO DAGScheduler: waiting: Set(ResultStage 174)
18/11/12 12:27:02 INFO DAGScheduler: failed: Set()
18/11/12 12:27:02 INFO DAGScheduler: Submitting ResultStage 174 (MapPartitionsRDD[818] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_179 stored as values in memory (estimated size 8.2 KB, free 1987.6 MB)
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_179_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1987.6 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_179_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1999.0 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 179 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 174 (MapPartitionsRDD[818] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 174.0 with 1 tasks
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 174.0 (TID 372, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 174.0 (TID 372)
18/11/12 12:27:02 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:02 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 174.0 (TID 372). 1551 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 174.0 (TID 372) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 174.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO DAGScheduler: ResultStage 174 (take at Classifier.scala:111) finished in 0.006 s
18/11/12 12:27:02 INFO DAGScheduler: Job 128 finished: take at Classifier.scala:111, took 0.036809 s
18/11/12 12:27:02 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_90dac7a23586__labelCol since numClasses was not specified in the column metadata.
[INFO] [11/12/2018 12:27:02.091] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:47278
[INFO] [11/12/2018 12:27:02.091] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:02 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:02 INFO DAGScheduler: Registering RDD 830 (take at Classifier.scala:111)
18/11/12 12:27:02 INFO DAGScheduler: Got job 129 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:02 INFO DAGScheduler: Final stage: ResultStage 176 (take at Classifier.scala:111)
18/11/12 12:27:02 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 175)
18/11/12 12:27:02 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 175)
18/11/12 12:27:02 INFO DAGScheduler: Submitting ShuffleMapStage 175 (MapPartitionsRDD[830] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:02 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_180 stored as values in memory (estimated size 537.6 KB, free 1987.0 MB)
[INFO] [11/12/2018 12:27:02.108] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:58953
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_180_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1986.9 MB)
[INFO] [11/12/2018 12:27:02.108] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_180_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1998.8 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 180 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 175 (MapPartitionsRDD[830] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 175.0 with 1 tasks
18/11/12 12:27:02 INFO DAGScheduler: Got job 130 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 175.0 (TID 373, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:02 INFO DAGScheduler: Final stage: ResultStage 177 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:02 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 175.0 (TID 373)
18/11/12 12:27:02 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:02 INFO DAGScheduler: Submitting ResultStage 177 (MapPartitionsRDD[835] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:02 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:02 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_181 stored as values in memory (estimated size 543.8 KB, free 1986.4 MB)
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_181_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1986.2 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_181_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1998.7 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 181 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 177 (MapPartitionsRDD[835] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 177.0 with 1 tasks
18/11/12 12:27:02 INFO DAGScheduler: Got job 131 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:02 INFO DAGScheduler: Final stage: ResultStage 178 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:02 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:02 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:02 INFO DAGScheduler: Submitting ResultStage 178 (MapPartitionsRDD[843] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:02 INFO Executor: Finished task 0.0 in stage 175.0 (TID 373). 3861 bytes result sent to driver
18/11/12 12:27:02 INFO TaskSetManager: Starting task 0.0 in stage 177.0 (TID 374, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:02 INFO Executor: Running task 0.0 in stage 177.0 (TID 374)
18/11/12 12:27:02 INFO TaskSetManager: Finished task 0.0 in stage 175.0 (TID 373) in 20 ms on localhost (executor driver) (1/1)
18/11/12 12:27:02 INFO TaskSchedulerImpl: Removed TaskSet 175.0, whose tasks have all completed, from pool 
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_182 stored as values in memory (estimated size 543.8 KB, free 1985.7 MB)
18/11/12 12:27:02 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_182_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1985.5 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_182_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.5 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 182 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 178 (MapPartitionsRDD[843] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 178.0 with 1 tasks
18/11/12 12:27:02 INFO DAGScheduler: ShuffleMapStage 175 (take at Classifier.scala:111) finished in 0.044 s
18/11/12 12:27:02 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:02 INFO DAGScheduler: running: Set(ResultStage 177, ResultStage 178)
18/11/12 12:27:02 INFO DAGScheduler: waiting: Set(ResultStage 176)
18/11/12 12:27:02 INFO DAGScheduler: failed: Set()
18/11/12 12:27:02 INFO DAGScheduler: Submitting ResultStage 176 (MapPartitionsRDD[834] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_183 stored as values in memory (estimated size 8.2 KB, free 1985.5 MB)
18/11/12 12:27:02 INFO MemoryStore: Block broadcast_183_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1985.5 MB)
18/11/12 12:27:02 INFO BlockManagerInfo: Added broadcast_183_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1998.5 MB)
18/11/12 12:27:02 INFO SparkContext: Created broadcast 183 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:02 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 176 (MapPartitionsRDD[834] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:02 INFO TaskSchedulerImpl: Adding task set 176.0 with 1 tasks
[INFO] [11/12/2018 12:27:02.143] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:02.144] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:02.144] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:02] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.148] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [0]	train-error:0.175047
[INFO] [11/12/2018 12:27:02.150] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [1]	train-error:0.175047
[INFO] [11/12/2018 12:27:02.152] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [2]	train-error:0.175047
[INFO] [11/12/2018 12:27:02.154] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [3]	train-error:0.175047
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.156] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [4]	train-error:0.169460
[INFO] [11/12/2018 12:27:02.158] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [5]	train-error:0.171322
[INFO] [11/12/2018 12:27:02.161] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [6]	train-error:0.163873
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.163] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [7]	train-error:0.165736
[INFO] [11/12/2018 12:27:02.165] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.160149
[INFO] [11/12/2018 12:27:02.167] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [9]	train-error:0.160149
[INFO] [11/12/2018 12:27:02.169] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [10]	train-error:0.162011
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.171] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [11]	train-error:0.150838
[INFO] [11/12/2018 12:27:02.173] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [12]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.175] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [13]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.178] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [14]	train-error:0.150838
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.180] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [15]	train-error:0.150838
[INFO] [11/12/2018 12:27:02.182] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [16]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.183] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [17]	train-error:0.148976
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.185] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [18]	train-error:0.148976
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.187] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [19]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.189] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [20]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.191] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [21]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.193] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [22]	train-error:0.148976
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.195] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [23]	train-error:0.148976
[INFO] [11/12/2018 12:27:02.197] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [24]	train-error:0.147114
[INFO] [11/12/2018 12:27:02.199] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [25]	train-error:0.145251
[INFO] [11/12/2018 12:27:02.201] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.147114
[INFO] [11/12/2018 12:27:02.202] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [27]	train-error:0.147114
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.204] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [28]	train-error:0.147114
[INFO] [11/12/2018 12:27:02.206] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [29]	train-error:0.147114
[INFO] [11/12/2018 12:27:02.208] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30]	train-error:0.145251
[INFO] [11/12/2018 12:27:02.211] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [31]	train-error:0.135940
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.213] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [32]	train-error:0.134078
[INFO] [11/12/2018 12:27:02.215] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [33]	train-error:0.130354
[INFO] [11/12/2018 12:27:02.216] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [34]	train-error:0.134078
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.219] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [35]	train-error:0.134078
[INFO] [11/12/2018 12:27:02.221] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [36]	train-error:0.132216
[INFO] [11/12/2018 12:27:02.223] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [37]	train-error:0.130354
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.225] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [38]	train-error:0.132216
[INFO] [11/12/2018 12:27:02.227] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [39]	train-error:0.130354
[INFO] [11/12/2018 12:27:02.229] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [40]	train-error:0.130354
[INFO] [11/12/2018 12:27:02.231] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [41]	train-error:0.130354
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.234] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [42]	train-error:0.130354
[INFO] [11/12/2018 12:27:02.236] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [43]	train-error:0.130354
[INFO] [11/12/2018 12:27:02.239] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [44]	train-error:0.128492
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.243] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.126629
[INFO] [11/12/2018 12:27:02.248] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [46]	train-error:0.126629
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.251] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [47]	train-error:0.124767
[INFO] [11/12/2018 12:27:02.254] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [48]	train-error:0.124767
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.259] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [49]	train-error:0.121043
[INFO] [11/12/2018 12:27:02.262] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [50]	train-error:0.121043
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.265] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [51]	train-error:0.121043
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.270] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [52]	train-error:0.119181
[INFO] [11/12/2018 12:27:02.273] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [53]	train-error:0.117318
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.277] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [54]	train-error:0.117318
[INFO] [11/12/2018 12:27:02.283] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [55]	train-error:0.117318
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.286] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [56]	train-error:0.117318
[INFO] [11/12/2018 12:27:02.291] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [57]	train-error:0.115456
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.295] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [58]	train-error:0.115456
[INFO] [11/12/2018 12:27:02.299] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [59]	train-error:0.113594
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.304] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [60]	train-error:0.115456
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.308] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [61]	train-error:0.109870
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.315] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [62]	train-error:0.109870
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.322] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [63]	train-error:0.109870
[INFO] [11/12/2018 12:27:02.328] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [64]	train-error:0.109870
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.332] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [65]	train-error:0.109870
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.337] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [66]	train-error:0.108007
[INFO] [11/12/2018 12:27:02.342] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [67]	train-error:0.108007
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.348] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [68]	train-error:0.106145
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.352] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [69]	train-error:0.104283
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.357] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [70]	train-error:0.106145
[INFO] [11/12/2018 12:27:02.362] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [71]	train-error:0.104283
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.367] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.104283
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.372] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [73]	train-error:0.100559
[INFO] [11/12/2018 12:27:02.376] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [74]	train-error:0.100559
[INFO] [11/12/2018 12:27:02.379] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [75]	train-error:0.100559
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.382] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [76]	train-error:0.098696
[INFO] [11/12/2018 12:27:02.384] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [77]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.387] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [78]	train-error:0.098696
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.390] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [79]	train-error:0.098696
[INFO] [11/12/2018 12:27:02.392] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [80]	train-error:0.098696
[INFO] [11/12/2018 12:27:02.395] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.098696
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.397] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [82]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.399] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [83]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.401] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [84]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.403] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [85]	train-error:0.096834
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.406] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [86]	train-error:0.098696
[INFO] [11/12/2018 12:27:02.408] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [87]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.410] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [88]	train-error:0.096834
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.412] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [89]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.415] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [90]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.417] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [91]	train-error:0.096834
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.419] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [92]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.421] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [93]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.424] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [94]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.426] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [95]	train-error:0.096834
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.428] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [96]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.431] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [97]	train-error:0.096834
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:02] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:02.433] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [98]	train-error:0.096834
[INFO] [11/12/2018 12:27:02.436] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [99]	train-error:0.096834
[INFO] [11/12/2018 12:27:04.439] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:04 INFO MemoryStore: Block rdd_835_0 stored as values in memory (estimated size 584.0 B, free 1985.5 MB)
18/11/12 12:27:04 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:04 INFO BlockManagerInfo: Added rdd_835_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1998.5 MB)
18/11/12 12:27:04 INFO Executor: 1 block locks were not released by TID = 374:
[rdd_835_0]
18/11/12 12:27:04 INFO Executor: Finished task 0.0 in stage 177.0 (TID 374). 3428 bytes result sent to driver
18/11/12 12:27:04 INFO TaskSetManager: Starting task 0.0 in stage 176.0 (TID 375, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:04 INFO TaskSetManager: Finished task 0.0 in stage 177.0 (TID 374) in 2312 ms on localhost (executor driver) (1/1)
18/11/12 12:27:04 INFO Executor: Running task 0.0 in stage 176.0 (TID 375)
18/11/12 12:27:04 INFO TaskSchedulerImpl: Removed TaskSet 177.0, whose tasks have all completed, from pool 
18/11/12 12:27:04 INFO DAGScheduler: ResultStage 177 (foreachPartition at XGBoost.scala:287) finished in 2.331 s
18/11/12 12:27:04 INFO DAGScheduler: Job 130 finished: foreachPartition at XGBoost.scala:287, took 2.341600 s
18/11/12 12:27:04 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:04 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:04 INFO Executor: Finished task 0.0 in stage 176.0 (TID 375). 1551 bytes result sent to driver
18/11/12 12:27:04 INFO TaskSetManager: Starting task 0.0 in stage 178.0 (TID 376, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:04 INFO TaskSetManager: Finished task 0.0 in stage 176.0 (TID 375) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:04 INFO TaskSchedulerImpl: Removed TaskSet 176.0, whose tasks have all completed, from pool 
18/11/12 12:27:04 INFO DAGScheduler: ResultStage 176 (take at Classifier.scala:111) finished in 2.303 s
18/11/12 12:27:04 INFO Executor: Running task 0.0 in stage 178.0 (TID 376)
18/11/12 12:27:04 INFO DAGScheduler: Job 129 finished: take at Classifier.scala:111, took 2.350201 s
18/11/12 12:27:04 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_094130b28ff5__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:04 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:27:04.479] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:04.481] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:04.481] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:04] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.487] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [0]	train-error:0.169065
18/11/12 12:27:04 INFO SparkContext: Starting job: first at XGBoost.scala:352
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:04 INFO DAGScheduler: Got job 132 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:04 INFO DAGScheduler: Final stage: ResultStage 179 (first at XGBoost.scala:352)
18/11/12 12:27:04 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:04 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:04 INFO DAGScheduler: Submitting ResultStage 179 (MapPartitionsRDD[835] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.490] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [1]	train-error:0.163669
[INFO] [11/12/2018 12:27:04.494] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [2]	train-error:0.156475
[INFO] [11/12/2018 12:27:04.495] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:42141
[INFO] [11/12/2018 12:27:04.495] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:27:04.497] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.154676
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.499] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [4]	train-error:0.149281
[INFO] [11/12/2018 12:27:04.502] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [5]	train-error:0.145683
[INFO] [11/12/2018 12:27:04.505] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [6]	train-error:0.151079
18/11/12 12:27:04 INFO MemoryStore: Block broadcast_184 stored as values in memory (estimated size 543.8 KB, free 1985.0 MB)
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:04 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:04 INFO MemoryStore: Block broadcast_184_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1984.8 MB)
18/11/12 12:27:04 INFO BlockManagerInfo: Added broadcast_184_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1998.4 MB)
18/11/12 12:27:04 INFO SparkContext: Created broadcast 184 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:04 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 179 (MapPartitionsRDD[835] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:04 INFO TaskSchedulerImpl: Adding task set 179.0 with 1 tasks
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:04 INFO DAGScheduler: Got job 133 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:04 INFO DAGScheduler: Final stage: ResultStage 180 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:04 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:04 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:04 INFO DAGScheduler: Submitting ResultStage 180 (MapPartitionsRDD[851] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:04.508] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [7]	train-error:0.147482
[INFO] [11/12/2018 12:27:04.510] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [8]	train-error:0.145683
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.513] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [9]	train-error:0.145683
[INFO] [11/12/2018 12:27:04.515] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [10]	train-error:0.145683
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:04 INFO MemoryStore: Block broadcast_185 stored as values in memory (estimated size 543.8 KB, free 1984.3 MB)
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:04 INFO MemoryStore: Block broadcast_185_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1984.2 MB)
18/11/12 12:27:04 INFO BlockManagerInfo: Added broadcast_185_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.2 MB)
18/11/12 12:27:04 INFO SparkContext: Created broadcast 185 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:04 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 180 (MapPartitionsRDD[851] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:04 INFO TaskSchedulerImpl: Adding task set 180.0 with 1 tasks
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.520] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [11]	train-error:0.147482
[INFO] [11/12/2018 12:27:04.522] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [12]	train-error:0.145683
[INFO] [11/12/2018 12:27:04.525] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [13]	train-error:0.145683
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.527] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [14]	train-error:0.143885
[INFO] [11/12/2018 12:27:04.530] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [15]	train-error:0.143885
[INFO] [11/12/2018 12:27:04.532] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.145683
[INFO] [11/12/2018 12:27:04.535] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [17]	train-error:0.143885
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.537] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [18]	train-error:0.140288
[INFO] [11/12/2018 12:27:04.539] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [19]	train-error:0.143885
[INFO] [11/12/2018 12:27:04.542] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [20]	train-error:0.138489
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.544] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [21]	train-error:0.138489
[INFO] [11/12/2018 12:27:04.546] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [22]	train-error:0.138489
[INFO] [11/12/2018 12:27:04.548] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [23]	train-error:0.136691
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.551] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [24]	train-error:0.136691
[INFO] [11/12/2018 12:27:04.553] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [25]	train-error:0.136691
[INFO] [11/12/2018 12:27:04.555] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.134892
[INFO] [11/12/2018 12:27:04.557] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [27]	train-error:0.134892
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.559] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28]	train-error:0.134892
[INFO] [11/12/2018 12:27:04.561] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [29]	train-error:0.133094
[INFO] [11/12/2018 12:27:04.564] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30]	train-error:0.133094
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.565] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [31]	train-error:0.133094
[INFO] [11/12/2018 12:27:04.568] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [32]	train-error:0.131295
[INFO] [11/12/2018 12:27:04.570] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [33]	train-error:0.131295
[INFO] [11/12/2018 12:27:04.572] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [34]	train-error:0.129496
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.574] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [35]	train-error:0.129496
[INFO] [11/12/2018 12:27:04.576] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [36]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.578] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [37]	train-error:0.127698
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.580] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [38]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.582] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [39]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.584] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [40]	train-error:0.127698
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.586] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [41]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.588] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [42]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.590] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [43]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.592] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [44]	train-error:0.127698
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.594] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.596] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [46]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.598] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [47]	train-error:0.129496
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.601] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [48]	train-error:0.129496
[INFO] [11/12/2018 12:27:04.603] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [49]	train-error:0.129496
[INFO] [11/12/2018 12:27:04.605] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [50]	train-error:0.129496
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.607] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [51]	train-error:0.129496
[INFO] [11/12/2018 12:27:04.609] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [52]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.611] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [53]	train-error:0.127698
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.613] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [54]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.616] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [55]	train-error:0.127698
[INFO] [11/12/2018 12:27:04.618] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [56]	train-error:0.125899
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.620] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [57]	train-error:0.125899
[INFO] [11/12/2018 12:27:04.622] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [58]	train-error:0.125899
[INFO] [11/12/2018 12:27:04.624] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [59]	train-error:0.125899
[INFO] [11/12/2018 12:27:04.626] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [60]	train-error:0.124101
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.628] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [61]	train-error:0.124101
[INFO] [11/12/2018 12:27:04.630] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [62]	train-error:0.124101
[INFO] [11/12/2018 12:27:04.632] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [63]	train-error:0.124101
[INFO] [11/12/2018 12:27:04.634] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [64]	train-error:0.124101
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.636] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [65]	train-error:0.124101
[INFO] [11/12/2018 12:27:04.638] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [66]	train-error:0.122302
[INFO] [11/12/2018 12:27:04.640] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [67]	train-error:0.124101
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.642] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [68]	train-error:0.124101
[INFO] [11/12/2018 12:27:04.644] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [69]	train-error:0.122302
[INFO] [11/12/2018 12:27:04.647] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [70]	train-error:0.120504
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.649] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [71]	train-error:0.120504
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.652] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [72]	train-error:0.120504
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.654] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [73]	train-error:0.116906
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.657] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [74]	train-error:0.116906
[INFO] [11/12/2018 12:27:04.660] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [75]	train-error:0.116906
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.664] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [76]	train-error:0.116906
[INFO] [11/12/2018 12:27:04.667] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [77]	train-error:0.116906
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.671] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [78]	train-error:0.115108
[INFO] [11/12/2018 12:27:04.673] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [79]	train-error:0.115108
[INFO] [11/12/2018 12:27:04.677] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [80]	train-error:0.115108
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.681] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [81]	train-error:0.116906
[INFO] [11/12/2018 12:27:04.685] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.116906
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.689] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [83]	train-error:0.115108
[INFO] [11/12/2018 12:27:04.693] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [84]	train-error:0.115108
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.697] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [85]	train-error:0.115108
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.702] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [86]	train-error:0.115108
[INFO] [11/12/2018 12:27:04.705] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [87]	train-error:0.113309
[INFO] [11/12/2018 12:27:04.708] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [88]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.713] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [89]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.718] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [90]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.722] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [91]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.728] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [92]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.730] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [93]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.735] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [94]	train-error:0.113309
[INFO] [11/12/2018 12:27:04.740] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [95]	train-error:0.113309
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.745] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [96]	train-error:0.111511
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.750] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [97]	train-error:0.111511
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:04] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:04.754] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [98]	train-error:0.111511
[INFO] [11/12/2018 12:27:04.760] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [99]	train-error:0.111511
18/11/12 12:27:06 INFO MemoryStore: Block rdd_843_0 stored as values in memory (estimated size 584.0 B, free 1984.2 MB)
18/11/12 12:27:06 INFO BlockManagerInfo: Added rdd_843_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1998.2 MB)
18/11/12 12:27:06 INFO Executor: 1 block locks were not released by TID = 376:
[rdd_843_0]
18/11/12 12:27:06 INFO Executor: Finished task 0.0 in stage 178.0 (TID 376). 3428 bytes result sent to driver
18/11/12 12:27:06 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:06 INFO TaskSetManager: Starting task 0.0 in stage 179.0 (TID 377, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:06 INFO TaskSetManager: Finished task 0.0 in stage 178.0 (TID 376) in 2322 ms on localhost (executor driver) (1/1)
18/11/12 12:27:06 INFO Executor: Running task 0.0 in stage 179.0 (TID 377)
18/11/12 12:27:06 INFO TaskSchedulerImpl: Removed TaskSet 178.0, whose tasks have all completed, from pool 
18/11/12 12:27:06 INFO DAGScheduler: ResultStage 178 (foreachPartition at XGBoost.scala:287) finished in 4.638 s
18/11/12 12:27:06 INFO DAGScheduler: Job 131 finished: foreachPartition at XGBoost.scala:287, took 4.648829 s
[INFO] [11/12/2018 12:27:06.765] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:06 INFO BlockManager: Found block rdd_835_0 locally
18/11/12 12:27:06 INFO Executor: 1 block locks were not released by TID = 377:
[rdd_835_0]
18/11/12 12:27:06 INFO Executor: Finished task 0.0 in stage 179.0 (TID 377). 59638 bytes result sent to driver
18/11/12 12:27:06 INFO TaskSetManager: Starting task 0.0 in stage 180.0 (TID 378, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:06 INFO Executor: Running task 0.0 in stage 180.0 (TID 378)
18/11/12 12:27:06 INFO TaskSetManager: Finished task 0.0 in stage 179.0 (TID 377) in 10 ms on localhost (executor driver) (1/1)
18/11/12 12:27:06 INFO TaskSchedulerImpl: Removed TaskSet 179.0, whose tasks have all completed, from pool 
18/11/12 12:27:06 INFO DAGScheduler: ResultStage 179 (first at XGBoost.scala:352) finished in 2.286 s
18/11/12 12:27:06 INFO DAGScheduler: Job 132 finished: first at XGBoost.scala:352, took 2.287255 s
18/11/12 12:27:06 INFO MapPartitionsRDD: Removing RDD 835 from persistence list
18/11/12 12:27:06 INFO BlockManager: Removing RDD 835
18/11/12 12:27:06 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:06 INFO DAGScheduler: Got job 134 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:06 INFO DAGScheduler: Final stage: ResultStage 181 (first at XGBoost.scala:352)
18/11/12 12:27:06 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:06 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:06 INFO DAGScheduler: Submitting ResultStage 181 (MapPartitionsRDD[843] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:06 INFO BlockManager: Found block rdd_184_0 locally
[INFO] [11/12/2018 12:27:06.792] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[12:27:06] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:27:06.794] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:06.794] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.802] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [0]	train-error:0.181818
18/11/12 12:27:06 INFO MemoryStore: Block broadcast_186 stored as values in memory (estimated size 543.8 KB, free 1983.6 MB)
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:06 INFO MemoryStore: Block broadcast_186_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1983.5 MB)
18/11/12 12:27:06 INFO BlockManagerInfo: Added broadcast_186_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.1 MB)
18/11/12 12:27:06 INFO SparkContext: Created broadcast 186 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:06 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 181 (MapPartitionsRDD[843] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:06 INFO TaskSchedulerImpl: Adding task set 181.0 with 1 tasks
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:06 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:06 INFO DAGScheduler: Registering RDD 856 (take at Classifier.scala:111)
18/11/12 12:27:06 INFO DAGScheduler: Got job 135 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:06 INFO DAGScheduler: Final stage: ResultStage 183 (take at Classifier.scala:111)
18/11/12 12:27:06 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 182)
18/11/12 12:27:06 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 182)
18/11/12 12:27:06 INFO DAGScheduler: Submitting ShuffleMapStage 182 (MapPartitionsRDD[856] at take at Classifier.scala:111), which has no missing parents
[INFO] [11/12/2018 12:27:06.806] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [1]	train-error:0.174081
[INFO] [11/12/2018 12:27:06.810] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [2]	train-error:0.183752
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.814] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [3]	train-error:0.174081
[INFO] [11/12/2018 12:27:06.817] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [4]	train-error:0.176015
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:06 INFO MemoryStore: Block broadcast_187 stored as values in memory (estimated size 537.6 KB, free 1983.0 MB)
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:06 INFO MemoryStore: Block broadcast_187_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1982.8 MB)
18/11/12 12:27:06 INFO BlockManagerInfo: Added broadcast_187_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.9 MB)
18/11/12 12:27:06 INFO SparkContext: Created broadcast 187 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:06 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 182 (MapPartitionsRDD[856] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:06 INFO TaskSchedulerImpl: Adding task set 182.0 with 1 tasks
[INFO] [11/12/2018 12:27:06.821] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [5]	train-error:0.172147
[INFO] [11/12/2018 12:27:06.824] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [6]	train-error:0.172147
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.827] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [7]	train-error:0.154739
[INFO] [11/12/2018 12:27:06.829] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.154739
[INFO] [11/12/2018 12:27:06.831] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [9]	train-error:0.158607
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.834] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [10]	train-error:0.148936
[INFO] [11/12/2018 12:27:06.837] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [11]	train-error:0.154739
[INFO] [11/12/2018 12:27:06.839] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [12]	train-error:0.154739
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.841] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [13]	train-error:0.150870
[INFO] [11/12/2018 12:27:06.844] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [14]	train-error:0.156673
[INFO] [11/12/2018 12:27:06.847] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [15]	train-error:0.156673
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.849] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.150870
[INFO] [11/12/2018 12:27:06.852] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [17]	train-error:0.150870
[INFO] [11/12/2018 12:27:06.855] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [18]	train-error:0.148936
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.858] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [19]	train-error:0.148936
[INFO] [11/12/2018 12:27:06.860] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [20]	train-error:0.148936
[INFO] [11/12/2018 12:27:06.863] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [21]	train-error:0.147002
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.865] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [22]	train-error:0.147002
[INFO] [11/12/2018 12:27:06.868] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [23]	train-error:0.147002
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.870] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [24]	train-error:0.148936
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.873] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [25]	train-error:0.147002
[INFO] [11/12/2018 12:27:06.876] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [26]	train-error:0.147002
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.878] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [27]	train-error:0.147002
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.880] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [28]	train-error:0.147002
[INFO] [11/12/2018 12:27:06.883] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [29]	train-error:0.147002
[INFO] [11/12/2018 12:27:06.886] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [30]	train-error:0.147002
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.889] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [31]	train-error:0.147002
[INFO] [11/12/2018 12:27:06.892] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [32]	train-error:0.147002
[INFO] [11/12/2018 12:27:06.894] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [33]	train-error:0.145068
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.898] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [34]	train-error:0.145068
[INFO] [11/12/2018 12:27:06.900] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [35]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.904] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [36]	train-error:0.143133
[INFO] [11/12/2018 12:27:06.906] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [37]	train-error:0.143133
[INFO] [11/12/2018 12:27:06.909] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [38]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.911] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [39]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.914] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [40]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.917] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [41]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.919] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [42]	train-error:0.143133
[INFO] [11/12/2018 12:27:06.922] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [43]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.925] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [44]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.927] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.145068
[INFO] [11/12/2018 12:27:06.930] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [46]	train-error:0.143133
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.932] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [47]	train-error:0.141199
[INFO] [11/12/2018 12:27:06.935] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [48]	train-error:0.141199
[INFO] [11/12/2018 12:27:06.937] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [49]	train-error:0.141199
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.940] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [50]	train-error:0.141199
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.942] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [51]	train-error:0.141199
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.945] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [52]	train-error:0.141199
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.947] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [53]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.950] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [54]	train-error:0.141199
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.952] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [55]	train-error:0.141199
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.955] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [56]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.958] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [57]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.961] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [58]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.964] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [59]	train-error:0.139265
[INFO] [11/12/2018 12:27:06.969] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [60]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.972] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [61]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.977] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [62]	train-error:0.139265
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.981] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [63]	train-error:0.137331
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.987] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [64]	train-error:0.137331
[INFO] [11/12/2018 12:27:06.990] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [65]	train-error:0.137331
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:06.994] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [66]	train-error:0.137331
[INFO] [11/12/2018 12:27:06.998] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [67]	train-error:0.137331
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:06] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.002] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [68]	train-error:0.137331
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.006] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [69]	train-error:0.137331
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.012] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [70]	train-error:0.137331
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.017] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [71]	train-error:0.137331
[INFO] [11/12/2018 12:27:07.021] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [72]	train-error:0.137331
[INFO] [11/12/2018 12:27:07.025] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [73]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.032] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [74]	train-error:0.137331
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.036] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [75]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.043] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [76]	train-error:0.135397
[INFO] [11/12/2018 12:27:07.047] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [77]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.054] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [78]	train-error:0.135397
[INFO] [11/12/2018 12:27:07.059] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [79]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.064] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [80]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.070] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.077] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [82]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.083] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [83]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.088] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [84]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.096] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [85]	train-error:0.133462
[INFO] [11/12/2018 12:27:07.100] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [86]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.108] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [87]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.115] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [88]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.119] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [89]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.124] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [90]	train-error:0.133462
[INFO] [11/12/2018 12:27:07.133] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [91]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.140] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [92]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.144] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [93]	train-error:0.135397
[INFO] [11/12/2018 12:27:07.148] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [94]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.151] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [95]	train-error:0.135397
[INFO] [11/12/2018 12:27:07.155] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [96]	train-error:0.135397
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.158] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [97]	train-error:0.135397
[INFO] [11/12/2018 12:27:07.161] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [98]	train-error:0.133462
[12:27:07] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:07.164] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [99]	train-error:0.133462
18/11/12 12:27:09 INFO MemoryStore: Block rdd_851_0 stored as values in memory (estimated size 584.0 B, free 1982.8 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added rdd_851_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1997.9 MB)
18/11/12 12:27:09 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:09 INFO Executor: 1 block locks were not released by TID = 378:
[rdd_851_0]
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 180.0 (TID 378). 3428 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 181.0 (TID 379, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 180.0 (TID 378) in 2396 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 181.0 (TID 379)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 180.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: ResultStage 180 (foreachPartition at XGBoost.scala:287) finished in 4.664 s
18/11/12 12:27:09 INFO DAGScheduler: Job 133 finished: foreachPartition at XGBoost.scala:287, took 4.667067 s
[INFO] [11/12/2018 12:27:09.170] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:09 INFO BlockManager: Found block rdd_843_0 locally
18/11/12 12:27:09 INFO Executor: 1 block locks were not released by TID = 379:
[rdd_843_0]
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 181.0 (TID 379). 56961 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 182.0 (TID 380, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 182.0 (TID 380)
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 181.0 (TID 379) in 9 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 181.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: ResultStage 181 (first at XGBoost.scala:352) finished in 2.395 s
18/11/12 12:27:09 INFO DAGScheduler: Job 134 finished: first at XGBoost.scala:352, took 2.396051 s
18/11/12 12:27:09 INFO MapPartitionsRDD: Removing RDD 843 from persistence list
18/11/12 12:27:09 INFO BlockManager: Removing RDD 843
18/11/12 12:27:09 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:09 INFO DAGScheduler: Got job 136 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:09 INFO DAGScheduler: Final stage: ResultStage 184 (first at XGBoost.scala:352)
18/11/12 12:27:09 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:09 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:09 INFO DAGScheduler: Submitting ResultStage 184 (MapPartitionsRDD[851] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:09 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_188 stored as values in memory (estimated size 543.8 KB, free 1982.3 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_188_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1982.1 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_188_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.8 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 188 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 184 (MapPartitionsRDD[851] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 184.0 with 1 tasks
18/11/12 12:27:09 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:09 INFO DAGScheduler: Registering RDD 865 (take at Classifier.scala:111)
18/11/12 12:27:09 INFO DAGScheduler: Got job 137 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:09 INFO DAGScheduler: Final stage: ResultStage 186 (take at Classifier.scala:111)
18/11/12 12:27:09 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 185)
18/11/12 12:27:09 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 185)
18/11/12 12:27:09 INFO DAGScheduler: Submitting ShuffleMapStage 185 (MapPartitionsRDD[865] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 182.0 (TID 380). 3861 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 184.0 (TID 381, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 182.0 (TID 380) in 29 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 182.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 184.0 (TID 381)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_189 stored as values in memory (estimated size 537.6 KB, free 1981.6 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_189_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1981.5 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_189_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.6 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 189 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 185 (MapPartitionsRDD[865] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 185.0 with 1 tasks
18/11/12 12:27:09 INFO DAGScheduler: ShuffleMapStage 182 (take at Classifier.scala:111) finished in 2.407 s
18/11/12 12:27:09 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:09 INFO DAGScheduler: running: Set(ResultStage 184, ShuffleMapStage 185)
18/11/12 12:27:09 INFO DAGScheduler: waiting: Set(ResultStage 186, ResultStage 183)
18/11/12 12:27:09 INFO DAGScheduler: failed: Set()
18/11/12 12:27:09 INFO DAGScheduler: Submitting ResultStage 183 (MapPartitionsRDD[860] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_190 stored as values in memory (estimated size 8.2 KB, free 1981.5 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_190_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1981.5 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_190_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.6 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 190 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 183 (MapPartitionsRDD[860] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 183.0 with 1 tasks
18/11/12 12:27:09 INFO BlockManager: Found block rdd_851_0 locally
18/11/12 12:27:09 INFO Executor: 1 block locks were not released by TID = 381:
[rdd_851_0]
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 184.0 (TID 381). 57180 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 183.0 (TID 382, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 183.0 (TID 382)
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 184.0 (TID 381) in 11 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 184.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: ResultStage 184 (first at XGBoost.scala:352) finished in 0.027 s
18/11/12 12:27:09 INFO DAGScheduler: Job 136 finished: first at XGBoost.scala:352, took 0.028253 s
18/11/12 12:27:09 INFO MapPartitionsRDD: Removing RDD 851 from persistence list
18/11/12 12:27:09 INFO BlockManager: Removing RDD 851
18/11/12 12:27:09 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:09 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 183.0 (TID 382). 1551 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 185.0 (TID 383, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 183.0 (TID 382) in 2 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 185.0 (TID 383)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 183.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: ResultStage 183 (take at Classifier.scala:111) finished in 0.006 s
18/11/12 12:27:09 INFO DAGScheduler: Job 135 finished: take at Classifier.scala:111, took 2.413796 s
18/11/12 12:27:09 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_694f22aaeeff__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:09 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 185.0 (TID 383). 3861 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 185.0 (TID 383) in 16 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 185.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: ShuffleMapStage 185 (take at Classifier.scala:111) finished in 0.032 s
18/11/12 12:27:09 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:09 INFO DAGScheduler: running: Set()
18/11/12 12:27:09 INFO DAGScheduler: waiting: Set(ResultStage 186)
18/11/12 12:27:09 INFO DAGScheduler: failed: Set()
18/11/12 12:27:09 INFO DAGScheduler: Submitting ResultStage 186 (MapPartitionsRDD[869] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_191 stored as values in memory (estimated size 8.2 KB, free 1981.4 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_191_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1981.4 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_191_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.6 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 191 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 186 (MapPartitionsRDD[869] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 186.0 with 1 tasks
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 186.0 (TID 384, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 186.0 (TID 384)
18/11/12 12:27:09 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:09 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 186.0 (TID 384). 1551 bytes result sent to driver
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 186.0 (TID 384) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 186.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: ResultStage 186 (take at Classifier.scala:111) finished in 0.006 s
18/11/12 12:27:09 INFO DAGScheduler: Job 137 finished: take at Classifier.scala:111, took 0.039150 s
18/11/12 12:27:09 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_16e012786803__labelCol since numClasses was not specified in the column metadata.
[INFO] [11/12/2018 12:27:09.251] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:59871
[INFO] [11/12/2018 12:27:09.251] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:09 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:09 INFO DAGScheduler: Registering RDD 880 (take at Classifier.scala:111)
18/11/12 12:27:09 INFO DAGScheduler: Got job 138 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:09 INFO DAGScheduler: Final stage: ResultStage 188 (take at Classifier.scala:111)
18/11/12 12:27:09 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 187)
18/11/12 12:27:09 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 187)
18/11/12 12:27:09 INFO DAGScheduler: Submitting ShuffleMapStage 187 (MapPartitionsRDD[880] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:09 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_192 stored as values in memory (estimated size 537.6 KB, free 1980.9 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_192_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1980.8 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_192_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.5 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 192 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 187 (MapPartitionsRDD[880] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 187.0 with 1 tasks
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 187.0 (TID 385, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:09 INFO DAGScheduler: Got job 139 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:09 INFO DAGScheduler: Final stage: ResultStage 189 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 187.0 (TID 385)
18/11/12 12:27:09 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:09 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:09 INFO DAGScheduler: Submitting ResultStage 189 (MapPartitionsRDD[886] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:09.269] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:37580
[INFO] [11/12/2018 12:27:09.269] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:09 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:09 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_193 stored as values in memory (estimated size 543.8 KB, free 1980.2 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_193_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1980.1 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_193_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.3 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 193 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 189 (MapPartitionsRDD[886] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 189.0 with 1 tasks
18/11/12 12:27:09 INFO Executor: Finished task 0.0 in stage 187.0 (TID 385). 3861 bytes result sent to driver
18/11/12 12:27:09 INFO DAGScheduler: Got job 140 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:09 INFO DAGScheduler: Final stage: ResultStage 190 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:09 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:09 INFO TaskSetManager: Starting task 0.0 in stage 189.0 (TID 386, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:09 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:09 INFO TaskSetManager: Finished task 0.0 in stage 187.0 (TID 385) in 21 ms on localhost (executor driver) (1/1)
18/11/12 12:27:09 INFO Executor: Running task 0.0 in stage 189.0 (TID 386)
18/11/12 12:27:09 INFO TaskSchedulerImpl: Removed TaskSet 187.0, whose tasks have all completed, from pool 
18/11/12 12:27:09 INFO DAGScheduler: Submitting ResultStage 190 (MapPartitionsRDD[894] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:09 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_194 stored as values in memory (estimated size 543.8 KB, free 1979.6 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_194_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1979.4 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_194_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.2 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 194 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 190 (MapPartitionsRDD[894] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 190.0 with 1 tasks
18/11/12 12:27:09 INFO DAGScheduler: ShuffleMapStage 187 (take at Classifier.scala:111) finished in 0.055 s
18/11/12 12:27:09 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:09 INFO DAGScheduler: running: Set(ResultStage 190, ResultStage 189)
18/11/12 12:27:09 INFO DAGScheduler: waiting: Set(ResultStage 188)
18/11/12 12:27:09 INFO DAGScheduler: failed: Set()
18/11/12 12:27:09 INFO DAGScheduler: Submitting ResultStage 188 (MapPartitionsRDD[885] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_195 stored as values in memory (estimated size 8.2 KB, free 1979.4 MB)
18/11/12 12:27:09 INFO MemoryStore: Block broadcast_195_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1979.4 MB)
18/11/12 12:27:09 INFO BlockManagerInfo: Added broadcast_195_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.2 MB)
18/11/12 12:27:09 INFO SparkContext: Created broadcast 195 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:09 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 188 (MapPartitionsRDD[885] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:09 INFO TaskSchedulerImpl: Adding task set 188.0 with 1 tasks
[12:27:09] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:27:09.312] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:09.316] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:09.316] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.324] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [0]	train-error:0.130354
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.329] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [1]	train-error:0.130354
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.336] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [2]	train-error:0.130354
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.340] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [3]	train-error:0.130354
[INFO] [11/12/2018 12:27:09.345] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [4]	train-error:0.126629
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.350] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [5]	train-error:0.130354
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.355] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [6]	train-error:0.122905
[INFO] [11/12/2018 12:27:09.360] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [7]	train-error:0.115456
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.364] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.115456
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.369] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [9]	train-error:0.117318
[INFO] [11/12/2018 12:27:09.374] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [10]	train-error:0.115456
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.379] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [11]	train-error:0.104283
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.384] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [12]	train-error:0.106145
[INFO] [11/12/2018 12:27:09.389] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [13]	train-error:0.100559
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.394] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [14]	train-error:0.094972
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.404] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [15]	train-error:0.096834
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.412] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [16]	train-error:0.094972
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.419] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [17]	train-error:0.093110
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.428] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [18]	train-error:0.093110
[INFO] [11/12/2018 12:27:09.439] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [19]	train-error:0.093110
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.451] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [20]	train-error:0.093110
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.460] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [21]	train-error:0.093110
[INFO] [11/12/2018 12:27:09.471] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22]	train-error:0.091248
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.482] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.091248
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.496] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [24]	train-error:0.085661
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.505] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [25]	train-error:0.087523
[INFO] [11/12/2018 12:27:09.517] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [26]	train-error:0.085661
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.526] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [27]	train-error:0.087523
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.534] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [28]	train-error:0.085661
[INFO] [11/12/2018 12:27:09.548] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [29]	train-error:0.089385
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.556] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [30]	train-error:0.087523
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.563] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [31]	train-error:0.085661
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.569] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [32]	train-error:0.085661
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.575] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [33]	train-error:0.085661
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.582] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [34]	train-error:0.081937
[INFO] [11/12/2018 12:27:09.586] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [35]	train-error:0.080074
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.592] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [36]	train-error:0.076350
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.599] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [37]	train-error:0.076350
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.608] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [38]	train-error:0.076350
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.625] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [39]	train-error:0.076350
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.630] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [40]	train-error:0.074488
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.641] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [41]	train-error:0.076350
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.654] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [42]	train-error:0.072626
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.661] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [43]	train-error:0.072626
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.673] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [44]	train-error:0.074488
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.680] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [45]	train-error:0.074488
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.691] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [46]	train-error:0.072626
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.704] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [47]	train-error:0.070763
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.711] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [48]	train-error:0.070763
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.724] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [49]	train-error:0.070763
[INFO] [11/12/2018 12:27:09.730] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [50]	train-error:0.070763
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.736] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [51]	train-error:0.070763
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.740] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [52]	train-error:0.068901
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.745] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [53]	train-error:0.065177
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.750] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [54]	train-error:0.065177
[INFO] [11/12/2018 12:27:09.754] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [55]	train-error:0.065177
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.758] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [56]	train-error:0.065177
[INFO] [11/12/2018 12:27:09.762] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [57]	train-error:0.065177
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.766] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [58]	train-error:0.065177
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.770] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [59]	train-error:0.063315
[INFO] [11/12/2018 12:27:09.776] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [60]	train-error:0.063315
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.779] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [61]	train-error:0.063315
[INFO] [11/12/2018 12:27:09.784] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [62]	train-error:0.063315
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.788] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [63]	train-error:0.063315
[INFO] [11/12/2018 12:27:09.792] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [64]	train-error:0.063315
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.798] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [65]	train-error:0.063315
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.808] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [66]	train-error:0.063315
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.819] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [67]	train-error:0.063315
[INFO] [11/12/2018 12:27:09.833] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [68]	train-error:0.061453
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.847] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [69]	train-error:0.061453
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.861] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [70]	train-error:0.061453
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.871] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [71]	train-error:0.059590
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.883] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [72]	train-error:0.061453
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.898] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [73]	train-error:0.061453
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.908] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [74]	train-error:0.059590
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.922] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [75]	train-error:0.057728
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.930] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [76]	train-error:0.059590
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.935] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [77]	train-error:0.057728
[INFO] [11/12/2018 12:27:09.940] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [78]	train-error:0.057728
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.945] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [79]	train-error:0.055866
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.949] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [80]	train-error:0.055866
[INFO] [11/12/2018 12:27:09.953] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [81]	train-error:0.055866
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.958] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.057728
[INFO] [11/12/2018 12:27:09.962] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [83]	train-error:0.057728
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.966] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [84]	train-error:0.057728
[INFO] [11/12/2018 12:27:09.970] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [85]	train-error:0.055866
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.975] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [86]	train-error:0.055866
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.979] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [87]	train-error:0.054004
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.985] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [88]	train-error:0.054004
[12:27:09] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:09.999] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [89]	train-error:0.054004
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.011] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [90]	train-error:0.052142
[INFO] [11/12/2018 12:27:10.017] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [91]	train-error:0.052142
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.028] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [92]	train-error:0.050279
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.040] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [93]	train-error:0.052142
[INFO] [11/12/2018 12:27:10.040] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/system/IO-TCP/selectors/$a/95] Message [akka.io.SelectionHandler$ChannelReadable$] from Actor[akka://RabitTracker/deadLetters] to Actor[akka://RabitTracker/system/IO-TCP/selectors/$a/95#263169571] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [11/12/2018 12:27:10.050] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [94]	train-error:0.048417
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.059] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [95]	train-error:0.048417
[INFO] [11/12/2018 12:27:10.064] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [96]	train-error:0.048417
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.075] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [97]	train-error:0.046555
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.081] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [98]	train-error:0.046555
[12:27:10] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:10.090] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [99]	train-error:0.046555
18/11/12 12:27:12 INFO MemoryStore: Block rdd_886_0 stored as values in memory (estimated size 584.0 B, free 1979.4 MB)
[INFO] [11/12/2018 12:27:12.092] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:12 INFO BlockManagerInfo: Added rdd_886_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1997.2 MB)
18/11/12 12:27:12 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:12 INFO Executor: 1 block locks were not released by TID = 386:
[rdd_886_0]
18/11/12 12:27:12 INFO Executor: Finished task 0.0 in stage 189.0 (TID 386). 3428 bytes result sent to driver
18/11/12 12:27:12 INFO TaskSetManager: Starting task 0.0 in stage 188.0 (TID 387, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:12 INFO TaskSetManager: Finished task 0.0 in stage 189.0 (TID 386) in 2806 ms on localhost (executor driver) (1/1)
18/11/12 12:27:12 INFO Executor: Running task 0.0 in stage 188.0 (TID 387)
18/11/12 12:27:12 INFO TaskSchedulerImpl: Removed TaskSet 189.0, whose tasks have all completed, from pool 
18/11/12 12:27:12 INFO DAGScheduler: ResultStage 189 (foreachPartition at XGBoost.scala:287) finished in 2.825 s
18/11/12 12:27:12 INFO DAGScheduler: Job 139 finished: foreachPartition at XGBoost.scala:287, took 2.833900 s
18/11/12 12:27:12 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:12 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:12 INFO Executor: Finished task 0.0 in stage 188.0 (TID 387). 1551 bytes result sent to driver
18/11/12 12:27:12 INFO TaskSetManager: Starting task 0.0 in stage 190.0 (TID 388, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:12 INFO TaskSetManager: Finished task 0.0 in stage 188.0 (TID 387) in 2 ms on localhost (executor driver) (1/1)
18/11/12 12:27:12 INFO TaskSchedulerImpl: Removed TaskSet 188.0, whose tasks have all completed, from pool 
18/11/12 12:27:12 INFO Executor: Running task 0.0 in stage 190.0 (TID 388)
18/11/12 12:27:12 INFO DAGScheduler: ResultStage 188 (take at Classifier.scala:111) finished in 2.788 s
18/11/12 12:27:12 INFO DAGScheduler: Job 138 finished: take at Classifier.scala:111, took 2.844878 s
18/11/12 12:27:12 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_ac9c647b9c3e__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:12 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:27:12.109] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:12.111] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:12.111] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:12] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.115] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [0]	train-error:0.134892
[INFO] [11/12/2018 12:27:12.119] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [1]	train-error:0.127698
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:12 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:12 INFO DAGScheduler: Got job 141 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:12 INFO DAGScheduler: Final stage: ResultStage 191 (first at XGBoost.scala:352)
18/11/12 12:27:12 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:12 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:12 INFO DAGScheduler: Submitting ResultStage 191 (MapPartitionsRDD[886] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.122] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [2]	train-error:0.115108
[INFO] [11/12/2018 12:27:12.124] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:47941
[INFO] [11/12/2018 12:27:12.124] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:27:12.126] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [3]	train-error:0.122302
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.130] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [4]	train-error:0.113309
[INFO] [11/12/2018 12:27:12.133] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [5]	train-error:0.115108
18/11/12 12:27:12 INFO MemoryStore: Block broadcast_196 stored as values in memory (estimated size 543.8 KB, free 1978.9 MB)
18/11/12 12:27:12 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.136] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.113309
[INFO] [11/12/2018 12:27:12.139] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [7]	train-error:0.111511
18/11/12 12:27:12 INFO MemoryStore: Block broadcast_196_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1978.7 MB)
18/11/12 12:27:12 INFO BlockManagerInfo: Added broadcast_196_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.0 MB)
18/11/12 12:27:12 INFO SparkContext: Created broadcast 196 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:12 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 191 (MapPartitionsRDD[886] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:12 INFO TaskSchedulerImpl: Adding task set 191.0 with 1 tasks
18/11/12 12:27:12 INFO DAGScheduler: Got job 142 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:12 INFO DAGScheduler: Final stage: ResultStage 192 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:12 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:12 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:12 INFO DAGScheduler: Submitting ResultStage 192 (MapPartitionsRDD[902] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.143] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.107914
[INFO] [11/12/2018 12:27:12.146] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [9]	train-error:0.113309
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.149] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [10]	train-error:0.111511
[INFO] [11/12/2018 12:27:12.153] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [11]	train-error:0.109712
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:12 INFO MemoryStore: Block broadcast_197 stored as values in memory (estimated size 543.8 KB, free 1978.2 MB)
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.156] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [12]	train-error:0.106115
[INFO] [11/12/2018 12:27:12.159] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [13]	train-error:0.102518
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:12 INFO MemoryStore: Block broadcast_197_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1978.0 MB)
18/11/12 12:27:12 INFO BlockManagerInfo: Added broadcast_197_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1996.9 MB)
18/11/12 12:27:12 INFO SparkContext: Created broadcast 197 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:12 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 192 (MapPartitionsRDD[902] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:12 INFO TaskSchedulerImpl: Adding task set 192.0 with 1 tasks
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.162] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [14]	train-error:0.106115
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.165] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [15]	train-error:0.104317
[INFO] [11/12/2018 12:27:12.168] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.106115
[INFO] [11/12/2018 12:27:12.171] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [17]	train-error:0.104317
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.174] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [18]	train-error:0.106115
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.176] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.102518
[INFO] [11/12/2018 12:27:12.179] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [20]	train-error:0.098921
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.182] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [21]	train-error:0.097122
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.184] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22]	train-error:0.097122
[INFO] [11/12/2018 12:27:12.186] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.100719
[INFO] [11/12/2018 12:27:12.189] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [24]	train-error:0.098921
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.191] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [25]	train-error:0.098921
[INFO] [11/12/2018 12:27:12.193] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.095324
[INFO] [11/12/2018 12:27:12.195] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [27]	train-error:0.095324
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.198] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28]	train-error:0.093525
[INFO] [11/12/2018 12:27:12.200] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [29]	train-error:0.093525
[INFO] [11/12/2018 12:27:12.202] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30]	train-error:0.091727
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.204] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [31]	train-error:0.091727
[INFO] [11/12/2018 12:27:12.207] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [32]	train-error:0.088129
[INFO] [11/12/2018 12:27:12.209] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [33]	train-error:0.088129
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.211] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [34]	train-error:0.086331
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.213] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [35]	train-error:0.086331
[INFO] [11/12/2018 12:27:12.215] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [36]	train-error:0.086331
[INFO] [11/12/2018 12:27:12.217] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [37]	train-error:0.086331
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.219] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [38]	train-error:0.086331
[INFO] [11/12/2018 12:27:12.221] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [39]	train-error:0.084532
[INFO] [11/12/2018 12:27:12.223] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [40]	train-error:0.082734
[INFO] [11/12/2018 12:27:12.226] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [41]	train-error:0.082734
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.228] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [42]	train-error:0.082734
[INFO] [11/12/2018 12:27:12.230] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [43]	train-error:0.082734
[INFO] [11/12/2018 12:27:12.232] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [44]	train-error:0.079137
[INFO] [11/12/2018 12:27:12.235] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.075540
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.237] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [46]	train-error:0.075540
[INFO] [11/12/2018 12:27:12.239] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [47]	train-error:0.075540
[INFO] [11/12/2018 12:27:12.242] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [48]	train-error:0.070144
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.244] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [49]	train-error:0.070144
[INFO] [11/12/2018 12:27:12.246] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [50]	train-error:0.070144
[INFO] [11/12/2018 12:27:12.249] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [51]	train-error:0.070144
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.251] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [52]	train-error:0.070144
[INFO] [11/12/2018 12:27:12.253] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [53]	train-error:0.070144
[INFO] [11/12/2018 12:27:12.255] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [54]	train-error:0.068345
[INFO] [11/12/2018 12:27:12.257] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [55]	train-error:0.064748
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.259] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [56]	train-error:0.062950
[INFO] [11/12/2018 12:27:12.261] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [57]	train-error:0.062950
[INFO] [11/12/2018 12:27:12.264] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [58]	train-error:0.059353
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.266] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [59]	train-error:0.059353
[INFO] [11/12/2018 12:27:12.268] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [60]	train-error:0.059353
[INFO] [11/12/2018 12:27:12.270] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [61]	train-error:0.057554
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.273] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [62]	train-error:0.057554
[INFO] [11/12/2018 12:27:12.275] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [63]	train-error:0.057554
[INFO] [11/12/2018 12:27:12.277] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [64]	train-error:0.053957
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.280] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [65]	train-error:0.050360
[INFO] [11/12/2018 12:27:12.282] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [66]	train-error:0.052158
[INFO] [11/12/2018 12:27:12.284] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [67]	train-error:0.052158
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.286] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [68]	train-error:0.050360
[INFO] [11/12/2018 12:27:12.288] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [69]	train-error:0.052158
[INFO] [11/12/2018 12:27:12.291] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [70]	train-error:0.050360
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.293] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [71]	train-error:0.048561
[INFO] [11/12/2018 12:27:12.296] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.048561
[INFO] [11/12/2018 12:27:12.298] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [73]	train-error:0.046763
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.300] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [74]	train-error:0.046763
[INFO] [11/12/2018 12:27:12.303] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [75]	train-error:0.044964
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.306] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [76]	train-error:0.044964
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.310] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [77]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.316] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [78]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.321] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [79]	train-error:0.041367
[INFO] [11/12/2018 12:27:12.325] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [80]	train-error:0.041367
[INFO] [11/12/2018 12:27:12.330] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [81]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.334] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [82]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.341] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [83]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.346] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [84]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.351] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [85]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.358] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [86]	train-error:0.041367
[INFO] [11/12/2018 12:27:12.365] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [87]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.371] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [88]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.374] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [89]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.381] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [90]	train-error:0.041367
[INFO] [11/12/2018 12:27:12.386] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [91]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.392] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [92]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.396] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [93]	train-error:0.041367
[INFO] [11/12/2018 12:27:12.403] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [94]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.410] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [95]	train-error:0.039568
[INFO] [11/12/2018 12:27:12.417] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [96]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.423] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [97]	train-error:0.041367
[12:27:12] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:12.429] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [98]	train-error:0.041367
[INFO] [11/12/2018 12:27:12.436] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [99]	train-error:0.041367
[INFO] [11/12/2018 12:27:14.439] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:14 INFO MemoryStore: Block rdd_894_0 stored as values in memory (estimated size 584.0 B, free 1978.0 MB)
18/11/12 12:27:14 INFO BlockManagerInfo: Added rdd_894_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1996.9 MB)
18/11/12 12:27:14 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:14 INFO Executor: 1 block locks were not released by TID = 388:
[rdd_894_0]
18/11/12 12:27:14 INFO Executor: Finished task 0.0 in stage 190.0 (TID 388). 3428 bytes result sent to driver
18/11/12 12:27:14 INFO TaskSetManager: Starting task 0.0 in stage 191.0 (TID 389, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:14 INFO TaskSetManager: Finished task 0.0 in stage 190.0 (TID 388) in 2345 ms on localhost (executor driver) (1/1)
18/11/12 12:27:14 INFO Executor: Running task 0.0 in stage 191.0 (TID 389)
18/11/12 12:27:14 INFO TaskSchedulerImpl: Removed TaskSet 190.0, whose tasks have all completed, from pool 
18/11/12 12:27:14 INFO DAGScheduler: ResultStage 190 (foreachPartition at XGBoost.scala:287) finished in 5.152 s
18/11/12 12:27:14 INFO DAGScheduler: Job 140 finished: foreachPartition at XGBoost.scala:287, took 5.164342 s
18/11/12 12:27:14 INFO BlockManager: Found block rdd_886_0 locally
18/11/12 12:27:14 INFO Executor: 1 block locks were not released by TID = 389:
[rdd_886_0]
18/11/12 12:27:14 INFO Executor: Finished task 0.0 in stage 191.0 (TID 389). 128891 bytes result sent to driver
18/11/12 12:27:14 INFO TaskSetManager: Starting task 0.0 in stage 192.0 (TID 390, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:14 INFO Executor: Running task 0.0 in stage 192.0 (TID 390)
18/11/12 12:27:14 INFO TaskSetManager: Finished task 0.0 in stage 191.0 (TID 389) in 18 ms on localhost (executor driver) (1/1)
18/11/12 12:27:14 INFO TaskSchedulerImpl: Removed TaskSet 191.0, whose tasks have all completed, from pool 
18/11/12 12:27:14 INFO DAGScheduler: ResultStage 191 (first at XGBoost.scala:352) finished in 2.335 s
18/11/12 12:27:14 INFO DAGScheduler: Job 141 finished: first at XGBoost.scala:352, took 2.336463 s
18/11/12 12:27:14 INFO MapPartitionsRDD: Removing RDD 886 from persistence list
18/11/12 12:27:14 INFO BlockManager: Removing RDD 886
18/11/12 12:27:14 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:14 INFO DAGScheduler: Got job 143 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:14 INFO DAGScheduler: Final stage: ResultStage 193 (first at XGBoost.scala:352)
18/11/12 12:27:14 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:14 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:14 INFO DAGScheduler: Submitting ResultStage 193 (MapPartitionsRDD[894] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:14 INFO BlockManager: Found block rdd_184_0 locally
[INFO] [11/12/2018 12:27:14.475] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:14.476] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:14.476] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
18/11/12 12:27:14 INFO MemoryStore: Block broadcast_198 stored as values in memory (estimated size 543.8 KB, free 1977.5 MB)
[12:27:14] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:14 INFO MemoryStore: Block broadcast_198_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1977.4 MB)
18/11/12 12:27:14 INFO BlockManagerInfo: Added broadcast_198_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1996.7 MB)
18/11/12 12:27:14 INFO SparkContext: Created broadcast 198 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:14 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 193 (MapPartitionsRDD[894] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:14 INFO TaskSchedulerImpl: Adding task set 193.0 with 1 tasks
[INFO] [11/12/2018 12:27:14.482] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [0]	train-error:0.150870
[INFO] [11/12/2018 12:27:14.485] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [1]	train-error:0.148936
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:14 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:14 INFO DAGScheduler: Registering RDD 907 (take at Classifier.scala:111)
18/11/12 12:27:14 INFO DAGScheduler: Got job 144 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:14 INFO DAGScheduler: Final stage: ResultStage 195 (take at Classifier.scala:111)
18/11/12 12:27:14 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 194)
18/11/12 12:27:14 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 194)
18/11/12 12:27:14 INFO DAGScheduler: Submitting ShuffleMapStage 194 (MapPartitionsRDD[907] at take at Classifier.scala:111), which has no missing parents
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.488] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [2]	train-error:0.150870
[INFO] [11/12/2018 12:27:14.492] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [3]	train-error:0.139265
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:14 INFO MemoryStore: Block broadcast_199 stored as values in memory (estimated size 537.6 KB, free 1976.8 MB)
[INFO] [11/12/2018 12:27:14.495] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [4]	train-error:0.139265
[INFO] [11/12/2018 12:27:14.498] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [5]	train-error:0.139265
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:14 INFO MemoryStore: Block broadcast_199_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1976.7 MB)
18/11/12 12:27:14 INFO BlockManagerInfo: Added broadcast_199_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1996.6 MB)
18/11/12 12:27:14 INFO SparkContext: Created broadcast 199 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:14 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 194 (MapPartitionsRDD[907] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:14 INFO TaskSchedulerImpl: Adding task set 194.0 with 1 tasks
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.502] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [6]	train-error:0.135397
[INFO] [11/12/2018 12:27:14.506] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [7]	train-error:0.133462
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.509] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [8]	train-error:0.127660
[INFO] [11/12/2018 12:27:14.514] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [9]	train-error:0.123791
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.518] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [10]	train-error:0.110251
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.523] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [11]	train-error:0.114120
[INFO] [11/12/2018 12:27:14.528] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [12]	train-error:0.110251
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.531] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [13]	train-error:0.110251
[INFO] [11/12/2018 12:27:14.535] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [14]	train-error:0.110251
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.538] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [15]	train-error:0.108317
[INFO] [11/12/2018 12:27:14.541] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [16]	train-error:0.110251
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.545] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [17]	train-error:0.102515
[INFO] [11/12/2018 12:27:14.548] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [18]	train-error:0.102515
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.552] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [19]	train-error:0.102515
[INFO] [11/12/2018 12:27:14.555] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [20]	train-error:0.108317
[INFO] [11/12/2018 12:27:14.558] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [21]	train-error:0.102515
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.561] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [22]	train-error:0.102515
[INFO] [11/12/2018 12:27:14.564] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [23]	train-error:0.102515
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.567] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [24]	train-error:0.100580
[INFO] [11/12/2018 12:27:14.570] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [25]	train-error:0.098646
[INFO] [11/12/2018 12:27:14.572] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [26]	train-error:0.096712
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.575] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [27]	train-error:0.096712
[INFO] [11/12/2018 12:27:14.578] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [28]	train-error:0.096712
[INFO] [11/12/2018 12:27:14.580] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [29]	train-error:0.096712
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.583] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [30]	train-error:0.096712
[INFO] [11/12/2018 12:27:14.585] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [31]	train-error:0.098646
[INFO] [11/12/2018 12:27:14.587] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [32]	train-error:0.098646
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.590] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [33]	train-error:0.098646
[INFO] [11/12/2018 12:27:14.592] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [34]	train-error:0.098646
[INFO] [11/12/2018 12:27:14.594] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [35]	train-error:0.098646
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.597] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [36]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.600] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [37]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.602] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [38]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.605] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [39]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.607] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [40]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.610] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [41]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.612] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [42]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.614] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [43]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.617] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [44]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.619] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [45]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.622] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [46]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.625] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [47]	train-error:0.096712
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.627] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [48]	train-error:0.096712
[INFO] [11/12/2018 12:27:14.630] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [49]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.633] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [50]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.635] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [51]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.638] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [52]	train-error:0.094778
[INFO] [11/12/2018 12:27:14.640] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [53]	train-error:0.094778
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.643] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [54]	train-error:0.092843
[INFO] [11/12/2018 12:27:14.645] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [55]	train-error:0.088975
[INFO] [11/12/2018 12:27:14.648] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [56]	train-error:0.088975
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.651] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [57]	train-error:0.087041
[INFO] [11/12/2018 12:27:14.654] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [58]	train-error:0.087041
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.657] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [59]	train-error:0.087041
[INFO] [11/12/2018 12:27:14.660] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [60]	train-error:0.085106
[INFO] [11/12/2018 12:27:14.664] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [61]	train-error:0.085106
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.669] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [62]	train-error:0.085106
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.672] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [63]	train-error:0.085106
[INFO] [11/12/2018 12:27:14.678] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [64]	train-error:0.085106
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.682] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [65]	train-error:0.085106
[INFO] [11/12/2018 12:27:14.685] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [66]	train-error:0.085106
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.691] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [67]	train-error:0.081238
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.695] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [68]	train-error:0.081238
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.701] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [69]	train-error:0.083172
[INFO] [11/12/2018 12:27:14.705] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [70]	train-error:0.081238
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.710] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [71]	train-error:0.081238
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.716] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [72]	train-error:0.081238
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.722] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [73]	train-error:0.081238
[INFO] [11/12/2018 12:27:14.727] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [74]	train-error:0.077369
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.732] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [75]	train-error:0.077369
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.738] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [76]	train-error:0.075435
[INFO] [11/12/2018 12:27:14.742] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [77]	train-error:0.075435
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.748] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [78]	train-error:0.075435
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.751] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [79]	train-error:0.071567
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.759] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [80]	train-error:0.069632
[INFO] [11/12/2018 12:27:14.762] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [81]	train-error:0.067698
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.768] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.067698
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.772] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [83]	train-error:0.067698
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.779] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [84]	train-error:0.067698
[INFO] [11/12/2018 12:27:14.783] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [85]	train-error:0.067698
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.790] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [86]	train-error:0.067698
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.795] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [87]	train-error:0.067698
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.801] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [88]	train-error:0.063830
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.806] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [89]	train-error:0.061896
[INFO] [11/12/2018 12:27:14.810] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [90]	train-error:0.061896
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.814] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [91]	train-error:0.061896
[INFO] [11/12/2018 12:27:14.817] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [92]	train-error:0.059961
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.821] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [93]	train-error:0.058027
[INFO] [11/12/2018 12:27:14.824] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [94]	train-error:0.059961
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.827] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [95]	train-error:0.058027
[INFO] [11/12/2018 12:27:14.830] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [96]	train-error:0.056093
[INFO] [11/12/2018 12:27:14.833] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [97]	train-error:0.054159
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.836] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [98]	train-error:0.052224
[12:27:14] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:14.842] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [99]	train-error:0.050290
[INFO] [11/12/2018 12:27:16.849] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:16 INFO MemoryStore: Block rdd_902_0 stored as values in memory (estimated size 584.0 B, free 1976.7 MB)
18/11/12 12:27:16 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:16 INFO BlockManagerInfo: Added rdd_902_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1996.6 MB)
18/11/12 12:27:16 INFO Executor: 1 block locks were not released by TID = 390:
[rdd_902_0]
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 192.0 (TID 390). 3428 bytes result sent to driver
18/11/12 12:27:16 INFO TaskSetManager: Starting task 0.0 in stage 193.0 (TID 391, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:16 INFO Executor: Running task 0.0 in stage 193.0 (TID 391)
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 192.0 (TID 390) in 2395 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 192.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO DAGScheduler: ResultStage 192 (foreachPartition at XGBoost.scala:287) finished in 4.712 s
18/11/12 12:27:16 INFO DAGScheduler: Job 142 finished: foreachPartition at XGBoost.scala:287, took 4.717535 s
18/11/12 12:27:16 INFO BlockManager: Found block rdd_894_0 locally
18/11/12 12:27:16 INFO Executor: 1 block locks were not released by TID = 391:
[rdd_894_0]
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 193.0 (TID 391). 128344 bytes result sent to driver
18/11/12 12:27:16 INFO TaskSetManager: Starting task 0.0 in stage 194.0 (TID 392, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:16 INFO Executor: Running task 0.0 in stage 194.0 (TID 392)
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 193.0 (TID 391) in 20 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 193.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO DAGScheduler: ResultStage 193 (first at XGBoost.scala:352) finished in 2.405 s
18/11/12 12:27:16 INFO DAGScheduler: Job 143 finished: first at XGBoost.scala:352, took 2.406744 s
18/11/12 12:27:16 INFO MapPartitionsRDD: Removing RDD 894 from persistence list
18/11/12 12:27:16 INFO BlockManager: Removing RDD 894
18/11/12 12:27:16 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:16 INFO DAGScheduler: Got job 145 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:16 INFO DAGScheduler: Final stage: ResultStage 196 (first at XGBoost.scala:352)
18/11/12 12:27:16 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:16 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:16 INFO DAGScheduler: Submitting ResultStage 196 (MapPartitionsRDD[902] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:16 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 194.0 (TID 392). 3861 bytes result sent to driver
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 194.0 (TID 392) in 28 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 194.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_200 stored as values in memory (estimated size 543.8 KB, free 1976.1 MB)
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_200_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1976.0 MB)
18/11/12 12:27:16 INFO BlockManagerInfo: Added broadcast_200_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1996.4 MB)
18/11/12 12:27:16 INFO SparkContext: Created broadcast 200 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:16 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 196 (MapPartitionsRDD[902] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:16 INFO TaskSchedulerImpl: Adding task set 196.0 with 1 tasks
18/11/12 12:27:16 INFO DAGScheduler: ShuffleMapStage 194 (take at Classifier.scala:111) finished in 2.417 s
18/11/12 12:27:16 INFO TaskSetManager: Starting task 0.0 in stage 196.0 (TID 393, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:16 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:16 INFO DAGScheduler: running: Set(ResultStage 196)
18/11/12 12:27:16 INFO DAGScheduler: waiting: Set(ResultStage 195)
18/11/12 12:27:16 INFO DAGScheduler: failed: Set()
18/11/12 12:27:16 INFO Executor: Running task 0.0 in stage 196.0 (TID 393)
18/11/12 12:27:16 INFO DAGScheduler: Submitting ResultStage 195 (MapPartitionsRDD[911] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_201 stored as values in memory (estimated size 8.2 KB, free 1976.0 MB)
18/11/12 12:27:16 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_201_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1976.0 MB)
18/11/12 12:27:16 INFO BlockManagerInfo: Added broadcast_201_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1996.4 MB)
18/11/12 12:27:16 INFO SparkContext: Created broadcast 201 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:16 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 195 (MapPartitionsRDD[911] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:16 INFO TaskSchedulerImpl: Adding task set 195.0 with 1 tasks
18/11/12 12:27:16 INFO DAGScheduler: Registering RDD 916 (take at Classifier.scala:111)
18/11/12 12:27:16 INFO DAGScheduler: Got job 146 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:16 INFO DAGScheduler: Final stage: ResultStage 198 (take at Classifier.scala:111)
18/11/12 12:27:16 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 197)
18/11/12 12:27:16 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 197)
18/11/12 12:27:16 INFO DAGScheduler: Submitting ShuffleMapStage 197 (MapPartitionsRDD[916] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:16 INFO BlockManager: Found block rdd_902_0 locally
18/11/12 12:27:16 INFO Executor: 1 block locks were not released by TID = 393:
[rdd_902_0]
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 196.0 (TID 393). 121426 bytes result sent to driver
18/11/12 12:27:16 INFO TaskSetManager: Starting task 0.0 in stage 195.0 (TID 394, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:16 INFO Executor: Running task 0.0 in stage 195.0 (TID 394)
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 196.0 (TID 393) in 16 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 196.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:16 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 195.0 (TID 394). 1594 bytes result sent to driver
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_202 stored as values in memory (estimated size 537.6 KB, free 1975.5 MB)
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 195.0 (TID 394) in 4 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 195.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_202_piece0 stored as bytes in memory (estimated size 150.3 KB, free 1975.3 MB)
18/11/12 12:27:16 INFO BlockManagerInfo: Added broadcast_202_piece0 in memory on 127.0.0.1:61956 (size: 150.3 KB, free: 1996.3 MB)
18/11/12 12:27:16 INFO SparkContext: Created broadcast 202 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:16 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 197 (MapPartitionsRDD[916] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:16 INFO TaskSchedulerImpl: Adding task set 197.0 with 1 tasks
18/11/12 12:27:16 INFO DAGScheduler: ResultStage 196 (first at XGBoost.scala:352) finished in 0.042 s
18/11/12 12:27:16 INFO TaskSetManager: Starting task 0.0 in stage 197.0 (TID 395, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:16 INFO DAGScheduler: Job 145 finished: first at XGBoost.scala:352, took 0.043415 s
18/11/12 12:27:16 INFO Executor: Running task 0.0 in stage 197.0 (TID 395)
18/11/12 12:27:16 INFO DAGScheduler: ResultStage 195 (take at Classifier.scala:111) finished in 0.023 s
18/11/12 12:27:16 INFO MapPartitionsRDD: Removing RDD 902 from persistence list
18/11/12 12:27:16 INFO DAGScheduler: Job 144 finished: take at Classifier.scala:111, took 2.441635 s
18/11/12 12:27:16 INFO BlockManager: Removing RDD 902
18/11/12 12:27:16 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_875ae5d42d91__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:16 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 197.0 (TID 395). 3861 bytes result sent to driver
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 197.0 (TID 395) in 21 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 197.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO DAGScheduler: ShuffleMapStage 197 (take at Classifier.scala:111) finished in 0.039 s
18/11/12 12:27:16 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:16 INFO DAGScheduler: running: Set()
18/11/12 12:27:16 INFO DAGScheduler: waiting: Set(ResultStage 198)
18/11/12 12:27:16 INFO DAGScheduler: failed: Set()
18/11/12 12:27:16 INFO DAGScheduler: Submitting ResultStage 198 (MapPartitionsRDD[920] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_203 stored as values in memory (estimated size 8.2 KB, free 1975.3 MB)
18/11/12 12:27:16 INFO MemoryStore: Block broadcast_203_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1975.3 MB)
18/11/12 12:27:16 INFO BlockManagerInfo: Added broadcast_203_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1996.3 MB)
18/11/12 12:27:16 INFO SparkContext: Created broadcast 203 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:16 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 198 (MapPartitionsRDD[920] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:16 INFO TaskSchedulerImpl: Adding task set 198.0 with 1 tasks
18/11/12 12:27:16 INFO TaskSetManager: Starting task 0.0 in stage 198.0 (TID 396, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:16 INFO Executor: Running task 0.0 in stage 198.0 (TID 396)
18/11/12 12:27:16 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:16 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:16 INFO Executor: Finished task 0.0 in stage 198.0 (TID 396). 1594 bytes result sent to driver
18/11/12 12:27:16 INFO TaskSetManager: Finished task 0.0 in stage 198.0 (TID 396) in 5 ms on localhost (executor driver) (1/1)
18/11/12 12:27:16 INFO TaskSchedulerImpl: Removed TaskSet 198.0, whose tasks have all completed, from pool 
18/11/12 12:27:16 INFO DAGScheduler: ResultStage 198 (take at Classifier.scala:111) finished in 0.011 s
18/11/12 12:27:16 INFO DAGScheduler: Job 146 finished: take at Classifier.scala:111, took 0.054908 s
18/11/12 12:27:16 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_64dabc142554__labelCol since numClasses was not specified in the column metadata.
[INFO] [11/12/2018 12:27:16.963] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:45295
[INFO] [11/12/2018 12:27:16.963] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:16 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:16 INFO DAGScheduler: Registering RDD 932 (take at Classifier.scala:111)
18/11/12 12:27:16 INFO DAGScheduler: Got job 147 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:16 INFO DAGScheduler: Final stage: ResultStage 200 (take at Classifier.scala:111)
18/11/12 12:27:16 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 199)
18/11/12 12:27:16 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 199)
18/11/12 12:27:16 INFO DAGScheduler: Submitting ShuffleMapStage 199 (MapPartitionsRDD[932] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5377
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5337
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5482
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5008
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5752
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4998
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4591
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4771
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5179
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4966
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4954
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5659
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4970
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5243
18/11/12 12:27:16 INFO BlockManagerInfo: Removed broadcast_162_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1996.4 MB)
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5117
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5807
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5147
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4906
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5205
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4730
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5270
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5648
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4802
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5607
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4835
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5463
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5742
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5699
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5095
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4868
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4557
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4770
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5019
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5340
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4985
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4843
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5740
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5139
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5259
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4950
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5979
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5265
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5731
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5780
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4646
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4940
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5126
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5226
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5269
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5361
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5755
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5969
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5316
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5170
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5169
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5214
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5829
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4764
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5743
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5605
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5880
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5072
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5559
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5867
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5109
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 5271
18/11/12 12:27:16 INFO ContextCleaner: Cleaned shuffle 42
18/11/12 12:27:16 INFO ContextCleaner: Cleaned accumulator 4808
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5469
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5600
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5354
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5440
18/11/12 12:27:17 INFO BlockManager: Removing RDD 800
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 800
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4746
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5471
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5855
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5839
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4927
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5642
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4803
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4563
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4599
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5247
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5365
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4911
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4809
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5427
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4629
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5794
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5282
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5581
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5252
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5432
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5934
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4668
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5245
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5617
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5478
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5513
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4909
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5919
18/11/12 12:27:17 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_180_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1996.6 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5672
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5373
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5927
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5306
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4962
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5556
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5612
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5551
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5207
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5286
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4890
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5647
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4953
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4566
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5813
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4611
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5809
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5412
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5325
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4577
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5201
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5893
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5176
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5555
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5044
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5909
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4871
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5246
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5712
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5697
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4729
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4736
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4853
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4778
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4869
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5027
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5046
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5402
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5596
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5448
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4820
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5878
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5087
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5093
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5395
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5068
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4756
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4914
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5532
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4691
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4847
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5709
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4612
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5653
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4574
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4965
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5184
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5122
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5613
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4964
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5130
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5347
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5686
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5565
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4806
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5868
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5718
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5375
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5973
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4586
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5888
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4641
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5735
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5974
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4590
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5061
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5771
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4842
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5391
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5380
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4593
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5020
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5920
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_192_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1996.7 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5518
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5661
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5237
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5129
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4858
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5706
18/11/12 12:27:17 INFO BlockManager: Removing RDD 741
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 741
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_166_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1996.9 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4687
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5145
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5639
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5727
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4901
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5332
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5018
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4640
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5525
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5579
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5029
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5343
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5055
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5558
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4857
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4570
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4596
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5124
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5299
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5047
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4800
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5808
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5922
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4947
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4674
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4797
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4833
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_164_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1997.0 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5983
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5965
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5352
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5189
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5634
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5357
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5580
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5564
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4618
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5425
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5230
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5966
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4592
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5692
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4594
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4883
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4969
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4967
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5097
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4688
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4896
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5627
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4656
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5655
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5687
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5628
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5146
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5891
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4686
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4872
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5830
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5090
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_165_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1997.0 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5384
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5630
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4666
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5264
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5569
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4832
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5228
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4975
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5914
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4568
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4805
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5846
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5003
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5456
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5541
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5180
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4660
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4881
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5568
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5376
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4992
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4610
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4790
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5079
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5042
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4685
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4783
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4926
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5571
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5480
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5309
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4741
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4675
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5762
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5918
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5296
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5748
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4669
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5760
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5669
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4571
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4633
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4936
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5833
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4748
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5796
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4935
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5249
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5103
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5764
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5069
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5711
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5749
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4678
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5894
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5089
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4817
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4886
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5220
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5175
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5185
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5637
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5717
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4997
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4943
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_189_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1997.2 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4990
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5587
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5219
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5776
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5327
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5004
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4619
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4819
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4680
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5294
18/11/12 12:27:17 INFO BlockManager: Removing RDD 894
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 894
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4989
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5477
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5227
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5358
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5137
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4725
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4647
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5475
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4852
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5825
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5657
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5292
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5772
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5360
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5779
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5971
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5302
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_193_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1997.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5522
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4799
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5491
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5897
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5851
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4994
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_204 stored as values in memory (estimated size 537.6 KB, free 1979.5 MB)
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_190_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1997.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5593
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5629
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5925
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4738
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5608
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5861
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5885
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5430
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4916
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4583
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5216
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5240
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5511
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4661
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5359
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5838
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5811
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5447
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4894
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5000
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5803
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5610
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4639
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5691
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4824
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5638
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5372
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5615
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4584
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5281
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5338
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5859
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5346
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4734
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5450
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4580
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4672
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5342
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5107
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5050
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5192
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5336
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5895
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5323
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5625
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5409
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_191_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1997.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4862
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5563
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5383
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5274
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5431
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5307
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4892
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5498
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5290
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5172
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5570
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5845
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5362
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4895
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4716
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4643
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4961
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5668
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5210
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5035
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5899
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4933
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5465
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5388
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5406
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5099
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5320
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4763
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4718
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5021
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5937
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5283
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4865
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5289
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5766
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4616
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_172_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1997.5 MB)
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_204_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1979.5 MB)
18/11/12 12:27:17 INFO BlockManagerInfo: Added broadcast_204_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5401
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5614
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5666
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5466
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5799
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5923
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5257
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5875
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5484
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4880
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5135
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5821
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5105
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4626
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5544
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5503
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5165
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5222
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5489
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5515
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5326
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5528
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5339
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5039
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4984
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5915
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5268
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4587
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4706
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4807
18/11/12 12:27:17 INFO SparkContext: Created broadcast 204 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:17 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 199 (MapPartitionsRDD[932] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:17 INFO TaskSchedulerImpl: Adding task set 199.0 with 1 tasks
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_194_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1997.5 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5721
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4708
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5726
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4622
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5043
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5576
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5746
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5260
18/11/12 12:27:17 INFO TaskSetManager: Starting task 0.0 in stage 199.0 (TID 397, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:17 INFO DAGScheduler: Got job 148 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:17 INFO DAGScheduler: Final stage: ResultStage 201 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:17 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:17 INFO BlockManager: Removing RDD 792
18/11/12 12:27:17 INFO Executor: Running task 0.0 in stage 199.0 (TID 397)
18/11/12 12:27:17 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 792
18/11/12 12:27:17 INFO DAGScheduler: Submitting ResultStage 201 (MapPartitionsRDD[937] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:17 INFO BlockManager: Removing RDD 902
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 902
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5045
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4971
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5141
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4958
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5502
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5651
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5744
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5413
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5374
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5929
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 41
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4863
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5900
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4698
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4598
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5546
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5677
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5820
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5052
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4693
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5404
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5800
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4733
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5774
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5887
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5104
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_198_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1997.6 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5229
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5140
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5901
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4873
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4902
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5775
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4855
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5526
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5276
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5026
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4849
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5415
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5408
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5804
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5206
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5239
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4624
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4731
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4983
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5529
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_179_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1997.6 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4737
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5293
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5871
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5435
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5091
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5785
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5036
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4735
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5436
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5982
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5451
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4874
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5504
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5619
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5084
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4634
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4821
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4956
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4630
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4903
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5213
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5277
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5824
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5980
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4595
18/11/12 12:27:17 INFO BlockManager: Removing RDD 749
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 749
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5777
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5102
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5606
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5203
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_157_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 1997.8 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5173
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5694
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4648
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5297
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5798
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4715
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5057
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4908
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5200
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5150
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5873
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5073
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4758
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5590
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4562
18/11/12 12:27:17 INFO BlockManager: Removing RDD 835
[INFO] [11/12/2018 12:27:17.024] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:39884
[INFO] [11/12/2018 12:27:17.024] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 835
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 43
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5688
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5770
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5009
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5066
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4654
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4980
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5155
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5303
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5190
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4841
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5670
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4851
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4723
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4750
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5455
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5589
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5333
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5913
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5370
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5381
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5251
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5494
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4856
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5074
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_183_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1997.8 MB)
18/11/12 12:27:17 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5728
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5198
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5156
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5195
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_197_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1997.9 MB)
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_205 stored as values in memory (estimated size 543.8 KB, free 1982.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4959
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4974
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5715
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4560
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5869
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4651
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5420
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5832
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5553
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5658
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4745
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4623
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5113
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4714
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5530
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5496
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5016
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5916
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4753
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5778
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5543
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4670
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5862
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5067
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4645
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5108
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5889
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5827
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4655
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5127
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5662
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5223
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5059
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5802
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4879
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5604
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5710
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5331
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5633
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5397
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5791
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5882
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5134
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4915
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5646
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5387
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4582
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4694
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4876
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5364
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5177
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5033
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5418
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5578
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5750
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5763
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5125
18/11/12 12:27:17 INFO Executor: Finished task 0.0 in stage 199.0 (TID 397). 3861 bytes result sent to driver
18/11/12 12:27:17 INFO TaskSetManager: Finished task 0.0 in stage 199.0 (TID 397) in 34 ms on localhost (executor driver) (1/1)
18/11/12 12:27:17 INFO TaskSchedulerImpl: Removed TaskSet 199.0, whose tasks have all completed, from pool 
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_175_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1998.1 MB)
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_205_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1982.8 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5142
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4604
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5310
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5355
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4938
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5479
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5280
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5341
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4659
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5300
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4743
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5591
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5860
18/11/12 12:27:17 INFO BlockManagerInfo: Added broadcast_205_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.9 MB)
18/11/12 12:27:17 INFO SparkContext: Created broadcast 205 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 45
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5510
18/11/12 12:27:17 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 201 (MapPartitionsRDD[937] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:17 INFO TaskSchedulerImpl: Adding task set 201.0 with 1 tasks
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 40
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4848
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5516
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5921
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4681
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 49
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5818
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5153
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5698
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5305
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5665
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5121
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5507
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5537
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5700
18/11/12 12:27:17 INFO TaskSetManager: Starting task 0.0 in stage 201.0 (TID 398, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:17 INFO DAGScheduler: ShuffleMapStage 199 (take at Classifier.scala:111) finished in 0.084 s
18/11/12 12:27:17 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:17 INFO DAGScheduler: running: Set(ResultStage 201)
18/11/12 12:27:17 INFO DAGScheduler: waiting: Set(ResultStage 200)
18/11/12 12:27:17 INFO DAGScheduler: failed: Set()
18/11/12 12:27:17 INFO DAGScheduler: Submitting ResultStage 200 (MapPartitionsRDD[936] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:17 INFO Executor: Running task 0.0 in stage 201.0 (TID 398)
18/11/12 12:27:17 INFO BlockManager: Removing RDD 784
18/11/12 12:27:17 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_206 stored as values in memory (estimated size 8.2 KB, free 1982.8 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 784
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4744
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4727
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5643
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5599
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5573
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5725
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5284
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5972
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4673
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5737
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5552
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5797
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5547
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4905
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5690
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5577
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4726
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_206_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1982.8 MB)
18/11/12 12:27:17 INFO BlockManagerInfo: Added broadcast_206_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.9 MB)
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_186_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1998.1 MB)
18/11/12 12:27:17 INFO SparkContext: Created broadcast 206 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5291
18/11/12 12:27:17 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 200 (MapPartitionsRDD[936] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5473
18/11/12 12:27:17 INFO TaskSchedulerImpl: Adding task set 200.0 with 1 tasks
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4960
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4917
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5493
18/11/12 12:27:17 INFO DAGScheduler: Got job 149 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:17 INFO DAGScheduler: Final stage: ResultStage 202 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:17 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_185_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1998.2 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4918
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4644
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5636
18/11/12 12:27:17 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5896
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5531
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5734
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5841
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4696
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5472
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5238
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5720
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5183
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5487
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5701
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5635
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4690
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5428
18/11/12 12:27:17 INFO DAGScheduler: Submitting ResultStage 202 (MapPartitionsRDD[945] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4701
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5204
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5499
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5962
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4754
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5159
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5328
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5566
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5667
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5329
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_200_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1998.4 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5041
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4683
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5002
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5787
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5805
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4637
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4913
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4922
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5468
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4920
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5123
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5024
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5464
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4839
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 47
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5654
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5225
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_170_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 1998.5 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4804
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4561
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5128
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4747
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5910
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_171_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1998.5 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5100
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5848
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5330
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4827
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5747
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4899
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4942
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4791
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5506
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4898
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4861
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4957
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5132
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5960
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5539
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 48
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5445
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5864
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5085
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5006
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5460
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4576
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5898
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4662
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5535
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5512
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4837
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4786
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5574
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5773
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5442
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5713
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4589
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5242
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5015
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5317
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4704
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4789
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4767
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5810
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5585
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5903
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5167
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5312
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5314
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5234
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5110
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5961
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4702
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4976
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5938
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5400
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5679
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5255
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4859
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4991
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5414
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5714
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4642
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5806
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5872
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4816
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5500
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4621
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5928
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5561
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4705
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4794
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5790
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5217
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5681
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5212
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4717
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5857
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5978
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5311
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4941
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5443
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5707
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5485
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5120
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5602
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5609
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5964
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5674
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5218
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5422
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4712
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5826
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5703
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5501
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5356
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5369
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5835
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5221
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5386
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5758
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5392
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5977
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5583
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5837
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4628
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5671
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5158
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4695
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5064
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5754
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5457
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5730
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5704
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5582
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5641
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4813
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5111
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4792
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_203_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1998.5 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4945
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5911
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5241
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5908
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4728
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5890
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4811
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5732
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4749
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5215
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5611
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5768
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4952
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5632
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_163_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1998.7 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5419
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5877
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5096
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5353
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5390
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5248
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5705
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4864
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_178_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1998.8 MB)
18/11/12 12:27:17 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4829
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4614
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5618
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5823
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5285
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4924
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4818
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4887
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5792
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5199
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4578
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5650
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4649
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5348
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4810
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5620
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5738
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5116
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5138
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5476
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4711
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5782
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5405
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5981
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4707
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_199_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1999.0 MB)
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_207 stored as values in memory (estimated size 543.8 KB, free 1987.0 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5429
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5508
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4981
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5497
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4713
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5101
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5708
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5695
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5739
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5058
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4703
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5148
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5572
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5261
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5849
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5676
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4663
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5424
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5166
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5423
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_196_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1999.1 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4760
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5930
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4692
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4613
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5538
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5828
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5191
18/11/12 12:27:17 INFO MemoryStore: Block broadcast_207_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1988.2 MB)
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_173_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1999.3 MB)
18/11/12 12:27:17 INFO BlockManagerInfo: Added broadcast_207_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.1 MB)
18/11/12 12:27:17 INFO SparkContext: Created broadcast 207 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5010
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5080
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5275
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5663
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5426
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4878
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5151
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5490
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5519
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5462
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5819
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5866
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5321
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5368
18/11/12 12:27:17 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 202 (MapPartitionsRDD[945] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4979
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5789
18/11/12 12:27:17 INFO TaskSchedulerImpl: Adding task set 202.0 with 1 tasks
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5492
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4709
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4773
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5644
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5656
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5904
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5444
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4951
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4609
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5884
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5939
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4831
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5756
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5315
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 46
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5836
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4565
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5421
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5118
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4780
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5616
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5817
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4888
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5399
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5178
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4782
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4838
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4700
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5209
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4787
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4937
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5562
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5001
[INFO] [11/12/2018 12:27:17.086] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[12:27:17] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:27:17.090] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_167_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1999.1 MB)
[INFO] [11/12/2018 12:27:17.092] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] All workers have started.
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5459
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5053
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4689
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5254
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5186
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5624
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5258
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4774
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4777
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4567
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5907
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5040
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5094
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5232
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5152
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4757
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4556
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4784
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5062
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5842
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5182
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4988
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4739
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_184_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 1999.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4751
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5112
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5157
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5741
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5378
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5031
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4671
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5757
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5854
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4684
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4635
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4602
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5881
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4710
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5272
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5385
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4996
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4882
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5022
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5786
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4928
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5733
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4910
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5483
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5509
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5550
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4779
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4973
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5488
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5322
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4919
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5683
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5034
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4796
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4697
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5594
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5736
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5181
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5912
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4573
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5063
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4769
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 50
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4840
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5304
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_176_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1999.4 MB)
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5702
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5601
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5968
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_195_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 1999.4 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5446
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5082
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5114
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_188_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 1999.6 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5719
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5433
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_158_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 1999.7 MB)
[INFO] [11/12/2018 12:27:17.105] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [0]	train-error:0.130354
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_168_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 1999.9 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5843
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5081
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5363
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4620
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5834
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5288
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5603
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5652
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5745
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5865
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4870
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5088
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5592
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4776
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5932
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5131
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5598
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5523
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4658
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4893
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4801
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5967
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4569
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5902
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5037
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4987
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5014
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5382
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5449
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5696
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4720
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5926
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5682
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5054
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5023
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5540
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5814
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5597
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4579
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_156_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 2000.0 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5685
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5689
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5486
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5171
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5197
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5398
18/11/12 12:27:17 INFO BlockManager: Removing RDD 843
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 843
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5279
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5162
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5886
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4923
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5038
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5458
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5874
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5334
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5396
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4846
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5083
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4907
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5350
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4768
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5793
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4889
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_161_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.2 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5098
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5071
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4603
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5438
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5012
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5075
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5211
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4627
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5876
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5263
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5256
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5883
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5935
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5188
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5403
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4830
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4607
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5295
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5524
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5723
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5645
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5187
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4900
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5194
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4600
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5943
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4605
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4559
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5076
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4761
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5233
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5193
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5673
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5822
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5273
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5324
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5759
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5831
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5313
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4986
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5367
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5051
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5595
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_187_piece0 on 127.0.0.1:61956 in memory (size: 150.4 KB, free: 2000.3 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5351
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5119
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5250
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5788
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4955
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4615
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5308
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5164
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5534
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4752
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4699
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4897
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5761
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5751
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4558
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4949
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4884
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5417
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4682
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5136
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4929
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5318
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5410
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4575
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5557
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5520
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5470
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5852
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4812
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5542
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5905
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4724
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5056
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5584
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5481
[INFO] [11/12/2018 12:27:17.116] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [1]	train-error:0.130354
18/11/12 12:27:17 INFO BlockManager: Removing RDD 733
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 733
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5454
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5753
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5801
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4652
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5133
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4636
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_174_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.5 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5416
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5048
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5007
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5856
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5892
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5262
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4795
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4572
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5236
18/11/12 12:27:17 INFO ContextCleaner: Cleaned shuffle 44
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5567
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4825
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4814
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5536
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4793
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4885
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4677
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4742
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4740
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5389
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5521
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4836
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5168
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5149
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5975
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_160_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.6 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5161
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4999
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4650
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5863
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5434
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5879
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5640
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4664
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4775
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4875
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5394
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4982
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4625
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5335
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5077
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_159_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2000.6 MB)
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5812
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5976
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4766
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4944
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5514
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5163
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5160
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5936
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5301
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4860
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4785
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4931
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4755
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5467
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4995
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5847
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5933
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5065
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5267
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5722
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5783
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4638
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4601
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4759
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5144
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5729
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5371
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5025
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4585
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4679
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5724
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5816
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4732
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4631
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4946
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5586
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4719
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4815
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4932
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5680
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5319
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4667
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4588
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5660
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5287
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4977
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5439
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5011
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5527
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5231
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4939
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4665
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4968
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5154
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4921
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5684
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4930
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5959
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5769
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5815
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5106
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5393
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5649
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5664
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5461
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5533
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4676
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5675
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_201_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2000.6 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5850
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4653
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4891
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5005
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5202
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5266
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4877
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5631
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5716
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4608
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5963
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4721
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5931
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5781
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5143
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4657
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4826
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5013
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5366
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5344
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5767
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4912
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5349
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4867
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4788
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5235
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5060
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5474
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5840
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5678
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5575
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5621
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5858
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5924
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5545
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5549
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5917
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4866
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5623
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5554
18/11/12 12:27:17 INFO BlockManager: Removing RDD 851
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 851
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4781
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5906
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4972
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4581
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5244
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4993
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5092
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5622
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4834
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5345
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5970
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5017
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4722
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4854
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5411
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5115
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4828
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4850
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5784
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4822
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4844
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5049
[INFO] [11/12/2018 12:27:17.129] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [2]	train-error:0.126629
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_182_piece0 on 127.0.0.1:61956 in memory (size: 153.1 KB, free: 2000.8 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5795
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5765
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5253
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4845
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4934
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4978
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5588
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5495
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4762
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5224
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5278
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5208
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_202_piece0 on 127.0.0.1:61956 in memory (size: 150.3 KB, free: 2000.9 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5626
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_181_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 2001.1 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4823
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4925
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5407
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5298
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4564
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5441
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5853
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5086
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5517
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4606
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5870
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4617
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4772
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5505
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5028
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5560
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5693
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5070
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5844
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4798
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5379
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4963
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_169_piece0 on 127.0.0.1:61956 in memory (size: 153.0 KB, free: 2001.2 MB)
18/11/12 12:27:17 INFO BlockManager: Removing RDD 886
18/11/12 12:27:17 INFO ContextCleaner: Cleaned RDD 886
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4765
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4948
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5032
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5453
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4597
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4632
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5030
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5548
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5196
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5452
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5437
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5174
[INFO] [11/12/2018 12:27:17.143] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.130354
18/11/12 12:27:17 INFO BlockManagerInfo: Removed broadcast_177_piece0 on 127.0.0.1:61956 in memory (size: 4.1 KB, free: 2001.2 MB)
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 5078
18/11/12 12:27:17 INFO ContextCleaner: Cleaned accumulator 4904
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:17.159] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [4]	train-error:0.130354
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:17.170] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [5]	train-error:0.122905
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:17.182] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [6]	train-error:0.119181
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.193] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [7]	train-error:0.117318
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:17.207] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [8]	train-error:0.113594
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.220] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [9]	train-error:0.111732
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:17.232] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [10]	train-error:0.108007
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:17.240] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [11]	train-error:0.106145
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:17.248] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [12]	train-error:0.100559
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.255] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [13]	train-error:0.096834
[INFO] [11/12/2018 12:27:17.261] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [14]	train-error:0.091248
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:17.268] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [15]	train-error:0.089385
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.275] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [16]	train-error:0.085661
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.291] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [17]	train-error:0.085661
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.304] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [18]	train-error:0.083799
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.317] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [19]	train-error:0.083799
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.330] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [20]	train-error:0.081937
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.345] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [21]	train-error:0.081937
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.359] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [22]	train-error:0.080074
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.372] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/system/IO-TCP/selectors/$a/25] Message [akka.io.SelectionHandler$ChannelReadable$] from Actor[akka://RabitTracker/deadLetters] to Actor[akka://RabitTracker/system/IO-TCP/selectors/$a/25#-1236603941] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [11/12/2018 12:27:17.373] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [23]	train-error:0.078212
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.385] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [24]	train-error:0.074488
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.399] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [25]	train-error:0.076350
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.408] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [26]	train-error:0.074488
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.415] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.070763
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.422] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [28]	train-error:0.068901
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.428] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [29]	train-error:0.068901
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.434] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [30]	train-error:0.067039
[INFO] [11/12/2018 12:27:17.440] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [31]	train-error:0.067039
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.445] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [32]	train-error:0.063315
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.451] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [33]	train-error:0.065177
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.456] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [34]	train-error:0.061453
[INFO] [11/12/2018 12:27:17.462] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [35]	train-error:0.057728
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.468] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [36]	train-error:0.055866
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.473] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [37]	train-error:0.050279
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.484] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [38]	train-error:0.050279
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.495] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [39]	train-error:0.048417
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.505] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [40]	train-error:0.042831
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.516] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [41]	train-error:0.044693
[INFO] [11/12/2018 12:27:17.533] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [42]	train-error:0.039106
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.544] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [43]	train-error:0.035382
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.556] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [44]	train-error:0.033520
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.572] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [45]	train-error:0.033520
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.590] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [46]	train-error:0.033520
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.600] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [47]	train-error:0.033520
[INFO] [11/12/2018 12:27:17.609] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [48]	train-error:0.033520
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.618] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [49]	train-error:0.033520
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.625] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [50]	train-error:0.033520
[INFO] [11/12/2018 12:27:17.631] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [51]	train-error:0.031657
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.637] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [52]	train-error:0.031657
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.642] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [53]	train-error:0.031657
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.648] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [54]	train-error:0.031657
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.653] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [55]	train-error:0.031657
[INFO] [11/12/2018 12:27:17.659] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [56]	train-error:0.031657
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.664] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [57]	train-error:0.031657
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.670] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [58]	train-error:0.029795
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.676] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [59]	train-error:0.027933
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.686] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [60]	train-error:0.027933
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.698] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [61]	train-error:0.027933
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.706] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [62]	train-error:0.024209
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.718] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [63]	train-error:0.024209
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.731] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [64]	train-error:0.024209
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.742] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [65]	train-error:0.024209
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.754] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [66]	train-error:0.024209
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.767] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [67]	train-error:0.024209
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.779] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [68]	train-error:0.018622
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.794] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [69]	train-error:0.016760
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.808] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [70]	train-error:0.016760
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.815] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [71]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.822] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [72]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.829] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [73]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.835] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [74]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.841] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [75]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.849] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [76]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.855] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [77]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.860] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [78]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.868] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [79]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.874] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [80]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.882] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [81]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.894] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [82]	train-error:0.014898
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.908] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [83]	train-error:0.013035
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.921] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [84]	train-error:0.011173
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.934] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [85]	train-error:0.011173
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.949] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [86]	train-error:0.011173
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.961] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [87]	train-error:0.011173
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.974] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [88]	train-error:0.011173
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:17.991] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [89]	train-error:0.009311
[12:27:17] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.005] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [90]	train-error:0.009311
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.021] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [91]	train-error:0.009311
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.030] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [92]	train-error:0.007449
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.046] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [93]	train-error:0.007449
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.054] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [94]	train-error:0.007449
[INFO] [11/12/2018 12:27:18.062] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [95]	train-error:0.007449
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.068] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [96]	train-error:0.005587
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.074] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [97]	train-error:0.005587
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.083] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [98]	train-error:0.003724
[12:27:18] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:18.095] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [99]	train-error:0.003724
18/11/12 12:27:20 INFO MemoryStore: Block rdd_937_0 stored as values in memory (estimated size 584.0 B, free 1997.8 MB)
18/11/12 12:27:20 INFO BlockManagerInfo: Added rdd_937_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 2001.2 MB)
18/11/12 12:27:20 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:20 INFO Executor: 1 block locks were not released by TID = 398:
[rdd_937_0]
18/11/12 12:27:20 INFO Executor: Finished task 0.0 in stage 201.0 (TID 398). 3428 bytes result sent to driver
18/11/12 12:27:20 INFO TaskSetManager: Starting task 0.0 in stage 200.0 (TID 399, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:20 INFO TaskSetManager: Finished task 0.0 in stage 201.0 (TID 398) in 3053 ms on localhost (executor driver) (1/1)
18/11/12 12:27:20 INFO Executor: Running task 0.0 in stage 200.0 (TID 399)
18/11/12 12:27:20 INFO TaskSchedulerImpl: Removed TaskSet 201.0, whose tasks have all completed, from pool 
18/11/12 12:27:20 INFO DAGScheduler: ResultStage 201 (foreachPartition at XGBoost.scala:287) finished in 3.092 s
18/11/12 12:27:20 INFO DAGScheduler: Job 148 finished: foreachPartition at XGBoost.scala:287, took 3.104324 s
18/11/12 12:27:20 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:20 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:20 INFO Executor: Finished task 0.0 in stage 200.0 (TID 399). 1594 bytes result sent to driver
18/11/12 12:27:20 INFO TaskSetManager: Starting task 0.0 in stage 202.0 (TID 400, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
[INFO] [11/12/2018 12:27:20.105] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:20 INFO Executor: Running task 0.0 in stage 202.0 (TID 400)
18/11/12 12:27:20 INFO TaskSetManager: Finished task 0.0 in stage 200.0 (TID 399) in 2 ms on localhost (executor driver) (1/1)
18/11/12 12:27:20 INFO TaskSchedulerImpl: Removed TaskSet 200.0, whose tasks have all completed, from pool 
18/11/12 12:27:20 INFO DAGScheduler: ResultStage 200 (take at Classifier.scala:111) finished in 3.052 s
18/11/12 12:27:20 INFO DAGScheduler: Job 147 finished: take at Classifier.scala:111, took 3.140491 s
18/11/12 12:27:20 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_aad3bad371eb__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:20 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:27:20.125] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:20.126] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:20.126] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:20] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:20 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:20 INFO DAGScheduler: Got job 150 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:20 INFO DAGScheduler: Final stage: ResultStage 203 (first at XGBoost.scala:352)
18/11/12 12:27:20 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:20 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:20 INFO DAGScheduler: Submitting ResultStage 203 (MapPartitionsRDD[937] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:20.135] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [0]	train-error:0.134892
[INFO] [11/12/2018 12:27:20.136] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:59412
[INFO] [11/12/2018 12:27:20.137] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:20.142] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [1]	train-error:0.127698
18/11/12 12:27:20 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:20 INFO MemoryStore: Block broadcast_208 stored as values in memory (estimated size 543.8 KB, free 1997.3 MB)
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:20 INFO MemoryStore: Block broadcast_208_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1997.1 MB)
18/11/12 12:27:20 INFO BlockManagerInfo: Added broadcast_208_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2001.1 MB)
18/11/12 12:27:20 INFO SparkContext: Created broadcast 208 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:20 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 203 (MapPartitionsRDD[937] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:20 INFO TaskSchedulerImpl: Adding task set 203.0 with 1 tasks
18/11/12 12:27:20 INFO DAGScheduler: Got job 151 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:20 INFO DAGScheduler: Final stage: ResultStage 204 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:20 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:20 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:20 INFO DAGScheduler: Submitting ResultStage 204 (MapPartitionsRDD[953] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:20.148] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [2]	train-error:0.111511
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=10
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:20.154] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [3]	train-error:0.120504
[INFO] [11/12/2018 12:27:20.161] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [4]	train-error:0.111511
18/11/12 12:27:20 INFO MemoryStore: Block broadcast_209 stored as values in memory (estimated size 543.8 KB, free 1996.6 MB)
18/11/12 12:27:20 INFO MemoryStore: Block broadcast_209_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1996.4 MB)
18/11/12 12:27:20 INFO BlockManagerInfo: Added broadcast_209_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2000.9 MB)
18/11/12 12:27:20 INFO SparkContext: Created broadcast 209 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:20 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 204 (MapPartitionsRDD[953] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:20 INFO TaskSchedulerImpl: Adding task set 204.0 with 1 tasks
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:20.166] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [5]	train-error:0.113309
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:20.172] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [6]	train-error:0.116906
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:20.177] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [7]	train-error:0.107914
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:20.183] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [8]	train-error:0.106115
[INFO] [11/12/2018 12:27:20.189] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [9]	train-error:0.106115
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:20.195] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [10]	train-error:0.098921
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=11
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.201] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [11]	train-error:0.098921
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:20.206] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [12]	train-error:0.100719
[INFO] [11/12/2018 12:27:20.211] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [13]	train-error:0.093525
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:20.217] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [14]	train-error:0.097122
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:20.222] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [15]	train-error:0.091727
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:20.228] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [16]	train-error:0.091727
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:20.234] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [17]	train-error:0.088129
[INFO] [11/12/2018 12:27:20.240] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [18]	train-error:0.084532
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.245] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.084532
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=11
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.250] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [20]	train-error:0.082734
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.256] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [21]	train-error:0.080935
[INFO] [11/12/2018 12:27:20.261] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [22]	train-error:0.077338
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.267] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [23]	train-error:0.075540
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.272] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [24]	train-error:0.075540
[INFO] [11/12/2018 12:27:20.277] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [25]	train-error:0.073741
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.282] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [26]	train-error:0.068345
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.287] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.064748
[INFO] [11/12/2018 12:27:20.292] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28]	train-error:0.062950
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.298] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [29]	train-error:0.061151
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.302] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [30]	train-error:0.059353
[INFO] [11/12/2018 12:27:20.308] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [31]	train-error:0.055755
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.315] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [32]	train-error:0.055755
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.323] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [33]	train-error:0.052158
[INFO] [11/12/2018 12:27:20.330] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [34]	train-error:0.053957
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.340] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [35]	train-error:0.048561
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.352] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [36]	train-error:0.048561
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.365] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [37]	train-error:0.044964
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.375] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [38]	train-error:0.044964
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.386] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [39]	train-error:0.041367
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.398] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [40]	train-error:0.041367
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.403] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [41]	train-error:0.039568
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.412] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [42]	train-error:0.037770
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.420] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [43]	train-error:0.037770
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.426] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [44]	train-error:0.037770
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.435] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.037770
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.441] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [46]	train-error:0.037770
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.450] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [47]	train-error:0.035971
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.456] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [48]	train-error:0.032374
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.461] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [49]	train-error:0.032374
[INFO] [11/12/2018 12:27:20.466] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [50]	train-error:0.032374
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.471] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [51]	train-error:0.030576
[INFO] [11/12/2018 12:27:20.476] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [52]	train-error:0.030576
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.481] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [53]	train-error:0.032374
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.486] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [54]	train-error:0.023381
[INFO] [11/12/2018 12:27:20.490] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [55]	train-error:0.023381
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.494] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [56]	train-error:0.021583
[INFO] [11/12/2018 12:27:20.498] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [57]	train-error:0.021583
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.502] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [58]	train-error:0.019784
[INFO] [11/12/2018 12:27:20.505] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [59]	train-error:0.019784
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.509] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [60]	train-error:0.017986
[INFO] [11/12/2018 12:27:20.513] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [61]	train-error:0.016187
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.519] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [62]	train-error:0.016187
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.526] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [63]	train-error:0.016187
[INFO] [11/12/2018 12:27:20.532] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [64]	train-error:0.012590
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.541] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [65]	train-error:0.010791
[INFO] [11/12/2018 12:27:20.546] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [66]	train-error:0.008993
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.556] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [67]	train-error:0.007194
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.564] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [68]	train-error:0.005396
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.570] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [69]	train-error:0.007194
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.578] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [70]	train-error:0.005396
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.587] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [71]	train-error:0.003597
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.595] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [72]	train-error:0.003597
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.603] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [73]	train-error:0.003597
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.611] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [74]	train-error:0.003597
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.617] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [75]	train-error:0.003597
[INFO] [11/12/2018 12:27:20.624] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [76]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.633] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [77]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.639] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [78]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.644] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [79]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.648] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [80]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.653] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [81]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.657] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.661] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [83]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.665] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [84]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.668] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [85]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.672] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [86]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.676] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [87]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.680] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [88]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.684] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [89]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.688] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [90]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.692] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [91]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.696] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [92]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.699] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [93]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.703] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [94]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.707] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [95]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.711] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [96]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:20.714] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [97]	train-error:0.001799
[INFO] [11/12/2018 12:27:20.718] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [98]	train-error:0.001799
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:20] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:20.723] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [99]	train-error:0.001799
[INFO] [11/12/2018 12:27:22.727] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:22 INFO MemoryStore: Block rdd_945_0 stored as values in memory (estimated size 584.0 B, free 1996.4 MB)
18/11/12 12:27:22 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:22 INFO BlockManagerInfo: Added rdd_945_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 2000.9 MB)
18/11/12 12:27:22 INFO Executor: 1 block locks were not released by TID = 400:
[rdd_945_0]
18/11/12 12:27:22 INFO Executor: Finished task 0.0 in stage 202.0 (TID 400). 3428 bytes result sent to driver
18/11/12 12:27:22 INFO TaskSetManager: Starting task 0.0 in stage 203.0 (TID 401, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:22 INFO Executor: Running task 0.0 in stage 203.0 (TID 401)
18/11/12 12:27:22 INFO TaskSetManager: Finished task 0.0 in stage 202.0 (TID 400) in 2620 ms on localhost (executor driver) (1/1)
18/11/12 12:27:22 INFO TaskSchedulerImpl: Removed TaskSet 202.0, whose tasks have all completed, from pool 
18/11/12 12:27:22 INFO DAGScheduler: ResultStage 202 (foreachPartition at XGBoost.scala:287) finished in 5.669 s
18/11/12 12:27:22 INFO DAGScheduler: Job 149 finished: foreachPartition at XGBoost.scala:287, took 5.672170 s
18/11/12 12:27:22 INFO BlockManager: Found block rdd_937_0 locally
18/11/12 12:27:22 INFO Executor: 1 block locks were not released by TID = 401:
[rdd_937_0]
18/11/12 12:27:22 INFO Executor: Finished task 0.0 in stage 203.0 (TID 401). 247215 bytes result sent to driver
18/11/12 12:27:22 INFO TaskSetManager: Starting task 0.0 in stage 204.0 (TID 402, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:22 INFO Executor: Running task 0.0 in stage 204.0 (TID 402)
18/11/12 12:27:22 INFO TaskSetManager: Finished task 0.0 in stage 203.0 (TID 401) in 13 ms on localhost (executor driver) (1/1)
18/11/12 12:27:22 INFO TaskSchedulerImpl: Removed TaskSet 203.0, whose tasks have all completed, from pool 
18/11/12 12:27:22 INFO DAGScheduler: ResultStage 203 (first at XGBoost.scala:352) finished in 2.606 s
18/11/12 12:27:22 INFO DAGScheduler: Job 150 finished: first at XGBoost.scala:352, took 2.607234 s
18/11/12 12:27:22 INFO MapPartitionsRDD: Removing RDD 937 from persistence list
18/11/12 12:27:22 INFO BlockManager: Removing RDD 937
18/11/12 12:27:22 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:22 INFO DAGScheduler: Got job 152 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:22 INFO DAGScheduler: Final stage: ResultStage 205 (first at XGBoost.scala:352)
18/11/12 12:27:22 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:22 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:22 INFO DAGScheduler: Submitting ResultStage 205 (MapPartitionsRDD[945] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:22 INFO BlockManager: Found block rdd_184_0 locally
[INFO] [11/12/2018 12:27:22.759] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:22.760] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:22.760] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:22] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:27:22.767] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [0]	train-error:0.150870
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=9
18/11/12 12:27:22 INFO MemoryStore: Block broadcast_210 stored as values in memory (estimated size 543.8 KB, free 1995.9 MB)
18/11/12 12:27:22 INFO MemoryStore: Block broadcast_210_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1995.8 MB)
18/11/12 12:27:22 INFO BlockManagerInfo: Added broadcast_210_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2000.8 MB)
18/11/12 12:27:22 INFO SparkContext: Created broadcast 210 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:22 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 205 (MapPartitionsRDD[945] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:22 INFO TaskSchedulerImpl: Adding task set 205.0 with 1 tasks
18/11/12 12:27:22 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:22 INFO DAGScheduler: Registering RDD 958 (take at Classifier.scala:111)
18/11/12 12:27:22 INFO DAGScheduler: Got job 153 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:22 INFO DAGScheduler: Final stage: ResultStage 207 (take at Classifier.scala:111)
18/11/12 12:27:22 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 206)
18/11/12 12:27:22 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 206)
18/11/12 12:27:22 INFO DAGScheduler: Submitting ShuffleMapStage 206 (MapPartitionsRDD[958] at take at Classifier.scala:111), which has no missing parents
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:22.772] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [1]	train-error:0.148936
[INFO] [11/12/2018 12:27:22.776] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [2]	train-error:0.150870
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:22 INFO MemoryStore: Block broadcast_211 stored as values in memory (estimated size 537.6 KB, free 1995.2 MB)
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=11
18/11/12 12:27:22 INFO MemoryStore: Block broadcast_211_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1995.1 MB)
18/11/12 12:27:22 INFO BlockManagerInfo: Added broadcast_211_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 2000.6 MB)
18/11/12 12:27:22 INFO SparkContext: Created broadcast 211 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:22 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 206 (MapPartitionsRDD[958] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:22 INFO TaskSchedulerImpl: Adding task set 206.0 with 1 tasks
[INFO] [11/12/2018 12:27:22.780] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [3]	train-error:0.139265
[INFO] [11/12/2018 12:27:22.784] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [4]	train-error:0.139265
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=10
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:22.787] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [5]	train-error:0.137331
[INFO] [11/12/2018 12:27:22.791] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [6]	train-error:0.133462
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:22.795] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [7]	train-error:0.133462
[INFO] [11/12/2018 12:27:22.799] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [8]	train-error:0.129594
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:22.802] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [9]	train-error:0.125725
[INFO] [11/12/2018 12:27:22.806] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [10]	train-error:0.125725
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.809] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [11]	train-error:0.123791
[INFO] [11/12/2018 12:27:22.813] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [12]	train-error:0.117988
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=11
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:22.817] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [13]	train-error:0.116054
[INFO] [11/12/2018 12:27:22.820] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [14]	train-error:0.112186
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.824] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [15]	train-error:0.108317
[INFO] [11/12/2018 12:27:22.828] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [16]	train-error:0.098646
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.831] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [17]	train-error:0.104449
[INFO] [11/12/2018 12:27:22.835] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [18]	train-error:0.102515
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:22.839] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.098646
[INFO] [11/12/2018 12:27:22.843] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [20]	train-error:0.094778
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.846] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [21]	train-error:0.088975
[INFO] [11/12/2018 12:27:22.850] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [22]	train-error:0.085106
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:22.854] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [23]	train-error:0.083172
[INFO] [11/12/2018 12:27:22.858] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [24]	train-error:0.083172
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.862] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [25]	train-error:0.081238
[INFO] [11/12/2018 12:27:22.866] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.077369
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.870] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [27]	train-error:0.073501
[INFO] [11/12/2018 12:27:22.874] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [28]	train-error:0.071567
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.878] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [29]	train-error:0.069632
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.881] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [30]	train-error:0.063830
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.887] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [31]	train-error:0.063830
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.891] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [32]	train-error:0.063830
[INFO] [11/12/2018 12:27:22.895] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [33]	train-error:0.061896
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.899] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [34]	train-error:0.061896
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.903] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [35]	train-error:0.061896
[INFO] [11/12/2018 12:27:22.906] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [36]	train-error:0.061896
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.910] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [37]	train-error:0.058027
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.914] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [38]	train-error:0.058027
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.918] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [39]	train-error:0.056093
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.921] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [40]	train-error:0.056093
[INFO] [11/12/2018 12:27:22.924] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [41]	train-error:0.054159
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.927] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [42]	train-error:0.048356
[INFO] [11/12/2018 12:27:22.931] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [43]	train-error:0.042553
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.935] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [44]	train-error:0.042553
[INFO] [11/12/2018 12:27:22.939] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [45]	train-error:0.038685
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.943] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [46]	train-error:0.038685
[INFO] [11/12/2018 12:27:22.947] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [47]	train-error:0.038685
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.953] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [48]	train-error:0.036750
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.958] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [49]	train-error:0.030948
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.964] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [50]	train-error:0.030948
[INFO] [11/12/2018 12:27:22.969] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [51]	train-error:0.029014
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.976] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [52]	train-error:0.027079
[INFO] [11/12/2018 12:27:22.983] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [53]	train-error:0.025145
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:22.990] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [54]	train-error:0.019342
[INFO] [11/12/2018 12:27:22.995] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [55]	train-error:0.017408
[12:27:22] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.003] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [56]	train-error:0.015474
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.010] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [57]	train-error:0.013540
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.017] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [58]	train-error:0.009671
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.024] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [59]	train-error:0.009671
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.030] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [60]	train-error:0.009671
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.037] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [61]	train-error:0.007737
[INFO] [11/12/2018 12:27:23.043] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [62]	train-error:0.007737
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.051] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [63]	train-error:0.007737
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.058] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [64]	train-error:0.007737
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.067] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [65]	train-error:0.005803
[INFO] [11/12/2018 12:27:23.076] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [66]	train-error:0.003868
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.084] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [67]	train-error:0.003868
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.092] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [68]	train-error:0.003868
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.101] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [69]	train-error:0.003868
[INFO] [11/12/2018 12:27:23.109] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [70]	train-error:0.003868
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.120] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [71]	train-error:0.001934
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.125] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.001934
[INFO] [11/12/2018 12:27:23.130] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [73]	train-error:0.001934
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.135] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [74]	train-error:0.001934
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.140] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.146] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[INFO] [11/12/2018 12:27:23.151] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.160] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.170] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.176] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.182] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.190] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.198] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.206] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.214] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[INFO] [11/12/2018 12:27:23.223] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.230] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.239] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:23.248] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[INFO] [11/12/2018 12:27:23.257] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:23.265] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.275] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[INFO] [11/12/2018 12:27:23.280] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.286] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.291] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[INFO] [11/12/2018 12:27:23.296] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.301] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[12:27:23] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:23.306] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[INFO] [11/12/2018 12:27:23.310] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
18/11/12 12:27:25 INFO MemoryStore: Block rdd_953_0 stored as values in memory (estimated size 584.0 B, free 1995.1 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added rdd_953_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 2000.6 MB)
18/11/12 12:27:25 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:25 INFO Executor: 1 block locks were not released by TID = 402:
[rdd_953_0]
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 204.0 (TID 402). 3428 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 205.0 (TID 403, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 205.0 (TID 403)
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 204.0 (TID 402) in 2575 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 204.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO DAGScheduler: ResultStage 204 (foreachPartition at XGBoost.scala:287) finished in 5.167 s
18/11/12 12:27:25 INFO DAGScheduler: Job 151 finished: foreachPartition at XGBoost.scala:287, took 5.172105 s
[INFO] [11/12/2018 12:27:25.314] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:25 INFO BlockManager: Found block rdd_945_0 locally
18/11/12 12:27:25 INFO Executor: 1 block locks were not released by TID = 403:
[rdd_945_0]
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 205.0 (TID 403). 254988 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 206.0 (TID 404, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 206.0 (TID 404)
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 205.0 (TID 403) in 9 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 205.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO DAGScheduler: ResultStage 205 (first at XGBoost.scala:352) finished in 2.570 s
18/11/12 12:27:25 INFO DAGScheduler: Job 152 finished: first at XGBoost.scala:352, took 2.572377 s
18/11/12 12:27:25 INFO MapPartitionsRDD: Removing RDD 945 from persistence list
18/11/12 12:27:25 INFO BlockManager: Removing RDD 945
18/11/12 12:27:25 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:25 INFO DAGScheduler: Got job 154 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:25 INFO DAGScheduler: Final stage: ResultStage 208 (first at XGBoost.scala:352)
18/11/12 12:27:25 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:25 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:25 INFO DAGScheduler: Submitting ResultStage 208 (MapPartitionsRDD[953] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:25 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 206.0 (TID 404). 3861 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 206.0 (TID 404) in 24 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 206.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_212 stored as values in memory (estimated size 543.8 KB, free 1994.6 MB)
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_212_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1994.4 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_212_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 2000.5 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 212 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 208 (MapPartitionsRDD[953] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 208.0 with 1 tasks
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 208.0 (TID 405, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:25 INFO DAGScheduler: ShuffleMapStage 206 (take at Classifier.scala:111) finished in 2.583 s
18/11/12 12:27:25 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:25 INFO DAGScheduler: running: Set(ResultStage 208)
18/11/12 12:27:25 INFO DAGScheduler: waiting: Set(ResultStage 207)
18/11/12 12:27:25 INFO DAGScheduler: failed: Set()
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 208.0 (TID 405)
18/11/12 12:27:25 INFO DAGScheduler: Submitting ResultStage 207 (MapPartitionsRDD[962] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_213 stored as values in memory (estimated size 8.2 KB, free 1994.4 MB)
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_213_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1994.4 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_213_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 2000.5 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 213 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 207 (MapPartitionsRDD[962] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 207.0 with 1 tasks
18/11/12 12:27:25 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:25 INFO DAGScheduler: Registering RDD 967 (take at Classifier.scala:111)
18/11/12 12:27:25 INFO DAGScheduler: Got job 155 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:25 INFO DAGScheduler: Final stage: ResultStage 210 (take at Classifier.scala:111)
18/11/12 12:27:25 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 209)
18/11/12 12:27:25 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 209)
18/11/12 12:27:25 INFO DAGScheduler: Submitting ShuffleMapStage 209 (MapPartitionsRDD[967] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:25 INFO BlockManager: Found block rdd_953_0 locally
18/11/12 12:27:25 INFO Executor: 1 block locks were not released by TID = 405:
[rdd_953_0]
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 208.0 (TID 405). 248302 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 207.0 (TID 406, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 207.0 (TID 406)
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 208.0 (TID 405) in 22 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 208.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:25 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 207.0 (TID 406). 1594 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 207.0 (TID 406) in 7 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 207.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_214 stored as values in memory (estimated size 537.6 KB, free 1993.9 MB)
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_214_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1993.7 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_214_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 2000.3 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 214 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 209 (MapPartitionsRDD[967] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 209.0 with 1 tasks
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 209.0 (TID 407, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:25 INFO DAGScheduler: ResultStage 208 (first at XGBoost.scala:352) finished in 0.046 s
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 209.0 (TID 407)
18/11/12 12:27:25 INFO DAGScheduler: Job 154 finished: first at XGBoost.scala:352, took 0.047005 s
18/11/12 12:27:25 INFO MapPartitionsRDD: Removing RDD 953 from persistence list
18/11/12 12:27:25 INFO DAGScheduler: ResultStage 207 (take at Classifier.scala:111) finished in 0.029 s
18/11/12 12:27:25 INFO DAGScheduler: Job 153 finished: take at Classifier.scala:111, took 2.614078 s
18/11/12 12:27:25 INFO BlockManager: Removing RDD 953
18/11/12 12:27:25 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_a883ed8b6b7e__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:25 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 209.0 (TID 407). 3861 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 209.0 (TID 407) in 23 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 209.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO DAGScheduler: ShuffleMapStage 209 (take at Classifier.scala:111) finished in 0.045 s
18/11/12 12:27:25 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:25 INFO DAGScheduler: running: Set()
18/11/12 12:27:25 INFO DAGScheduler: waiting: Set(ResultStage 210)
18/11/12 12:27:25 INFO DAGScheduler: failed: Set()
18/11/12 12:27:25 INFO DAGScheduler: Submitting ResultStage 210 (MapPartitionsRDD[971] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_215 stored as values in memory (estimated size 8.2 KB, free 1993.7 MB)
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_215_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1993.7 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_215_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 2000.3 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 215 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 210 (MapPartitionsRDD[971] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 210.0 with 1 tasks
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 210.0 (TID 408, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 210.0 (TID 408)
18/11/12 12:27:25 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:25 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 210.0 (TID 408). 1594 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 210.0 (TID 408) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 210.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO DAGScheduler: ResultStage 210 (take at Classifier.scala:111) finished in 0.006 s
18/11/12 12:27:25 INFO DAGScheduler: Job 155 finished: take at Classifier.scala:111, took 0.052681 s
18/11/12 12:27:25 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_2716ba4322a8__labelCol since numClasses was not specified in the column metadata.
[INFO] [11/12/2018 12:27:25.417] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:34176
[INFO] [11/12/2018 12:27:25.417] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:25 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:25 INFO DAGScheduler: Registering RDD 983 (take at Classifier.scala:111)
18/11/12 12:27:25 INFO DAGScheduler: Got job 156 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:25 INFO DAGScheduler: Final stage: ResultStage 212 (take at Classifier.scala:111)
18/11/12 12:27:25 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 211)
18/11/12 12:27:25 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 211)
18/11/12 12:27:25 INFO DAGScheduler: Submitting ShuffleMapStage 211 (MapPartitionsRDD[983] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:25 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_216 stored as values in memory (estimated size 537.6 KB, free 1993.2 MB)
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_216_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1993.0 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_216_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 2000.2 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 216 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 211 (MapPartitionsRDD[983] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 211.0 with 1 tasks
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 211.0 (TID 409, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:25 INFO DAGScheduler: Got job 157 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:25 INFO DAGScheduler: Final stage: ResultStage 213 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:25 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 211.0 (TID 409)
18/11/12 12:27:25 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:25 INFO DAGScheduler: Submitting ResultStage 213 (MapPartitionsRDD[988] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:25.437] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:52621
[INFO] [11/12/2018 12:27:25.437] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:25 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:25 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_217 stored as values in memory (estimated size 543.8 KB, free 1992.5 MB)
18/11/12 12:27:25 INFO Executor: Finished task 0.0 in stage 211.0 (TID 409). 3861 bytes result sent to driver
18/11/12 12:27:25 INFO TaskSetManager: Finished task 0.0 in stage 211.0 (TID 409) in 17 ms on localhost (executor driver) (1/1)
18/11/12 12:27:25 INFO TaskSchedulerImpl: Removed TaskSet 211.0, whose tasks have all completed, from pool 
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_217_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1992.4 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_217_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 2000.0 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 217 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 213 (MapPartitionsRDD[988] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 213.0 with 1 tasks
18/11/12 12:27:25 INFO TaskSetManager: Starting task 0.0 in stage 213.0 (TID 410, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:25 INFO DAGScheduler: Got job 158 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:25 INFO DAGScheduler: Final stage: ResultStage 214 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:25 INFO Executor: Running task 0.0 in stage 213.0 (TID 410)
18/11/12 12:27:25 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:25 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:25 INFO DAGScheduler: Submitting ResultStage 214 (MapPartitionsRDD[996] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_218 stored as values in memory (estimated size 543.8 KB, free 1991.8 MB)
18/11/12 12:27:25 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_218_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1991.7 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_218_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.9 MB)
18/11/12 12:27:25 INFO SparkContext: Created broadcast 218 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 214 (MapPartitionsRDD[996] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 214.0 with 1 tasks
18/11/12 12:27:25 INFO DAGScheduler: ShuffleMapStage 211 (take at Classifier.scala:111) finished in 0.049 s
18/11/12 12:27:25 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:25 INFO DAGScheduler: running: Set(ResultStage 213, ResultStage 214)
18/11/12 12:27:25 INFO DAGScheduler: waiting: Set(ResultStage 212)
18/11/12 12:27:25 INFO DAGScheduler: failed: Set()
18/11/12 12:27:25 INFO DAGScheduler: Submitting ResultStage 212 (MapPartitionsRDD[987] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_219 stored as values in memory (estimated size 8.2 KB, free 1991.7 MB)
[12:27:25] Tree method is automatically selected to be 'approx' for distributed training.
18/11/12 12:27:25 INFO MemoryStore: Block broadcast_219_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1991.7 MB)
18/11/12 12:27:25 INFO BlockManagerInfo: Added broadcast_219_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1999.9 MB)
[INFO] [11/12/2018 12:27:25.472] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:25.473] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:25.473] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
18/11/12 12:27:25 INFO SparkContext: Created broadcast 219 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:25 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 212 (MapPartitionsRDD[987] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:25 INFO TaskSchedulerImpl: Adding task set 212.0 with 1 tasks
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.476] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [0]	train-error:0.175047
[INFO] [11/12/2018 12:27:25.477] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [1]	train-error:0.169460
[INFO] [11/12/2018 12:27:25.479] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [2]	train-error:0.162011
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.481] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.150838
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.483] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [4]	train-error:0.148976
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.484] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [5]	train-error:0.137803
[INFO] [11/12/2018 12:27:25.486] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.139665
[INFO] [11/12/2018 12:27:25.488] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [7]	train-error:0.135940
[INFO] [11/12/2018 12:27:25.490] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [8]	train-error:0.135940
[INFO] [11/12/2018 12:27:25.491] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [9]	train-error:0.135940
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.493] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [10]	train-error:0.130354
[INFO] [11/12/2018 12:27:25.495] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [11]	train-error:0.126629
[INFO] [11/12/2018 12:27:25.496] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [12]	train-error:0.124767
[INFO] [11/12/2018 12:27:25.498] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [13]	train-error:0.124767
[INFO] [11/12/2018 12:27:25.499] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [14]	train-error:0.124767
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.501] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [15]	train-error:0.124767
[INFO] [11/12/2018 12:27:25.503] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [16]	train-error:0.124767
[INFO] [11/12/2018 12:27:25.504] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [17]	train-error:0.124767
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.506] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [18]	train-error:0.109870
[INFO] [11/12/2018 12:27:25.507] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [19]	train-error:0.111732
[INFO] [11/12/2018 12:27:25.509] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [20]	train-error:0.108007
[INFO] [11/12/2018 12:27:25.510] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [21]	train-error:0.104283
[INFO] [11/12/2018 12:27:25.512] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [22]	train-error:0.100559
[INFO] [11/12/2018 12:27:25.513] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [23]	train-error:0.100559
[INFO] [11/12/2018 12:27:25.515] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [24]	train-error:0.100559
[INFO] [11/12/2018 12:27:25.516] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [25]	train-error:0.093110
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.518] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [26]	train-error:0.093110
[INFO] [11/12/2018 12:27:25.519] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [27]	train-error:0.093110
[INFO] [11/12/2018 12:27:25.523] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/system/IO-TCP/selectors/$a/30] Message [akka.io.SelectionHandler$ChannelReadable$] from Actor[akka://RabitTracker/deadLetters] to Actor[akka://RabitTracker/system/IO-TCP/selectors/$a/30#800440226] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [11/12/2018 12:27:25.523] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28]	train-error:0.093110
[INFO] [11/12/2018 12:27:25.525] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [29]	train-error:0.091248
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.526] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [30]	train-error:0.087523
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.528] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [31]	train-error:0.087523
[INFO] [11/12/2018 12:27:25.530] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [32]	train-error:0.087523
[INFO] [11/12/2018 12:27:25.532] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [33]	train-error:0.087523
[INFO] [11/12/2018 12:27:25.534] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [34]	train-error:0.085661
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.536] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [35]	train-error:0.087523
[INFO] [11/12/2018 12:27:25.538] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [36]	train-error:0.089385
[INFO] [11/12/2018 12:27:25.541] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [37]	train-error:0.089385
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.544] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [38]	train-error:0.085661
[INFO] [11/12/2018 12:27:25.547] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [39]	train-error:0.087523
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.550] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [40]	train-error:0.087523
[INFO] [11/12/2018 12:27:25.552] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [41]	train-error:0.085661
[INFO] [11/12/2018 12:27:25.556] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [42]	train-error:0.085661
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.558] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [43]	train-error:0.089385
[INFO] [11/12/2018 12:27:25.560] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [44]	train-error:0.089385
[INFO] [11/12/2018 12:27:25.563] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [45]	train-error:0.085661
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.566] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [46]	train-error:0.083799
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.571] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [47]	train-error:0.083799
[INFO] [11/12/2018 12:27:25.573] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [48]	train-error:0.083799
[INFO] [11/12/2018 12:27:25.575] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [49]	train-error:0.081937
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.579] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [50]	train-error:0.080074
[INFO] [11/12/2018 12:27:25.582] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [51]	train-error:0.080074
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.586] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [52]	train-error:0.078212
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.590] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [53]	train-error:0.076350
[INFO] [11/12/2018 12:27:25.596] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [54]	train-error:0.076350
[INFO] [11/12/2018 12:27:25.602] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [55]	train-error:0.074488
[INFO] [11/12/2018 12:27:25.604] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [56]	train-error:0.076350
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.610] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [57]	train-error:0.074488
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.613] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [58]	train-error:0.074488
[INFO] [11/12/2018 12:27:25.615] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [59]	train-error:0.074488
[INFO] [11/12/2018 12:27:25.619] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [60]	train-error:0.072626
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.624] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [61]	train-error:0.072626
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.628] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [62]	train-error:0.070763
[INFO] [11/12/2018 12:27:25.632] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [63]	train-error:0.070763
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.636] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [64]	train-error:0.070763
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.640] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [65]	train-error:0.070763
[INFO] [11/12/2018 12:27:25.642] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [66]	train-error:0.070763
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.647] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [67]	train-error:0.068901
[INFO] [11/12/2018 12:27:25.650] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [68]	train-error:0.068901
[INFO] [11/12/2018 12:27:25.653] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [69]	train-error:0.068901
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.658] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [70]	train-error:0.070763
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.661] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [71]	train-error:0.068901
[INFO] [11/12/2018 12:27:25.664] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [72]	train-error:0.067039
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.668] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [73]	train-error:0.067039
[INFO] [11/12/2018 12:27:25.670] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [74]	train-error:0.067039
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.674] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [75]	train-error:0.067039
[INFO] [11/12/2018 12:27:25.679] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [76]	train-error:0.065177
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.682] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [77]	train-error:0.061453
[INFO] [11/12/2018 12:27:25.685] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [78]	train-error:0.063315
[INFO] [11/12/2018 12:27:25.688] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [79]	train-error:0.061453
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.690] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [80]	train-error:0.061453
[INFO] [11/12/2018 12:27:25.692] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [81]	train-error:0.059590
[INFO] [11/12/2018 12:27:25.694] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [82]	train-error:0.061453
[INFO] [11/12/2018 12:27:25.696] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [83]	train-error:0.059590
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.698] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [84]	train-error:0.057728
[INFO] [11/12/2018 12:27:25.700] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [85]	train-error:0.055866
[INFO] [11/12/2018 12:27:25.702] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [86]	train-error:0.055866
[INFO] [11/12/2018 12:27:25.704] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [87]	train-error:0.055866
[INFO] [11/12/2018 12:27:25.706] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [88]	train-error:0.055866
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.708] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [89]	train-error:0.055866
[INFO] [11/12/2018 12:27:25.710] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [90]	train-error:0.054004
[INFO] [11/12/2018 12:27:25.712] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [91]	train-error:0.054004
[INFO] [11/12/2018 12:27:25.714] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [92]	train-error:0.054004
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.716] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [93]	train-error:0.054004
[INFO] [11/12/2018 12:27:25.718] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [94]	train-error:0.054004
[INFO] [11/12/2018 12:27:25.721] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [95]	train-error:0.054004
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:25.723] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [96]	train-error:0.054004
[INFO] [11/12/2018 12:27:25.725] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [97]	train-error:0.055866
[INFO] [11/12/2018 12:27:25.727] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [98]	train-error:0.055866
[INFO] [11/12/2018 12:27:25.730] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [99]	train-error:0.055866
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:25] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.734] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:27 INFO MemoryStore: Block rdd_988_0 stored as values in memory (estimated size 584.0 B, free 1991.7 MB)
18/11/12 12:27:27 INFO BlockManagerInfo: Added rdd_988_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1999.9 MB)
18/11/12 12:27:27 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:27 INFO Executor: 1 block locks were not released by TID = 410:
[rdd_988_0]
18/11/12 12:27:27 INFO Executor: Finished task 0.0 in stage 213.0 (TID 410). 3428 bytes result sent to driver
18/11/12 12:27:27 INFO TaskSetManager: Starting task 0.0 in stage 212.0 (TID 411, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:27 INFO Executor: Running task 0.0 in stage 212.0 (TID 411)
18/11/12 12:27:27 INFO TaskSetManager: Finished task 0.0 in stage 213.0 (TID 410) in 2280 ms on localhost (executor driver) (1/1)
18/11/12 12:27:27 INFO TaskSchedulerImpl: Removed TaskSet 213.0, whose tasks have all completed, from pool 
18/11/12 12:27:27 INFO DAGScheduler: ResultStage 213 (foreachPartition at XGBoost.scala:287) finished in 2.298 s
18/11/12 12:27:27 INFO DAGScheduler: Job 157 finished: foreachPartition at XGBoost.scala:287, took 2.308695 s
18/11/12 12:27:27 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:27 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:27 INFO Executor: Finished task 0.0 in stage 212.0 (TID 411). 1594 bytes result sent to driver
18/11/12 12:27:27 INFO TaskSetManager: Starting task 0.0 in stage 214.0 (TID 412, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:27 INFO TaskSetManager: Finished task 0.0 in stage 212.0 (TID 411) in 2 ms on localhost (executor driver) (1/1)
18/11/12 12:27:27 INFO Executor: Running task 0.0 in stage 214.0 (TID 412)
18/11/12 12:27:27 INFO TaskSchedulerImpl: Removed TaskSet 212.0, whose tasks have all completed, from pool 
18/11/12 12:27:27 INFO DAGScheduler: ResultStage 212 (take at Classifier.scala:111) finished in 2.266 s
18/11/12 12:27:27 INFO DAGScheduler: Job 156 finished: take at Classifier.scala:111, took 2.316851 s
18/11/12 12:27:27 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_b855e1de5b19__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:27 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:27:27.752] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:27.753] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:27.753] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] All workers have started.
[INFO] [11/12/2018 12:27:27.756] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [0]	train-error:0.169065
[INFO] [11/12/2018 12:27:27.758] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [1]	train-error:0.156475
[12:27:27] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:27 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:27 INFO DAGScheduler: Got job 159 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:27 INFO DAGScheduler: Final stage: ResultStage 215 (first at XGBoost.scala:352)
18/11/12 12:27:27 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:27 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:27 INFO DAGScheduler: Submitting ResultStage 215 (MapPartitionsRDD[988] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.760] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [2]	train-error:0.151079
[INFO] [11/12/2018 12:27:27.761] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:53325
[INFO] [11/12/2018 12:27:27.761] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:27:27.762] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [3]	train-error:0.156475
[INFO] [11/12/2018 12:27:27.764] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [4]	train-error:0.151079
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.766] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [5]	train-error:0.147482
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:27 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:27 INFO MemoryStore: Block broadcast_220 stored as values in memory (estimated size 543.8 KB, free 1991.1 MB)
[INFO] [11/12/2018 12:27:27.770] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [6]	train-error:0.149281
[INFO] [11/12/2018 12:27:27.772] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [7]	train-error:0.143885
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:27 INFO MemoryStore: Block broadcast_220_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1991.0 MB)
18/11/12 12:27:27 INFO BlockManagerInfo: Added broadcast_220_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.7 MB)
18/11/12 12:27:27 INFO SparkContext: Created broadcast 220 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:27 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 215 (MapPartitionsRDD[988] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:27 INFO TaskSchedulerImpl: Adding task set 215.0 with 1 tasks
18/11/12 12:27:27 INFO DAGScheduler: Got job 160 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:27 INFO DAGScheduler: Final stage: ResultStage 216 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:27 INFO DAGScheduler: Parents of final stage: List()
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:27 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:27 INFO DAGScheduler: Submitting ResultStage 216 (MapPartitionsRDD[1004] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.775] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [8]	train-error:0.134892
[INFO] [11/12/2018 12:27:27.777] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [9]	train-error:0.138489
[INFO] [11/12/2018 12:27:27.779] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [10]	train-error:0.134892
[INFO] [11/12/2018 12:27:27.781] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [11]	train-error:0.133094
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.783] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [12]	train-error:0.131295
[INFO] [11/12/2018 12:27:27.785] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [13]	train-error:0.129496
[INFO] [11/12/2018 12:27:27.788] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [14]	train-error:0.131295
18/11/12 12:27:27 INFO MemoryStore: Block broadcast_221 stored as values in memory (estimated size 543.8 KB, free 1990.5 MB)
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:27 INFO MemoryStore: Block broadcast_221_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1990.3 MB)
18/11/12 12:27:27 INFO BlockManagerInfo: Added broadcast_221_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1999.6 MB)
18/11/12 12:27:27 INFO SparkContext: Created broadcast 221 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:27 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 216 (MapPartitionsRDD[1004] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:27 INFO TaskSchedulerImpl: Adding task set 216.0 with 1 tasks
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.791] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [15]	train-error:0.125899
[INFO] [11/12/2018 12:27:27.793] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [16]	train-error:0.125899
[INFO] [11/12/2018 12:27:27.794] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [17]	train-error:0.125899
[INFO] [11/12/2018 12:27:27.796] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [18]	train-error:0.125899
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.798] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [19]	train-error:0.124101
[INFO] [11/12/2018 12:27:27.799] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [20]	train-error:0.125899
[INFO] [11/12/2018 12:27:27.801] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [21]	train-error:0.118705
[INFO] [11/12/2018 12:27:27.803] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [22]	train-error:0.115108
[INFO] [11/12/2018 12:27:27.804] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [23]	train-error:0.116906
[INFO] [11/12/2018 12:27:27.806] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [24]	train-error:0.115108
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.807] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [25]	train-error:0.111511
[INFO] [11/12/2018 12:27:27.809] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [26]	train-error:0.116906
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.810] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.116906
[INFO] [11/12/2018 12:27:27.812] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [28]	train-error:0.116906
[INFO] [11/12/2018 12:27:27.813] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [29]	train-error:0.107914
[INFO] [11/12/2018 12:27:27.815] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [30]	train-error:0.107914
[INFO] [11/12/2018 12:27:27.816] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [31]	train-error:0.107914
[INFO] [11/12/2018 12:27:27.818] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [32]	train-error:0.104317
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.819] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [33]	train-error:0.104317
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.821] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [34]	train-error:0.104317
[INFO] [11/12/2018 12:27:27.822] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [35]	train-error:0.104317
[INFO] [11/12/2018 12:27:27.824] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [36]	train-error:0.106115
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.825] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [37]	train-error:0.104317
[INFO] [11/12/2018 12:27:27.826] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [38]	train-error:0.106115
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.828] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [39]	train-error:0.098921
[INFO] [11/12/2018 12:27:27.829] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [40]	train-error:0.098921
[INFO] [11/12/2018 12:27:27.831] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [41]	train-error:0.097122
[INFO] [11/12/2018 12:27:27.832] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [42]	train-error:0.097122
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.834] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [43]	train-error:0.097122
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.835] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [44]	train-error:0.097122
[INFO] [11/12/2018 12:27:27.837] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.095324
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.838] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [46]	train-error:0.093525
[INFO] [11/12/2018 12:27:27.840] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [47]	train-error:0.093525
[INFO] [11/12/2018 12:27:27.841] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [48]	train-error:0.093525
[INFO] [11/12/2018 12:27:27.842] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [49]	train-error:0.093525
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.844] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [50]	train-error:0.097122
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.846] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [51]	train-error:0.089928
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.847] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [52]	train-error:0.089928
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.848] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [53]	train-error:0.089928
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.850] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [54]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.851] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [55]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.853] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [56]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.854] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [57]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.856] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [58]	train-error:0.089928
[INFO] [11/12/2018 12:27:27.857] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [59]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.859] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [60]	train-error:0.088129
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.860] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [61]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.861] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [62]	train-error:0.088129
[INFO] [11/12/2018 12:27:27.863] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [63]	train-error:0.086331
[INFO] [11/12/2018 12:27:27.864] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [64]	train-error:0.086331
[INFO] [11/12/2018 12:27:27.866] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [65]	train-error:0.086331
[INFO] [11/12/2018 12:27:27.867] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [66]	train-error:0.086331
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.869] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [67]	train-error:0.082734
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.870] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [68]	train-error:0.082734
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.872] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [69]	train-error:0.082734
[INFO] [11/12/2018 12:27:27.873] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [70]	train-error:0.082734
[INFO] [11/12/2018 12:27:27.875] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [71]	train-error:0.082734
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.879] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [72]	train-error:0.080935
[INFO] [11/12/2018 12:27:27.881] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [73]	train-error:0.079137
[INFO] [11/12/2018 12:27:27.882] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [74]	train-error:0.079137
[INFO] [11/12/2018 12:27:27.884] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [75]	train-error:0.077338
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.887] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [76]	train-error:0.077338
[INFO] [11/12/2018 12:27:27.889] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [77]	train-error:0.075540
[INFO] [11/12/2018 12:27:27.891] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [78]	train-error:0.075540
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.893] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [79]	train-error:0.075540
[INFO] [11/12/2018 12:27:27.895] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [80]	train-error:0.075540
[INFO] [11/12/2018 12:27:27.897] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.073741
[INFO] [11/12/2018 12:27:27.899] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [82]	train-error:0.075540
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.900] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [83]	train-error:0.073741
[INFO] [11/12/2018 12:27:27.902] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [84]	train-error:0.073741
[INFO] [11/12/2018 12:27:27.904] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [85]	train-error:0.070144
[INFO] [11/12/2018 12:27:27.905] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [86]	train-error:0.070144
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.907] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [87]	train-error:0.068345
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.909] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [88]	train-error:0.066547
[INFO] [11/12/2018 12:27:27.911] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [89]	train-error:0.064748
[INFO] [11/12/2018 12:27:27.912] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [90]	train-error:0.062950
[INFO] [11/12/2018 12:27:27.914] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [91]	train-error:0.062950
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.916] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [92]	train-error:0.062950
[INFO] [11/12/2018 12:27:27.918] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [93]	train-error:0.062950
[INFO] [11/12/2018 12:27:27.919] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [94]	train-error:0.062950
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.921] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [95]	train-error:0.059353
[INFO] [11/12/2018 12:27:27.923] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [96]	train-error:0.057554
[INFO] [11/12/2018 12:27:27.925] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [97]	train-error:0.057554
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:27] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:27.926] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [98]	train-error:0.059353
[INFO] [11/12/2018 12:27:27.928] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [99]	train-error:0.059353
18/11/12 12:27:29 INFO MemoryStore: Block rdd_996_0 stored as values in memory (estimated size 584.0 B, free 1990.3 MB)
18/11/12 12:27:29 INFO BlockManagerInfo: Added rdd_996_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1999.6 MB)
18/11/12 12:27:29 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:29 INFO Executor: 1 block locks were not released by TID = 412:
[rdd_996_0]
18/11/12 12:27:29 INFO Executor: Finished task 0.0 in stage 214.0 (TID 412). 3428 bytes result sent to driver
18/11/12 12:27:29 INFO TaskSetManager: Starting task 0.0 in stage 215.0 (TID 413, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:29 INFO TaskSetManager: Finished task 0.0 in stage 214.0 (TID 412) in 2196 ms on localhost (executor driver) (1/1)
18/11/12 12:27:29 INFO Executor: Running task 0.0 in stage 215.0 (TID 413)
18/11/12 12:27:29 INFO TaskSchedulerImpl: Removed TaskSet 214.0, whose tasks have all completed, from pool 
18/11/12 12:27:29 INFO DAGScheduler: ResultStage 214 (foreachPartition at XGBoost.scala:287) finished in 4.477 s
18/11/12 12:27:29 INFO DAGScheduler: Job 158 finished: foreachPartition at XGBoost.scala:287, took 4.487417 s
[INFO] [11/12/2018 12:27:29.932] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:29 INFO BlockManager: Found block rdd_988_0 locally
18/11/12 12:27:29 INFO Executor: 1 block locks were not released by TID = 413:
[rdd_988_0]
18/11/12 12:27:29 INFO Executor: Finished task 0.0 in stage 215.0 (TID 413). 59580 bytes result sent to driver
18/11/12 12:27:29 INFO TaskSetManager: Starting task 0.0 in stage 216.0 (TID 414, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:29 INFO Executor: Running task 0.0 in stage 216.0 (TID 414)
18/11/12 12:27:29 INFO TaskSetManager: Finished task 0.0 in stage 215.0 (TID 413) in 10 ms on localhost (executor driver) (1/1)
18/11/12 12:27:29 INFO TaskSchedulerImpl: Removed TaskSet 215.0, whose tasks have all completed, from pool 
18/11/12 12:27:29 INFO DAGScheduler: ResultStage 215 (first at XGBoost.scala:352) finished in 2.185 s
18/11/12 12:27:29 INFO DAGScheduler: Job 159 finished: first at XGBoost.scala:352, took 2.186627 s
18/11/12 12:27:29 INFO MapPartitionsRDD: Removing RDD 988 from persistence list
18/11/12 12:27:29 INFO BlockManager: Removing RDD 988
18/11/12 12:27:29 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:29 INFO DAGScheduler: Got job 161 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:29 INFO DAGScheduler: Final stage: ResultStage 217 (first at XGBoost.scala:352)
18/11/12 12:27:29 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:29 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:29 INFO DAGScheduler: Submitting ResultStage 217 (MapPartitionsRDD[996] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:29 INFO BlockManager: Found block rdd_184_0 locally
[INFO] [11/12/2018 12:27:29.961] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:29.962] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:29.963] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:29] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.966] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [0]	train-error:0.181818
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:29 INFO MemoryStore: Block broadcast_222 stored as values in memory (estimated size 543.8 KB, free 1989.8 MB)
18/11/12 12:27:29 INFO MemoryStore: Block broadcast_222_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1989.6 MB)
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:29 INFO BlockManagerInfo: Added broadcast_222_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.4 MB)
18/11/12 12:27:29 INFO SparkContext: Created broadcast 222 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:29 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 217 (MapPartitionsRDD[996] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:29 INFO TaskSchedulerImpl: Adding task set 217.0 with 1 tasks
18/11/12 12:27:29 INFO SparkContext: Starting job: take at Classifier.scala:111
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:29 INFO DAGScheduler: Registering RDD 1009 (take at Classifier.scala:111)
18/11/12 12:27:29 INFO DAGScheduler: Got job 162 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:29 INFO DAGScheduler: Final stage: ResultStage 219 (take at Classifier.scala:111)
18/11/12 12:27:29 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 218)
18/11/12 12:27:29 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 218)
18/11/12 12:27:29 INFO DAGScheduler: Submitting ShuffleMapStage 218 (MapPartitionsRDD[1009] at take at Classifier.scala:111), which has no missing parents
[INFO] [11/12/2018 12:27:29.969] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [1]	train-error:0.176015
[INFO] [11/12/2018 12:27:29.971] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [2]	train-error:0.158607
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.973] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [3]	train-error:0.152805
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.976] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [4]	train-error:0.145068
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.978] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [5]	train-error:0.150870
[INFO] [11/12/2018 12:27:29.981] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [6]	train-error:0.148936
18/11/12 12:27:29 INFO MemoryStore: Block broadcast_223 stored as values in memory (estimated size 537.6 KB, free 1989.1 MB)
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
18/11/12 12:27:29 INFO MemoryStore: Block broadcast_223_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1989.0 MB)
18/11/12 12:27:29 INFO BlockManagerInfo: Added broadcast_223_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1999.3 MB)
18/11/12 12:27:29 INFO SparkContext: Created broadcast 223 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:29 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 218 (MapPartitionsRDD[1009] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:29 INFO TaskSchedulerImpl: Adding task set 218.0 with 1 tasks
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.983] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [7]	train-error:0.147002
[INFO] [11/12/2018 12:27:29.985] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [8]	train-error:0.148936
[INFO] [11/12/2018 12:27:29.987] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [9]	train-error:0.147002
[INFO] [11/12/2018 12:27:29.988] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [10]	train-error:0.147002
[INFO] [11/12/2018 12:27:29.990] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [11]	train-error:0.145068
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.992] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [12]	train-error:0.145068
[INFO] [11/12/2018 12:27:29.993] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [13]	train-error:0.147002
[INFO] [11/12/2018 12:27:29.995] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [14]	train-error:0.141199
[INFO] [11/12/2018 12:27:29.997] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [15]	train-error:0.139265
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:29] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:29.999] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.139265
[INFO] [11/12/2018 12:27:30.001] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [17]	train-error:0.139265
[INFO] [11/12/2018 12:27:30.002] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [18]	train-error:0.139265
[INFO] [11/12/2018 12:27:30.004] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [19]	train-error:0.139265
[INFO] [11/12/2018 12:27:30.005] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [20]	train-error:0.139265
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.007] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [21]	train-error:0.137331
[INFO] [11/12/2018 12:27:30.009] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [22]	train-error:0.137331
[INFO] [11/12/2018 12:27:30.010] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [23]	train-error:0.133462
[INFO] [11/12/2018 12:27:30.012] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [24]	train-error:0.135397
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.013] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [25]	train-error:0.133462
[INFO] [11/12/2018 12:27:30.015] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [26]	train-error:0.131528
[INFO] [11/12/2018 12:27:30.016] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [27]	train-error:0.131528
[INFO] [11/12/2018 12:27:30.017] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [28]	train-error:0.129594
[INFO] [11/12/2018 12:27:30.019] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [29]	train-error:0.129594
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.020] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [30]	train-error:0.129594
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.022] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [31]	train-error:0.119923
[INFO] [11/12/2018 12:27:30.024] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [32]	train-error:0.116054
[INFO] [11/12/2018 12:27:30.025] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [33]	train-error:0.119923
[INFO] [11/12/2018 12:27:30.027] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [34]	train-error:0.119923
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.029] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [35]	train-error:0.117988
[INFO] [11/12/2018 12:27:30.030] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [36]	train-error:0.119923
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.032] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [37]	train-error:0.119923
[INFO] [11/12/2018 12:27:30.034] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [38]	train-error:0.119923
[INFO] [11/12/2018 12:27:30.036] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [39]	train-error:0.117988
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.038] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [40]	train-error:0.117988
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.040] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [41]	train-error:0.116054
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.041] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [42]	train-error:0.117988
[INFO] [11/12/2018 12:27:30.043] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [43]	train-error:0.117988
[INFO] [11/12/2018 12:27:30.045] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [44]	train-error:0.116054
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.047] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [45]	train-error:0.112186
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.049] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [46]	train-error:0.112186
[INFO] [11/12/2018 12:27:30.051] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [47]	train-error:0.110251
[INFO] [11/12/2018 12:27:30.053] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [48]	train-error:0.108317
[INFO] [11/12/2018 12:27:30.055] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [49]	train-error:0.104449
[INFO] [11/12/2018 12:27:30.057] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [50]	train-error:0.100580
[INFO] [11/12/2018 12:27:30.059] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [51]	train-error:0.098646
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.061] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [52]	train-error:0.094778
[INFO] [11/12/2018 12:27:30.063] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [53]	train-error:0.092843
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.064] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [54]	train-error:0.096712
[INFO] [11/12/2018 12:27:30.066] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [55]	train-error:0.096712
[INFO] [11/12/2018 12:27:30.068] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [56]	train-error:0.096712
[INFO] [11/12/2018 12:27:30.069] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [57]	train-error:0.094778
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.071] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [58]	train-error:0.094778
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.073] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [59]	train-error:0.094778
[INFO] [11/12/2018 12:27:30.074] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [60]	train-error:0.092843
[INFO] [11/12/2018 12:27:30.076] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [61]	train-error:0.090909
[INFO] [11/12/2018 12:27:30.078] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [62]	train-error:0.092843
[INFO] [11/12/2018 12:27:30.079] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [63]	train-error:0.088975
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.081] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [64]	train-error:0.088975
[INFO] [11/12/2018 12:27:30.083] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [65]	train-error:0.088975
[INFO] [11/12/2018 12:27:30.085] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [66]	train-error:0.087041
[INFO] [11/12/2018 12:27:30.087] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [67]	train-error:0.087041
[INFO] [11/12/2018 12:27:30.089] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [68]	train-error:0.087041
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.091] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [69]	train-error:0.087041
[INFO] [11/12/2018 12:27:30.093] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [70]	train-error:0.088975
[INFO] [11/12/2018 12:27:30.095] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [71]	train-error:0.085106
[INFO] [11/12/2018 12:27:30.097] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [72]	train-error:0.085106
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.099] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [73]	train-error:0.085106
[INFO] [11/12/2018 12:27:30.102] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [74]	train-error:0.081238
[INFO] [11/12/2018 12:27:30.104] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [75]	train-error:0.081238
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.107] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [76]	train-error:0.083172
[INFO] [11/12/2018 12:27:30.110] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [77]	train-error:0.081238
[INFO] [11/12/2018 12:27:30.114] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [78]	train-error:0.079304
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.118] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [79]	train-error:0.079304
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.123] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [80]	train-error:0.077369
[INFO] [11/12/2018 12:27:30.127] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [81]	train-error:0.081238
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.129] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [82]	train-error:0.075435
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.132] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [83]	train-error:0.077369
[INFO] [11/12/2018 12:27:30.134] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [84]	train-error:0.075435
[INFO] [11/12/2018 12:27:30.137] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [85]	train-error:0.075435
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.139] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [86]	train-error:0.073501
[INFO] [11/12/2018 12:27:30.141] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [87]	train-error:0.075435
[INFO] [11/12/2018 12:27:30.143] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [88]	train-error:0.075435
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.146] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [89]	train-error:0.077369
[INFO] [11/12/2018 12:27:30.148] [RabitTracker-akka.actor.default-dispatcher-12] [akka://RabitTracker/user/Handler] [90]	train-error:0.075435
[INFO] [11/12/2018 12:27:30.151] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [91]	train-error:0.073501
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 10 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.153] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [92]	train-error:0.071567
[INFO] [11/12/2018 12:27:30.156] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [93]	train-error:0.069632
[INFO] [11/12/2018 12:27:30.159] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [94]	train-error:0.073501
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 6 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.163] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [95]	train-error:0.069632
[INFO] [11/12/2018 12:27:30.166] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [96]	train-error:0.071567
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 8 extra nodes, 0 pruned nodes, max_depth=3
[12:27:30] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3
[INFO] [11/12/2018 12:27:30.168] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [97]	train-error:0.069632
[INFO] [11/12/2018 12:27:30.171] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [98]	train-error:0.069632
[INFO] [11/12/2018 12:27:30.173] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [99]	train-error:0.067698
18/11/12 12:27:32 INFO MemoryStore: Block rdd_1004_0 stored as values in memory (estimated size 584.0 B, free 1989.0 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added rdd_1004_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1999.3 MB)
18/11/12 12:27:32 INFO XGBoostSpark: Rabit returns with exit code 0
[INFO] [11/12/2018 12:27:32.174] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:32 INFO Executor: 1 block locks were not released by TID = 414:
[rdd_1004_0]
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 216.0 (TID 414). 3428 bytes result sent to driver
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 217.0 (TID 415, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 216.0 (TID 414) in 2232 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 217.0 (TID 415)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 216.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO DAGScheduler: ResultStage 216 (foreachPartition at XGBoost.scala:287) finished in 4.399 s
18/11/12 12:27:32 INFO DAGScheduler: Job 160 finished: foreachPartition at XGBoost.scala:287, took 4.403964 s
18/11/12 12:27:32 INFO BlockManager: Found block rdd_996_0 locally
18/11/12 12:27:32 INFO Executor: 1 block locks were not released by TID = 415:
[rdd_996_0]
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 217.0 (TID 415). 56354 bytes result sent to driver
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 218.0 (TID 416, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 218.0 (TID 416)
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 217.0 (TID 415) in 11 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 217.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO DAGScheduler: ResultStage 217 (first at XGBoost.scala:352) finished in 2.232 s
18/11/12 12:27:32 INFO DAGScheduler: Job 161 finished: first at XGBoost.scala:352, took 2.233022 s
18/11/12 12:27:32 INFO MapPartitionsRDD: Removing RDD 996 from persistence list
18/11/12 12:27:32 INFO BlockManager: Removing RDD 996
18/11/12 12:27:32 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:32 INFO DAGScheduler: Got job 163 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:32 INFO DAGScheduler: Final stage: ResultStage 220 (first at XGBoost.scala:352)
18/11/12 12:27:32 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:32 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:32 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:32 INFO DAGScheduler: Submitting ResultStage 220 (MapPartitionsRDD[1004] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 218.0 (TID 416). 3861 bytes result sent to driver
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 218.0 (TID 416) in 18 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 218.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_224 stored as values in memory (estimated size 543.8 KB, free 1988.4 MB)
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_224_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1988.3 MB)
18/11/12 12:27:32 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_224_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1999.1 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 224 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 220 (MapPartitionsRDD[1004] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 220.0 with 1 tasks
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 220.0 (TID 417, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:32 INFO DAGScheduler: ShuffleMapStage 218 (take at Classifier.scala:111) finished in 2.235 s
18/11/12 12:27:32 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 220.0 (TID 417)
18/11/12 12:27:32 INFO DAGScheduler: running: Set(ResultStage 220)
18/11/12 12:27:32 INFO DAGScheduler: waiting: Set(ResultStage 219)
18/11/12 12:27:32 INFO DAGScheduler: failed: Set()
18/11/12 12:27:32 INFO DAGScheduler: Submitting ResultStage 219 (MapPartitionsRDD[1013] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_225 stored as values in memory (estimated size 8.2 KB, free 1988.3 MB)
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_225_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1988.3 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_225_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1999.1 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 225 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 219 (MapPartitionsRDD[1013] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 219.0 with 1 tasks
18/11/12 12:27:32 INFO DAGScheduler: Registering RDD 1018 (take at Classifier.scala:111)
18/11/12 12:27:32 INFO DAGScheduler: Got job 164 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:32 INFO DAGScheduler: Final stage: ResultStage 222 (take at Classifier.scala:111)
18/11/12 12:27:32 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 221)
18/11/12 12:27:32 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 221)
18/11/12 12:27:32 INFO DAGScheduler: Submitting ShuffleMapStage 221 (MapPartitionsRDD[1018] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:32 INFO BlockManager: Found block rdd_1004_0 locally
18/11/12 12:27:32 INFO Executor: 1 block locks were not released by TID = 417:
[rdd_1004_0]
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 220.0 (TID 417). 57945 bytes result sent to driver
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 219.0 (TID 418, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 219.0 (TID 418)
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 220.0 (TID 417) in 15 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 220.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_226 stored as values in memory (estimated size 537.6 KB, free 1987.7 MB)
18/11/12 12:27:32 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:32 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 219.0 (TID 418). 1594 bytes result sent to driver
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_226_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1987.6 MB)
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 219.0 (TID 418) in 5 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 219.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_226_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1999.0 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 226 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 221 (MapPartitionsRDD[1018] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 221.0 with 1 tasks
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 221.0 (TID 419, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:32 INFO DAGScheduler: ResultStage 220 (first at XGBoost.scala:352) finished in 0.031 s
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 221.0 (TID 419)
18/11/12 12:27:32 INFO DAGScheduler: Job 163 finished: first at XGBoost.scala:352, took 0.032645 s
18/11/12 12:27:32 INFO MapPartitionsRDD: Removing RDD 1004 from persistence list
18/11/12 12:27:32 INFO DAGScheduler: ResultStage 219 (take at Classifier.scala:111) finished in 0.020 s
18/11/12 12:27:32 INFO DAGScheduler: Job 162 finished: take at Classifier.scala:111, took 2.257107 s
18/11/12 12:27:32 INFO BlockManager: Removing RDD 1004
18/11/12 12:27:32 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_6b50e2218db4__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:32 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 221.0 (TID 419). 3861 bytes result sent to driver
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 221.0 (TID 419) in 19 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 221.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO DAGScheduler: ShuffleMapStage 221 (take at Classifier.scala:111) finished in 0.036 s
18/11/12 12:27:32 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:32 INFO DAGScheduler: running: Set()
18/11/12 12:27:32 INFO DAGScheduler: waiting: Set(ResultStage 222)
18/11/12 12:27:32 INFO DAGScheduler: failed: Set()
18/11/12 12:27:32 INFO DAGScheduler: Submitting ResultStage 222 (MapPartitionsRDD[1022] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_227 stored as values in memory (estimated size 8.2 KB, free 1987.6 MB)
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_227_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1987.6 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_227_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1999.0 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 227 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 222 (MapPartitionsRDD[1022] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 222.0 with 1 tasks
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 222.0 (TID 420, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 222.0 (TID 420)
18/11/12 12:27:32 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:32 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 222.0 (TID 420). 1551 bytes result sent to driver
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 222.0 (TID 420) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 222.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO DAGScheduler: ResultStage 222 (take at Classifier.scala:111) finished in 0.006 s
18/11/12 12:27:32 INFO DAGScheduler: Job 164 finished: take at Classifier.scala:111, took 0.047359 s
18/11/12 12:27:32 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_c78d5c7e3c2d__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:32 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:32 INFO DAGScheduler: Registering RDD 1033 (take at Classifier.scala:111)
18/11/12 12:27:32 INFO DAGScheduler: Got job 165 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:32 INFO DAGScheduler: Final stage: ResultStage 224 (take at Classifier.scala:111)
18/11/12 12:27:32 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 223)
18/11/12 12:27:32 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 223)
18/11/12 12:27:32 INFO DAGScheduler: Submitting ShuffleMapStage 223 (MapPartitionsRDD[1033] at take at Classifier.scala:111), which has no missing parents
[INFO] [11/12/2018 12:27:32.260] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:52848
[INFO] [11/12/2018 12:27:32.260] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:32 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_228 stored as values in memory (estimated size 537.6 KB, free 1987.0 MB)
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_228_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1986.9 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_228_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1998.8 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 228 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 223 (MapPartitionsRDD[1033] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 223.0 with 1 tasks
18/11/12 12:27:32 INFO DAGScheduler: Got job 166 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:32 INFO DAGScheduler: Final stage: ResultStage 225 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 223.0 (TID 421, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:32 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 223.0 (TID 421)
18/11/12 12:27:32 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:32 INFO DAGScheduler: Submitting ResultStage 225 (MapPartitionsRDD[1039] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:32.281] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:48041
[INFO] [11/12/2018 12:27:32.281] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:32 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:32 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_229 stored as values in memory (estimated size 543.8 KB, free 1986.4 MB)
18/11/12 12:27:32 INFO Executor: Finished task 0.0 in stage 223.0 (TID 421). 3861 bytes result sent to driver
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_229_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1986.2 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_229_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.7 MB)
18/11/12 12:27:32 INFO TaskSetManager: Finished task 0.0 in stage 223.0 (TID 421) in 18 ms on localhost (executor driver) (1/1)
18/11/12 12:27:32 INFO TaskSchedulerImpl: Removed TaskSet 223.0, whose tasks have all completed, from pool 
18/11/12 12:27:32 INFO SparkContext: Created broadcast 229 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 225 (MapPartitionsRDD[1039] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 225.0 with 1 tasks
18/11/12 12:27:32 INFO TaskSetManager: Starting task 0.0 in stage 225.0 (TID 422, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:32 INFO DAGScheduler: Got job 167 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:32 INFO DAGScheduler: Final stage: ResultStage 226 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:32 INFO Executor: Running task 0.0 in stage 225.0 (TID 422)
18/11/12 12:27:32 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:32 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:32 INFO DAGScheduler: Submitting ResultStage 226 (MapPartitionsRDD[1047] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:32 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_230 stored as values in memory (estimated size 543.8 KB, free 1985.7 MB)
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_230_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1985.5 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_230_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1998.5 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 230 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 226 (MapPartitionsRDD[1047] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 226.0 with 1 tasks
18/11/12 12:27:32 INFO DAGScheduler: ShuffleMapStage 223 (take at Classifier.scala:111) finished in 0.047 s
18/11/12 12:27:32 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:32 INFO DAGScheduler: running: Set(ResultStage 225, ResultStage 226)
18/11/12 12:27:32 INFO DAGScheduler: waiting: Set(ResultStage 224)
18/11/12 12:27:32 INFO DAGScheduler: failed: Set()
18/11/12 12:27:32 INFO DAGScheduler: Submitting ResultStage 224 (MapPartitionsRDD[1038] at take at Classifier.scala:111), which has no missing parents
[INFO] [11/12/2018 12:27:32.309] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:32.311] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:32.311] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] All workers have started.
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_231 stored as values in memory (estimated size 8.2 KB, free 1985.5 MB)
[12:27:32] Tree method is automatically selected to be 'approx' for distributed training.
18/11/12 12:27:32 INFO MemoryStore: Block broadcast_231_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1985.5 MB)
18/11/12 12:27:32 INFO BlockManagerInfo: Added broadcast_231_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1998.5 MB)
18/11/12 12:27:32 INFO SparkContext: Created broadcast 231 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:32 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 224 (MapPartitionsRDD[1038] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:32 INFO TaskSchedulerImpl: Adding task set 224.0 with 1 tasks
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.315] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [0]	train-error:0.130354
[INFO] [11/12/2018 12:27:32.318] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [1]	train-error:0.132216
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.321] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [2]	train-error:0.121043
[INFO] [11/12/2018 12:27:32.324] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.109870
[INFO] [11/12/2018 12:27:32.326] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [4]	train-error:0.106145
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.329] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [5]	train-error:0.100559
[INFO] [11/12/2018 12:27:32.332] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [6]	train-error:0.098696
[INFO] [11/12/2018 12:27:32.334] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [7]	train-error:0.094972
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.337] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [8]	train-error:0.091248
[INFO] [11/12/2018 12:27:32.339] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [9]	train-error:0.085661
[INFO] [11/12/2018 12:27:32.341] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [10]	train-error:0.081937
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.343] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [11]	train-error:0.078212
[INFO] [11/12/2018 12:27:32.345] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [12]	train-error:0.080074
[INFO] [11/12/2018 12:27:32.348] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [13]	train-error:0.070763
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.350] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [14]	train-error:0.068901
[INFO] [11/12/2018 12:27:32.352] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [15]	train-error:0.067039
[INFO] [11/12/2018 12:27:32.355] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [16]	train-error:0.057728
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.357] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [17]	train-error:0.055866
[INFO] [11/12/2018 12:27:32.359] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [18]	train-error:0.052142
[INFO] [11/12/2018 12:27:32.361] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [19]	train-error:0.048417
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.364] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [20]	train-error:0.050279
[INFO] [11/12/2018 12:27:32.366] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [21]	train-error:0.046555
[INFO] [11/12/2018 12:27:32.368] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [22]	train-error:0.046555
[INFO] [11/12/2018 12:27:32.371] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.046555
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.374] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [24]	train-error:0.046555
[INFO] [11/12/2018 12:27:32.377] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [25]	train-error:0.046555
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.380] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [26]	train-error:0.044693
[INFO] [11/12/2018 12:27:32.382] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.042831
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.385] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [28]	train-error:0.042831
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.389] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [29]	train-error:0.040968
[INFO] [11/12/2018 12:27:32.393] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [30]	train-error:0.042831
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.396] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [31]	train-error:0.037244
[INFO] [11/12/2018 12:27:32.399] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [32]	train-error:0.037244
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.402] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [33]	train-error:0.037244
[INFO] [11/12/2018 12:27:32.407] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [34]	train-error:0.037244
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.412] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [35]	train-error:0.037244
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.416] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [36]	train-error:0.037244
[INFO] [11/12/2018 12:27:32.420] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [37]	train-error:0.037244
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.424] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [38]	train-error:0.037244
[INFO] [11/12/2018 12:27:32.428] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [39]	train-error:0.037244
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.431] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [40]	train-error:0.035382
[INFO] [11/12/2018 12:27:32.434] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [41]	train-error:0.031657
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.440] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [42]	train-error:0.026071
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.443] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [43]	train-error:0.026071
[INFO] [11/12/2018 12:27:32.447] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [44]	train-error:0.024209
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.452] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [45]	train-error:0.022346
[INFO] [11/12/2018 12:27:32.455] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [46]	train-error:0.020484
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.460] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [47]	train-error:0.020484
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.465] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [48]	train-error:0.018622
[INFO] [11/12/2018 12:27:32.469] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [49]	train-error:0.018622
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.474] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [50]	train-error:0.018622
[INFO] [11/12/2018 12:27:32.477] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [51]	train-error:0.018622
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.482] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [52]	train-error:0.018622
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.488] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [53]	train-error:0.014898
[INFO] [11/12/2018 12:27:32.492] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [54]	train-error:0.014898
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.496] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [55]	train-error:0.016760
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.500] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [56]	train-error:0.014898
[INFO] [11/12/2018 12:27:32.504] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [57]	train-error:0.011173
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.510] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [58]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.515] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [59]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.519] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [60]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.524] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [61]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.530] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [62]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.535] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [63]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.538] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [64]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.542] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [65]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.545] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [66]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.548] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [67]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.550] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [68]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.553] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [69]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.556] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [70]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.559] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [71]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.562] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [72]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.565] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [73]	train-error:0.009311
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.567] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [74]	train-error:0.009311
[INFO] [11/12/2018 12:27:32.570] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [75]	train-error:0.007449
[INFO] [11/12/2018 12:27:32.573] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [76]	train-error:0.007449
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.575] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [77]	train-error:0.007449
[INFO] [11/12/2018 12:27:32.578] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [78]	train-error:0.007449
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.580] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [79]	train-error:0.007449
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.583] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [80]	train-error:0.005587
[INFO] [11/12/2018 12:27:32.586] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [81]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.589] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [82]	train-error:0.005587
[INFO] [11/12/2018 12:27:32.592] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [83]	train-error:0.005587
[INFO] [11/12/2018 12:27:32.595] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [84]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.598] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [85]	train-error:0.005587
[INFO] [11/12/2018 12:27:32.601] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [86]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.608] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [87]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.613] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [88]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.619] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [89]	train-error:0.005587
[INFO] [11/12/2018 12:27:32.623] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [90]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.631] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [91]	train-error:0.005587
[INFO] [11/12/2018 12:27:32.635] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [92]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.641] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [93]	train-error:0.005587
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.648] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [94]	train-error:0.003724
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.651] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [95]	train-error:0.003724
[INFO] [11/12/2018 12:27:32.655] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [96]	train-error:0.003724
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.661] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [97]	train-error:0.003724
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:32] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:32.666] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [98]	train-error:0.003724
[INFO] [11/12/2018 12:27:32.671] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [99]	train-error:0.003724
18/11/12 12:27:34 INFO MemoryStore: Block rdd_1039_0 stored as values in memory (estimated size 584.0 B, free 1985.5 MB)
18/11/12 12:27:34 INFO BlockManagerInfo: Added rdd_1039_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1998.5 MB)
18/11/12 12:27:34 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:34 INFO Executor: 1 block locks were not released by TID = 422:
[rdd_1039_0]
18/11/12 12:27:34 INFO Executor: Finished task 0.0 in stage 225.0 (TID 422). 3428 bytes result sent to driver
18/11/12 12:27:34 INFO TaskSetManager: Starting task 0.0 in stage 224.0 (TID 423, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:34 INFO Executor: Running task 0.0 in stage 224.0 (TID 423)
18/11/12 12:27:34 INFO TaskSetManager: Finished task 0.0 in stage 225.0 (TID 422) in 2383 ms on localhost (executor driver) (1/1)
18/11/12 12:27:34 INFO TaskSchedulerImpl: Removed TaskSet 225.0, whose tasks have all completed, from pool 
18/11/12 12:27:34 INFO DAGScheduler: ResultStage 225 (foreachPartition at XGBoost.scala:287) finished in 2.402 s
18/11/12 12:27:34 INFO DAGScheduler: Job 166 finished: foreachPartition at XGBoost.scala:287, took 2.407458 s
18/11/12 12:27:34 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:34 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:34 INFO Executor: Finished task 0.0 in stage 224.0 (TID 423). 1594 bytes result sent to driver
[INFO] [11/12/2018 12:27:34.676] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:34 INFO TaskSetManager: Starting task 0.0 in stage 226.0 (TID 424, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:34 INFO TaskSetManager: Finished task 0.0 in stage 224.0 (TID 423) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:34 INFO Executor: Running task 0.0 in stage 226.0 (TID 424)
18/11/12 12:27:34 INFO TaskSchedulerImpl: Removed TaskSet 224.0, whose tasks have all completed, from pool 
18/11/12 12:27:34 INFO DAGScheduler: ResultStage 224 (take at Classifier.scala:111) finished in 2.372 s
18/11/12 12:27:34 INFO DAGScheduler: Job 165 finished: take at Classifier.scala:111, took 2.422206 s
18/11/12 12:27:34 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_8480345bcf99__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:34 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:27:34.698] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:34.698] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:34.699] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:34] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:34 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:34 INFO DAGScheduler: Got job 168 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:34 INFO DAGScheduler: Final stage: ResultStage 227 (first at XGBoost.scala:352)
18/11/12 12:27:34 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:34 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:34 INFO DAGScheduler: Submitting ResultStage 227 (MapPartitionsRDD[1039] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.703] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:49505
[INFO] [11/12/2018 12:27:34.703] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:27:34.704] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [0]	train-error:0.134892
[INFO] [11/12/2018 12:27:34.707] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [1]	train-error:0.120504
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:34 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.710] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [2]	train-error:0.115108
[INFO] [11/12/2018 12:27:34.713] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [3]	train-error:0.109712
18/11/12 12:27:34 INFO MemoryStore: Block broadcast_232 stored as values in memory (estimated size 543.8 KB, free 1985.0 MB)
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:34 INFO MemoryStore: Block broadcast_232_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1984.8 MB)
18/11/12 12:27:34 INFO BlockManagerInfo: Added broadcast_232_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.4 MB)
18/11/12 12:27:34 INFO SparkContext: Created broadcast 232 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:34 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 227 (MapPartitionsRDD[1039] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:34 INFO TaskSchedulerImpl: Adding task set 227.0 with 1 tasks
18/11/12 12:27:34 INFO DAGScheduler: Got job 169 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:34 INFO DAGScheduler: Final stage: ResultStage 228 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:34 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:34 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:34 INFO DAGScheduler: Submitting ResultStage 228 (MapPartitionsRDD[1055] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.717] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [4]	train-error:0.107914
[INFO] [11/12/2018 12:27:34.720] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [5]	train-error:0.098921
[INFO] [11/12/2018 12:27:34.722] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [6]	train-error:0.098921
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:34 INFO MemoryStore: Block broadcast_233 stored as values in memory (estimated size 543.8 KB, free 1984.3 MB)
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.725] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [7]	train-error:0.098921
[INFO] [11/12/2018 12:27:34.728] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [8]	train-error:0.095324
18/11/12 12:27:34 INFO MemoryStore: Block broadcast_233_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1984.2 MB)
18/11/12 12:27:34 INFO BlockManagerInfo: Added broadcast_233_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.2 MB)
18/11/12 12:27:34 INFO SparkContext: Created broadcast 233 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:34 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 228 (MapPartitionsRDD[1055] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:34 INFO TaskSchedulerImpl: Adding task set 228.0 with 1 tasks
[INFO] [11/12/2018 12:27:34.730] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [9]	train-error:0.089928
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.732] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [10]	train-error:0.088129
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.734] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [11]	train-error:0.082734
[INFO] [11/12/2018 12:27:34.736] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [12]	train-error:0.080935
[INFO] [11/12/2018 12:27:34.739] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [13]	train-error:0.080935
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.741] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [14]	train-error:0.077338
[INFO] [11/12/2018 12:27:34.743] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [15]	train-error:0.070144
[INFO] [11/12/2018 12:27:34.745] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [16]	train-error:0.064748
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.747] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [17]	train-error:0.061151
[INFO] [11/12/2018 12:27:34.750] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [18]	train-error:0.057554
[INFO] [11/12/2018 12:27:34.752] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [19]	train-error:0.053957
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.754] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [20]	train-error:0.053957
[INFO] [11/12/2018 12:27:34.757] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [21]	train-error:0.050360
[INFO] [11/12/2018 12:27:34.759] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [22]	train-error:0.048561
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.762] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [23]	train-error:0.044964
[INFO] [11/12/2018 12:27:34.764] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [24]	train-error:0.046763
[INFO] [11/12/2018 12:27:34.767] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [25]	train-error:0.037770
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.769] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [26]	train-error:0.037770
[INFO] [11/12/2018 12:27:34.771] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [27]	train-error:0.041367
[INFO] [11/12/2018 12:27:34.773] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [28]	train-error:0.043165
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.775] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [29]	train-error:0.039568
[INFO] [11/12/2018 12:27:34.778] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [30]	train-error:0.035971
[INFO] [11/12/2018 12:27:34.780] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [31]	train-error:0.035971
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.782] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [32]	train-error:0.032374
[INFO] [11/12/2018 12:27:34.784] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [33]	train-error:0.028777
[INFO] [11/12/2018 12:27:34.786] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [34]	train-error:0.026978
[INFO] [11/12/2018 12:27:34.788] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [35]	train-error:0.026978
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.791] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [36]	train-error:0.026978
[INFO] [11/12/2018 12:27:34.793] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [37]	train-error:0.026978
[INFO] [11/12/2018 12:27:34.795] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [38]	train-error:0.021583
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.797] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [39]	train-error:0.023381
[INFO] [11/12/2018 12:27:34.800] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [40]	train-error:0.021583
[INFO] [11/12/2018 12:27:34.802] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [41]	train-error:0.023381
[INFO] [11/12/2018 12:27:34.804] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [42]	train-error:0.017986
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.807] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [43]	train-error:0.017986
[INFO] [11/12/2018 12:27:34.809] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [44]	train-error:0.017986
[INFO] [11/12/2018 12:27:34.811] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [45]	train-error:0.017986
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.814] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [46]	train-error:0.017986
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.816] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [47]	train-error:0.014388
[INFO] [11/12/2018 12:27:34.818] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [48]	train-error:0.016187
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.821] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [49]	train-error:0.016187
[INFO] [11/12/2018 12:27:34.823] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [50]	train-error:0.014388
[INFO] [11/12/2018 12:27:34.825] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [51]	train-error:0.014388
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.828] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [52]	train-error:0.014388
[INFO] [11/12/2018 12:27:34.830] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [53]	train-error:0.014388
[INFO] [11/12/2018 12:27:34.833] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [54]	train-error:0.014388
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.835] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [55]	train-error:0.014388
[INFO] [11/12/2018 12:27:34.837] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [56]	train-error:0.012590
[INFO] [11/12/2018 12:27:34.840] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [57]	train-error:0.012590
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.842] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [58]	train-error:0.012590
[INFO] [11/12/2018 12:27:34.845] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [59]	train-error:0.012590
[INFO] [11/12/2018 12:27:34.847] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [60]	train-error:0.012590
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.849] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [61]	train-error:0.012590
[INFO] [11/12/2018 12:27:34.851] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [62]	train-error:0.012590
[INFO] [11/12/2018 12:27:34.854] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [63]	train-error:0.012590
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.856] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [64]	train-error:0.010791
[INFO] [11/12/2018 12:27:34.859] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [65]	train-error:0.010791
[INFO] [11/12/2018 12:27:34.861] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [66]	train-error:0.010791
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.863] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [67]	train-error:0.012590
[INFO] [11/12/2018 12:27:34.865] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [68]	train-error:0.010791
[INFO] [11/12/2018 12:27:34.868] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [69]	train-error:0.007194
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.870] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [70]	train-error:0.008993
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.873] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [71]	train-error:0.007194
[INFO] [11/12/2018 12:27:34.875] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.007194
[INFO] [11/12/2018 12:27:34.877] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [73]	train-error:0.007194
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.880] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [74]	train-error:0.008993
[INFO] [11/12/2018 12:27:34.882] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [75]	train-error:0.007194
[INFO] [11/12/2018 12:27:34.885] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [76]	train-error:0.007194
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.887] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [77]	train-error:0.007194
[INFO] [11/12/2018 12:27:34.891] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [78]	train-error:0.007194
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.894] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [79]	train-error:0.007194
[INFO] [11/12/2018 12:27:34.897] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [80]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.900] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [81]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.905] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [82]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.909] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [83]	train-error:0.005396
[INFO] [11/12/2018 12:27:34.913] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [84]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.920] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [85]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.924] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [86]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.930] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [87]	train-error:0.005396
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.935] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [88]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.942] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [89]	train-error:0.003597
[INFO] [11/12/2018 12:27:34.947] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [90]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.951] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [91]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.955] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [92]	train-error:0.003597
[INFO] [11/12/2018 12:27:34.961] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [93]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.966] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [94]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.970] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [95]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.979] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [96]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.985] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [97]	train-error:0.003597
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:34] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:34.990] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [98]	train-error:0.003597
[INFO] [11/12/2018 12:27:34.995] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [99]	train-error:0.003597
[INFO] [11/12/2018 12:27:37.000] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:36 INFO MemoryStore: Block rdd_1047_0 stored as values in memory (estimated size 584.0 B, free 1984.2 MB)
18/11/12 12:27:37 INFO BlockManagerInfo: Added rdd_1047_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1998.2 MB)
18/11/12 12:27:37 INFO Executor: 1 block locks were not released by TID = 424:
[rdd_1047_0]
18/11/12 12:27:37 INFO Executor: Finished task 0.0 in stage 226.0 (TID 424). 3428 bytes result sent to driver
18/11/12 12:27:37 INFO TaskSetManager: Starting task 0.0 in stage 227.0 (TID 425, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:37 INFO TaskSetManager: Finished task 0.0 in stage 226.0 (TID 424) in 2320 ms on localhost (executor driver) (1/1)
18/11/12 12:27:37 INFO TaskSchedulerImpl: Removed TaskSet 226.0, whose tasks have all completed, from pool 
18/11/12 12:27:37 INFO Executor: Running task 0.0 in stage 227.0 (TID 425)
18/11/12 12:27:37 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:37 INFO DAGScheduler: ResultStage 226 (foreachPartition at XGBoost.scala:287) finished in 4.706 s
18/11/12 12:27:37 INFO DAGScheduler: Job 167 finished: foreachPartition at XGBoost.scala:287, took 4.712715 s
18/11/12 12:27:37 INFO BlockManager: Found block rdd_1039_0 locally
18/11/12 12:27:37 INFO Executor: 1 block locks were not released by TID = 425:
[rdd_1039_0]
18/11/12 12:27:37 INFO Executor: Finished task 0.0 in stage 227.0 (TID 425). 132900 bytes result sent to driver
18/11/12 12:27:37 INFO TaskSetManager: Starting task 0.0 in stage 228.0 (TID 426, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:37 INFO Executor: Running task 0.0 in stage 228.0 (TID 426)
18/11/12 12:27:37 INFO TaskSetManager: Finished task 0.0 in stage 227.0 (TID 425) in 10 ms on localhost (executor driver) (1/1)
18/11/12 12:27:37 INFO TaskSchedulerImpl: Removed TaskSet 227.0, whose tasks have all completed, from pool 
18/11/12 12:27:37 INFO DAGScheduler: ResultStage 227 (first at XGBoost.scala:352) finished in 2.306 s
18/11/12 12:27:37 INFO DAGScheduler: Job 168 finished: first at XGBoost.scala:352, took 2.306876 s
18/11/12 12:27:37 INFO MapPartitionsRDD: Removing RDD 1039 from persistence list
18/11/12 12:27:37 INFO BlockManager: Removing RDD 1039
18/11/12 12:27:37 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:37 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:37 INFO DAGScheduler: Got job 170 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:37 INFO DAGScheduler: Final stage: ResultStage 229 (first at XGBoost.scala:352)
18/11/12 12:27:37 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:37 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:37 INFO DAGScheduler: Submitting ResultStage 229 (MapPartitionsRDD[1047] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:37.025] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:37.027] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:37.027] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:37] Tree method is automatically selected to be 'approx' for distributed training.
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.032] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [0]	train-error:0.150870
[INFO] [11/12/2018 12:27:37.037] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [1]	train-error:0.143133
18/11/12 12:27:37 INFO MemoryStore: Block broadcast_234 stored as values in memory (estimated size 543.8 KB, free 1983.6 MB)
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:37 INFO MemoryStore: Block broadcast_234_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1983.5 MB)
18/11/12 12:27:37 INFO BlockManagerInfo: Added broadcast_234_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1998.1 MB)
18/11/12 12:27:37 INFO SparkContext: Created broadcast 234 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 229 (MapPartitionsRDD[1047] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:37 INFO TaskSchedulerImpl: Adding task set 229.0 with 1 tasks
18/11/12 12:27:37 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:37 INFO DAGScheduler: Registering RDD 1060 (take at Classifier.scala:111)
18/11/12 12:27:37 INFO DAGScheduler: Got job 171 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:37 INFO DAGScheduler: Final stage: ResultStage 231 (take at Classifier.scala:111)
18/11/12 12:27:37 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 230)
18/11/12 12:27:37 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 230)
18/11/12 12:27:37 INFO DAGScheduler: Submitting ShuffleMapStage 230 (MapPartitionsRDD[1060] at take at Classifier.scala:111), which has no missing parents
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.040] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [2]	train-error:0.119923
[INFO] [11/12/2018 12:27:37.043] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [3]	train-error:0.114120
[INFO] [11/12/2018 12:27:37.046] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [4]	train-error:0.112186
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:37 INFO MemoryStore: Block broadcast_235 stored as values in memory (estimated size 537.6 KB, free 1983.0 MB)
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
18/11/12 12:27:37 INFO MemoryStore: Block broadcast_235_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1982.8 MB)
18/11/12 12:27:37 INFO BlockManagerInfo: Added broadcast_235_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.9 MB)
18/11/12 12:27:37 INFO SparkContext: Created broadcast 235 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:37 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 230 (MapPartitionsRDD[1060] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:37 INFO TaskSchedulerImpl: Adding task set 230.0 with 1 tasks
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.049] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [5]	train-error:0.114120
[INFO] [11/12/2018 12:27:37.052] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [6]	train-error:0.110251
[INFO] [11/12/2018 12:27:37.054] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [7]	train-error:0.110251
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.057] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [8]	train-error:0.104449
[INFO] [11/12/2018 12:27:37.059] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [9]	train-error:0.104449
[INFO] [11/12/2018 12:27:37.061] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [10]	train-error:0.104449
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.063] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [11]	train-error:0.102515
[INFO] [11/12/2018 12:27:37.066] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [12]	train-error:0.102515
[INFO] [11/12/2018 12:27:37.068] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [13]	train-error:0.102515
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.071] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [14]	train-error:0.100580
[INFO] [11/12/2018 12:27:37.073] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [15]	train-error:0.100580
[INFO] [11/12/2018 12:27:37.075] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [16]	train-error:0.098646
[INFO] [11/12/2018 12:27:37.078] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [17]	train-error:0.088975
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.080] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [18]	train-error:0.088975
[INFO] [11/12/2018 12:27:37.082] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [19]	train-error:0.085106
[INFO] [11/12/2018 12:27:37.085] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [20]	train-error:0.077369
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.087] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [21]	train-error:0.075435
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.089] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [22]	train-error:0.073501
[INFO] [11/12/2018 12:27:37.091] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [23]	train-error:0.067698
[INFO] [11/12/2018 12:27:37.094] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [24]	train-error:0.067698
[INFO] [11/12/2018 12:27:37.096] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [25]	train-error:0.063830
[INFO] [11/12/2018 12:27:37.098] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.061896
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.101] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [27]	train-error:0.059961
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.103] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [28]	train-error:0.059961
[INFO] [11/12/2018 12:27:37.105] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [29]	train-error:0.059961
[INFO] [11/12/2018 12:27:37.108] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [30]	train-error:0.059961
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.110] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [31]	train-error:0.052224
[INFO] [11/12/2018 12:27:37.112] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [32]	train-error:0.052224
[INFO] [11/12/2018 12:27:37.115] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [33]	train-error:0.050290
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 12 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.117] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [34]	train-error:0.052224
[INFO] [11/12/2018 12:27:37.119] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [35]	train-error:0.050290
[INFO] [11/12/2018 12:27:37.121] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [36]	train-error:0.042553
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.124] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [37]	train-error:0.042553
[INFO] [11/12/2018 12:27:37.126] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [38]	train-error:0.036750
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.129] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [39]	train-error:0.036750
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.131] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [40]	train-error:0.034816
[INFO] [11/12/2018 12:27:37.133] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [41]	train-error:0.030948
[INFO] [11/12/2018 12:27:37.136] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [42]	train-error:0.030948
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.138] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [43]	train-error:0.030948
[INFO] [11/12/2018 12:27:37.140] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [44]	train-error:0.030948
[INFO] [11/12/2018 12:27:37.143] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [45]	train-error:0.027079
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.145] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [46]	train-error:0.029014
[INFO] [11/12/2018 12:27:37.148] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [47]	train-error:0.027079
[INFO] [11/12/2018 12:27:37.151] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [48]	train-error:0.027079
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 16 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.154] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [49]	train-error:0.025145
[INFO] [11/12/2018 12:27:37.158] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [50]	train-error:0.021277
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.162] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [51]	train-error:0.019342
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.168] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [52]	train-error:0.019342
[INFO] [11/12/2018 12:27:37.173] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [53]	train-error:0.017408
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.178] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [54]	train-error:0.017408
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.182] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [55]	train-error:0.013540
[INFO] [11/12/2018 12:27:37.186] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [56]	train-error:0.011605
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.191] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [57]	train-error:0.013540
[INFO] [11/12/2018 12:27:37.194] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [58]	train-error:0.009671
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.198] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [59]	train-error:0.009671
[INFO] [11/12/2018 12:27:37.202] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [60]	train-error:0.009671
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.205] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [61]	train-error:0.009671
[INFO] [11/12/2018 12:27:37.210] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [62]	train-error:0.009671
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.214] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [63]	train-error:0.009671
[INFO] [11/12/2018 12:27:37.217] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [64]	train-error:0.009671
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.221] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [65]	train-error:0.009671
[INFO] [11/12/2018 12:27:37.225] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [66]	train-error:0.009671
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.233] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [67]	train-error:0.009671
[INFO] [11/12/2018 12:27:37.237] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [68]	train-error:0.009671
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.244] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [69]	train-error:0.007737
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.248] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [70]	train-error:0.007737
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.255] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [71]	train-error:0.005803
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.260] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [72]	train-error:0.005803
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.268] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [73]	train-error:0.005803
[INFO] [11/12/2018 12:27:37.273] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [74]	train-error:0.007737
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.280] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [75]	train-error:0.005803
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.287] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [76]	train-error:0.005803
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.291] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [77]	train-error:0.005803
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.298] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [78]	train-error:0.005803
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.303] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [79]	train-error:0.003868
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.310] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [80]	train-error:0.003868
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 22 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.316] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.003868
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.323] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [82]	train-error:0.003868
[INFO] [11/12/2018 12:27:37.330] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [83]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.334] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [84]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.341] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [85]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.347] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [86]	train-error:0.003868
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.352] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [87]	train-error:0.003868
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.359] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [88]	train-error:0.003868
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 32 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.365] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [89]	train-error:0.001934
[INFO] [11/12/2018 12:27:37.369] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [90]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.373] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [91]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 24 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.377] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [92]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.381] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [93]	train-error:0.001934
[INFO] [11/12/2018 12:27:37.384] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [94]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 20 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.390] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [95]	train-error:0.001934
[INFO] [11/12/2018 12:27:37.394] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [96]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 18 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 28 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.397] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [97]	train-error:0.001934
[INFO] [11/12/2018 12:27:37.401] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [98]	train-error:0.001934
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 38 extra nodes, 0 pruned nodes, max_depth=6
[12:27:37] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 30 extra nodes, 0 pruned nodes, max_depth=6
[INFO] [11/12/2018 12:27:37.407] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [99]	train-error:0.001934
[INFO] [11/12/2018 12:27:39.411] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:39 INFO MemoryStore: Block rdd_1055_0 stored as values in memory (estimated size 584.0 B, free 1982.8 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added rdd_1055_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1997.9 MB)
18/11/12 12:27:39 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:39 INFO Executor: 1 block locks were not released by TID = 426:
[rdd_1055_0]
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 228.0 (TID 426). 3428 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 229.0 (TID 427, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 228.0 (TID 426) in 2402 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 229.0 (TID 427)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 228.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO DAGScheduler: ResultStage 228 (foreachPartition at XGBoost.scala:287) finished in 4.695 s
18/11/12 12:27:39 INFO DAGScheduler: Job 169 finished: foreachPartition at XGBoost.scala:287, took 4.702075 s
18/11/12 12:27:39 INFO BlockManager: Found block rdd_1047_0 locally
18/11/12 12:27:39 INFO Executor: 1 block locks were not released by TID = 427:
[rdd_1047_0]
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 229.0 (TID 427). 128445 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 230.0 (TID 428, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 230.0 (TID 428)
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 229.0 (TID 427) in 12 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 229.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO DAGScheduler: ResultStage 229 (first at XGBoost.scala:352) finished in 2.402 s
18/11/12 12:27:39 INFO DAGScheduler: Job 170 finished: first at XGBoost.scala:352, took 2.402929 s
18/11/12 12:27:39 INFO MapPartitionsRDD: Removing RDD 1047 from persistence list
18/11/12 12:27:39 INFO BlockManager: Removing RDD 1047
18/11/12 12:27:39 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:39 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:39 INFO DAGScheduler: Got job 172 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:39 INFO DAGScheduler: Final stage: ResultStage 232 (first at XGBoost.scala:352)
18/11/12 12:27:39 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:39 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:39 INFO DAGScheduler: Submitting ResultStage 232 (MapPartitionsRDD[1055] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 230.0 (TID 428). 3861 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 230.0 (TID 428) in 24 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 230.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_236 stored as values in memory (estimated size 543.8 KB, free 1982.3 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_236_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1982.1 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_236_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.8 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 236 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 232 (MapPartitionsRDD[1055] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 232.0 with 1 tasks
18/11/12 12:27:39 INFO DAGScheduler: ShuffleMapStage 230 (take at Classifier.scala:111) finished in 2.414 s
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 232.0 (TID 429, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:39 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:39 INFO DAGScheduler: running: Set(ResultStage 232)
18/11/12 12:27:39 INFO DAGScheduler: waiting: Set(ResultStage 231)
18/11/12 12:27:39 INFO DAGScheduler: failed: Set()
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 232.0 (TID 429)
18/11/12 12:27:39 INFO DAGScheduler: Submitting ResultStage 231 (MapPartitionsRDD[1064] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:39 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_237 stored as values in memory (estimated size 8.2 KB, free 1982.1 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_237_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1982.1 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_237_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.8 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 237 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 231 (MapPartitionsRDD[1064] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 231.0 with 1 tasks
18/11/12 12:27:39 INFO DAGScheduler: Registering RDD 1069 (take at Classifier.scala:111)
18/11/12 12:27:39 INFO DAGScheduler: Got job 173 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:39 INFO DAGScheduler: Final stage: ResultStage 234 (take at Classifier.scala:111)
18/11/12 12:27:39 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 233)
18/11/12 12:27:39 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 233)
18/11/12 12:27:39 INFO DAGScheduler: Submitting ShuffleMapStage 233 (MapPartitionsRDD[1069] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:39 INFO BlockManager: Found block rdd_1055_0 locally
18/11/12 12:27:39 INFO Executor: 1 block locks were not released by TID = 429:
[rdd_1055_0]
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 232.0 (TID 429). 122122 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 231.0 (TID 430, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 231.0 (TID 430)
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 232.0 (TID 429) in 15 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 232.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:39 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_238 stored as values in memory (estimated size 537.6 KB, free 1981.6 MB)
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 231.0 (TID 430). 1594 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 231.0 (TID 430) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 231.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_238_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1981.5 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_238_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.6 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 238 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 233 (MapPartitionsRDD[1069] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 233.0 with 1 tasks
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 233.0 (TID 431, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:39 INFO DAGScheduler: ResultStage 232 (first at XGBoost.scala:352) finished in 0.037 s
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 233.0 (TID 431)
18/11/12 12:27:39 INFO DAGScheduler: Job 172 finished: first at XGBoost.scala:352, took 0.037406 s
18/11/12 12:27:39 INFO MapPartitionsRDD: Removing RDD 1055 from persistence list
18/11/12 12:27:39 INFO DAGScheduler: ResultStage 231 (take at Classifier.scala:111) finished in 0.019 s
18/11/12 12:27:39 INFO DAGScheduler: Job 171 finished: take at Classifier.scala:111, took 2.435218 s
18/11/12 12:27:39 INFO BlockManager: Removing RDD 1055
18/11/12 12:27:39 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_a9849fade5e0__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:39 INFO BlockManager: Found block rdd_182_0 locally
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 233.0 (TID 431). 3861 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 233.0 (TID 431) in 15 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 233.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO DAGScheduler: ShuffleMapStage 233 (take at Classifier.scala:111) finished in 0.028 s
18/11/12 12:27:39 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:39 INFO DAGScheduler: running: Set()
18/11/12 12:27:39 INFO DAGScheduler: waiting: Set(ResultStage 234)
18/11/12 12:27:39 INFO DAGScheduler: failed: Set()
18/11/12 12:27:39 INFO DAGScheduler: Submitting ResultStage 234 (MapPartitionsRDD[1073] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_239 stored as values in memory (estimated size 8.2 KB, free 1981.4 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_239_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1981.4 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_239_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.6 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 239 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 234 (MapPartitionsRDD[1073] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 234.0 with 1 tasks
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 234.0 (TID 432, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 234.0 (TID 432)
18/11/12 12:27:39 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:39 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 234.0 (TID 432). 1594 bytes result sent to driver
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 234.0 (TID 432) in 3 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 234.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO DAGScheduler: ResultStage 234 (take at Classifier.scala:111) finished in 0.005 s
18/11/12 12:27:39 INFO DAGScheduler: Job 173 finished: take at Classifier.scala:111, took 0.039492 s
18/11/12 12:27:39 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_8ddbaaa22662__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:39 INFO SparkContext: Starting job: take at Classifier.scala:111
18/11/12 12:27:39 INFO DAGScheduler: Registering RDD 1085 (take at Classifier.scala:111)
18/11/12 12:27:39 INFO DAGScheduler: Got job 174 (take at Classifier.scala:111) with 1 output partitions
18/11/12 12:27:39 INFO DAGScheduler: Final stage: ResultStage 236 (take at Classifier.scala:111)
18/11/12 12:27:39 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 235)
18/11/12 12:27:39 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 235)
18/11/12 12:27:39 INFO DAGScheduler: Submitting ShuffleMapStage 235 (MapPartitionsRDD[1085] at take at Classifier.scala:111), which has no missing parents
[INFO] [11/12/2018 12:27:39.499] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:47436
[INFO] [11/12/2018 12:27:39.499] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:39 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_240 stored as values in memory (estimated size 537.6 KB, free 1980.9 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_240_piece0 stored as bytes in memory (estimated size 150.4 KB, free 1980.8 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_240_piece0 in memory on 127.0.0.1:61956 (size: 150.4 KB, free: 1997.5 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 240 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 235 (MapPartitionsRDD[1085] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 235.0 with 1 tasks
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 235.0 (TID 433, localhost, executor driver, partition 0, PROCESS_LOCAL, 8454 bytes)
18/11/12 12:27:39 INFO DAGScheduler: Got job 175 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:39 INFO DAGScheduler: Final stage: ResultStage 237 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:39 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 235.0 (TID 433)
18/11/12 12:27:39 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:39 INFO DAGScheduler: Submitting ResultStage 237 (MapPartitionsRDD[1090] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:39.520] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:40754
[INFO] [11/12/2018 12:27:39.520] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
18/11/12 12:27:39 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
18/11/12 12:27:39 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_241 stored as values in memory (estimated size 543.8 KB, free 1980.2 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_241_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1980.1 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_241_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1997.3 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 241 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 237 (MapPartitionsRDD[1090] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 237.0 with 1 tasks
18/11/12 12:27:39 INFO Executor: Finished task 0.0 in stage 235.0 (TID 433). 3861 bytes result sent to driver
18/11/12 12:27:39 INFO DAGScheduler: Got job 176 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:39 INFO DAGScheduler: Final stage: ResultStage 238 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:39 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:39 INFO TaskSetManager: Starting task 0.0 in stage 237.0 (TID 434, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:39 INFO Executor: Running task 0.0 in stage 237.0 (TID 434)
18/11/12 12:27:39 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:39 INFO TaskSetManager: Finished task 0.0 in stage 235.0 (TID 433) in 21 ms on localhost (executor driver) (1/1)
18/11/12 12:27:39 INFO TaskSchedulerImpl: Removed TaskSet 235.0, whose tasks have all completed, from pool 
18/11/12 12:27:39 INFO DAGScheduler: Submitting ResultStage 238 (MapPartitionsRDD[1098] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:39 INFO BlockManager: Found block rdd_178_0 locally
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_242 stored as values in memory (estimated size 543.8 KB, free 1979.6 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_242_piece0 stored as bytes in memory (estimated size 153.0 KB, free 1979.4 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_242_piece0 in memory on 127.0.0.1:61956 (size: 153.0 KB, free: 1997.2 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 242 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 238 (MapPartitionsRDD[1098] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 238.0 with 1 tasks
18/11/12 12:27:39 INFO DAGScheduler: ShuffleMapStage 235 (take at Classifier.scala:111) finished in 0.052 s
18/11/12 12:27:39 INFO DAGScheduler: looking for newly runnable stages
18/11/12 12:27:39 INFO DAGScheduler: running: Set(ResultStage 237, ResultStage 238)
18/11/12 12:27:39 INFO DAGScheduler: waiting: Set(ResultStage 236)
18/11/12 12:27:39 INFO DAGScheduler: failed: Set()
18/11/12 12:27:39 INFO DAGScheduler: Submitting ResultStage 236 (MapPartitionsRDD[1089] at take at Classifier.scala:111), which has no missing parents
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_243 stored as values in memory (estimated size 8.2 KB, free 1979.4 MB)
18/11/12 12:27:39 INFO MemoryStore: Block broadcast_243_piece0 stored as bytes in memory (estimated size 4.1 KB, free 1979.4 MB)
18/11/12 12:27:39 INFO BlockManagerInfo: Added broadcast_243_piece0 in memory on 127.0.0.1:61956 (size: 4.1 KB, free: 1997.2 MB)
18/11/12 12:27:39 INFO SparkContext: Created broadcast 243 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 236 (MapPartitionsRDD[1089] at take at Classifier.scala:111) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:39 INFO TaskSchedulerImpl: Adding task set 236.0 with 1 tasks
[12:27:39] Tree method is automatically selected to be 'approx' for distributed training.
[INFO] [11/12/2018 12:27:39.554] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:39.555] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:39.556] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:39.562] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [0]	train-error:0.130354
[INFO] [11/12/2018 12:27:39.567] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [1]	train-error:0.126629
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:39.572] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [2]	train-error:0.108007
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.577] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [3]	train-error:0.093110
[INFO] [11/12/2018 12:27:39.582] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [4]	train-error:0.091248
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.587] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [5]	train-error:0.087523
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=11
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.592] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [6]	train-error:0.081937
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:39.597] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [7]	train-error:0.074488
[INFO] [11/12/2018 12:27:39.602] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [8]	train-error:0.065177
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.607] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [9]	train-error:0.065177
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.612] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [10]	train-error:0.061453
[INFO] [11/12/2018 12:27:39.616] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [11]	train-error:0.055866
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.621] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [12]	train-error:0.052142
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.627] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [13]	train-error:0.046555
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.635] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [14]	train-error:0.044693
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.642] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [15]	train-error:0.037244
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.650] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.033520
[INFO] [11/12/2018 12:27:39.658] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [17]	train-error:0.029795
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.667] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [18]	train-error:0.027933
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.675] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.026071
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.685] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [20]	train-error:0.022346
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.697] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [21]	train-error:0.020484
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.707] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [22]	train-error:0.016760
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.715] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.011173
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.727] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [24]	train-error:0.011173
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.738] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [25]	train-error:0.011173
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:39.749] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [26]	train-error:0.009311
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.760] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [27]	train-error:0.007449
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.767] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [28]	train-error:0.005587
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.776] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [29]	train-error:0.003724
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.781] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [30]	train-error:0.003724
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.787] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [31]	train-error:0.003724
[INFO] [11/12/2018 12:27:39.792] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [32]	train-error:0.003724
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.797] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [33]	train-error:0.003724
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.802] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [34]	train-error:0.003724
[INFO] [11/12/2018 12:27:39.807] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [35]	train-error:0.003724
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.813] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [36]	train-error:0.003724
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.818] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [37]	train-error:0.001862
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.824] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [38]	train-error:0.001862
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.834] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [39]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.841] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [40]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.850] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [41]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.860] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [42]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.870] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [43]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.882] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [44]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.890] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [45]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.901] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [46]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.911] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [47]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.923] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [48]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.932] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [49]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.942] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [50]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.956] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [51]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.968] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [52]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.975] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [53]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 42 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.981] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [54]	train-error:0.000000
[INFO] [11/12/2018 12:27:39.987] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [55]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.993] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [56]	train-error:0.000000
[12:27:39] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:39.998] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [57]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.005] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [58]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.011] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [59]	train-error:0.000000
[INFO] [11/12/2018 12:27:40.016] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [60]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.022] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [61]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.029] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [62]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 86 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:40.040] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [63]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.051] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [64]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:40.061] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [65]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.074] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [66]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.084] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [67]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.094] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [68]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.105] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [69]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.115] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [70]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.131] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [71]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.143] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [72]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.155] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [73]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:40.168] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [74]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.176] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.191] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.204] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.211] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.218] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:40.225] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.233] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.243] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.255] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:40.262] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.275] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.288] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.301] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.309] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.323] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.336] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.346] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[INFO] [11/12/2018 12:27:40.356] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.365] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[INFO] [11/12/2018 12:27:40.372] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.378] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[INFO] [11/12/2018 12:27:40.383] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.389] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[INFO] [11/12/2018 12:27:40.394] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:27:40] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:40.402] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
[INFO] [11/12/2018 12:27:42.410] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:42 INFO MemoryStore: Block rdd_1090_0 stored as values in memory (estimated size 584.0 B, free 1979.4 MB)
18/11/12 12:27:42 INFO BlockManagerInfo: Added rdd_1090_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1997.2 MB)
18/11/12 12:27:42 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:42 INFO Executor: 1 block locks were not released by TID = 434:
[rdd_1090_0]
18/11/12 12:27:42 INFO Executor: Finished task 0.0 in stage 237.0 (TID 434). 3428 bytes result sent to driver
18/11/12 12:27:42 INFO TaskSetManager: Starting task 0.0 in stage 236.0 (TID 435, localhost, executor driver, partition 0, ANY, 7754 bytes)
18/11/12 12:27:42 INFO TaskSetManager: Finished task 0.0 in stage 237.0 (TID 434) in 2873 ms on localhost (executor driver) (1/1)
18/11/12 12:27:42 INFO Executor: Running task 0.0 in stage 236.0 (TID 435)
18/11/12 12:27:42 INFO TaskSchedulerImpl: Removed TaskSet 237.0, whose tasks have all completed, from pool 
18/11/12 12:27:42 INFO DAGScheduler: ResultStage 237 (foreachPartition at XGBoost.scala:287) finished in 2.893 s
18/11/12 12:27:42 INFO DAGScheduler: Job 175 finished: foreachPartition at XGBoost.scala:287, took 2.903731 s
18/11/12 12:27:42 INFO ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks
18/11/12 12:27:42 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
18/11/12 12:27:42 INFO Executor: Finished task 0.0 in stage 236.0 (TID 435). 1594 bytes result sent to driver
18/11/12 12:27:42 INFO TaskSetManager: Starting task 0.0 in stage 238.0 (TID 436, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:42 INFO TaskSetManager: Finished task 0.0 in stage 236.0 (TID 435) in 4 ms on localhost (executor driver) (1/1)
18/11/12 12:27:42 INFO TaskSchedulerImpl: Removed TaskSet 236.0, whose tasks have all completed, from pool 
18/11/12 12:27:42 INFO Executor: Running task 0.0 in stage 238.0 (TID 436)
18/11/12 12:27:42 INFO DAGScheduler: ResultStage 236 (take at Classifier.scala:111) finished in 2.863 s
18/11/12 12:27:42 INFO DAGScheduler: Job 174 finished: take at Classifier.scala:111, took 2.915917 s
18/11/12 12:27:42 INFO XGBoostClassifier: ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier inferred 2 classes for labelCol=xgbc_8b6c15c2feb9__labelCol since numClasses was not specified in the column metadata.
18/11/12 12:27:42 INFO BlockManager: Found block rdd_182_0 locally
[INFO] [11/12/2018 12:27:42.437] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:42.439] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:42.439] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] All workers have started.
[12:27:42] Tree method is automatically selected to be 'approx' for distributed training.
18/11/12 12:27:42 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:42 INFO DAGScheduler: Got job 177 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:42 INFO DAGScheduler: Final stage: ResultStage 239 (first at XGBoost.scala:352)
18/11/12 12:27:42 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:42 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:42 INFO DAGScheduler: Submitting ResultStage 239 (MapPartitionsRDD[1090] at mapPartitions at XGBoost.scala:275), which has no missing parents
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:42.444] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Tracker listening @ 10.131.142.191:43417
[INFO] [11/12/2018 12:27:42.444] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Worker connection timeout is Duration.Inf.
[INFO] [11/12/2018 12:27:42.447] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [0]	train-error:0.134892
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=10
18/11/12 12:27:42 INFO SparkContext: Starting job: foreachPartition at XGBoost.scala:287
[INFO] [11/12/2018 12:27:42.457] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [1]	train-error:0.116906
18/11/12 12:27:42 INFO MemoryStore: Block broadcast_244 stored as values in memory (estimated size 543.8 KB, free 1978.9 MB)
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=9
18/11/12 12:27:42 INFO MemoryStore: Block broadcast_244_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1978.7 MB)
18/11/12 12:27:42 INFO BlockManagerInfo: Added broadcast_244_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1997.0 MB)
18/11/12 12:27:42 INFO SparkContext: Created broadcast 244 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:42 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 239 (MapPartitionsRDD[1090] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:42 INFO TaskSchedulerImpl: Adding task set 239.0 with 1 tasks
18/11/12 12:27:42 INFO DAGScheduler: Got job 178 (foreachPartition at XGBoost.scala:287) with 1 output partitions
18/11/12 12:27:42 INFO DAGScheduler: Final stage: ResultStage 240 (foreachPartition at XGBoost.scala:287)
18/11/12 12:27:42 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:42 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:42 INFO DAGScheduler: Submitting ResultStage 240 (MapPartitionsRDD[1106] at mapPartitions at XGBoost.scala:275), which has no missing parents
[INFO] [11/12/2018 12:27:42.465] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [2]	train-error:0.120504
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.473] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [3]	train-error:0.100719
[INFO] [11/12/2018 12:27:42.479] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [4]	train-error:0.100719
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=11
18/11/12 12:27:42 INFO MemoryStore: Block broadcast_245 stored as values in memory (estimated size 543.8 KB, free 1978.2 MB)
18/11/12 12:27:42 INFO MemoryStore: Block broadcast_245_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1978.0 MB)
18/11/12 12:27:42 INFO BlockManagerInfo: Added broadcast_245_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1996.9 MB)
18/11/12 12:27:42 INFO SparkContext: Created broadcast 245 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:42 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 240 (MapPartitionsRDD[1106] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:42 INFO TaskSchedulerImpl: Adding task set 240.0 with 1 tasks
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:42.486] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [5]	train-error:0.095324
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.493] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [6]	train-error:0.088129
[INFO] [11/12/2018 12:27:42.499] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [7]	train-error:0.084532
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.505] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [8]	train-error:0.075540
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.511] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [9]	train-error:0.059353
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.517] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [10]	train-error:0.053957
[INFO] [11/12/2018 12:27:42.522] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [11]	train-error:0.055755
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.527] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [12]	train-error:0.050360
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 26 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.532] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [13]	train-error:0.046763
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.537] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [14]	train-error:0.041367
[INFO] [11/12/2018 12:27:42.542] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [15]	train-error:0.037770
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.548] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [16]	train-error:0.034173
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.553] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [17]	train-error:0.030576
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.558] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [18]	train-error:0.032374
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.563] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [19]	train-error:0.025180
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.568] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [20]	train-error:0.017986
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.573] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [21]	train-error:0.016187
[INFO] [11/12/2018 12:27:42.578] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [22]	train-error:0.012590
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.583] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [23]	train-error:0.010791
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.588] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [24]	train-error:0.008993
[INFO] [11/12/2018 12:27:42.593] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [25]	train-error:0.007194
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.598] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [26]	train-error:0.005396
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.603] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [27]	train-error:0.003597
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.608] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28]	train-error:0.003597
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.613] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [29]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.618] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [30]	train-error:0.003597
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.624] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [31]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.632] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [32]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.641] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [33]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.649] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [34]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.657] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [35]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.667] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [36]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.675] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [37]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.686] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [38]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.698] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [39]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.710] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [40]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.721] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [41]	train-error:0.001799
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.732] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [42]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.746] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [43]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.759] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [44]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.770] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [45]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.778] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [46]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.786] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [47]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.794] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [48]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.800] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [49]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.806] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [50]	train-error:0.000000
[INFO] [11/12/2018 12:27:42.813] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [51]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.820] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [52]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.832] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [53]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.843] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [54]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:42.855] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [55]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.869] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [56]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.882] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [57]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:42.898] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [58]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.913] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [59]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.926] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [60]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.942] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [61]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.957] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [62]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:42.973] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [63]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.980] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [64]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.986] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [65]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.991] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [66]	train-error:0.000000
[12:27:42] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:42.996] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [67]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.001] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [68]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.006] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [69]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.011] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [70]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.015] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [71]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.020] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [72]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.025] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [73]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.030] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [74]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.040] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.051] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.058] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.069] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.077] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.086] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.094] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.104] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.114] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.126] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.138] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.147] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.158] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[INFO] [11/12/2018 12:27:43.163] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.169] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.175] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.181] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.186] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.191] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.197] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.206] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.216] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.224] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.229] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[12:27:43] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:43.239] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.242] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:45 INFO MemoryStore: Block rdd_1098_0 stored as values in memory (estimated size 584.0 B, free 1978.0 MB)
18/11/12 12:27:45 INFO BlockManagerInfo: Added rdd_1098_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1996.9 MB)
18/11/12 12:27:45 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:45 INFO Executor: 1 block locks were not released by TID = 436:
[rdd_1098_0]
18/11/12 12:27:45 INFO Executor: Finished task 0.0 in stage 238.0 (TID 436). 3428 bytes result sent to driver
18/11/12 12:27:45 INFO TaskSetManager: Starting task 0.0 in stage 239.0 (TID 437, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:45 INFO Executor: Running task 0.0 in stage 239.0 (TID 437)
18/11/12 12:27:45 INFO TaskSetManager: Finished task 0.0 in stage 238.0 (TID 436) in 2829 ms on localhost (executor driver) (1/1)
18/11/12 12:27:45 INFO TaskSchedulerImpl: Removed TaskSet 238.0, whose tasks have all completed, from pool 
18/11/12 12:27:45 INFO DAGScheduler: ResultStage 238 (foreachPartition at XGBoost.scala:287) finished in 5.706 s
18/11/12 12:27:45 INFO DAGScheduler: Job 176 finished: foreachPartition at XGBoost.scala:287, took 5.714263 s
18/11/12 12:27:45 INFO BlockManager: Found block rdd_1090_0 locally
18/11/12 12:27:45 INFO Executor: 1 block locks were not released by TID = 437:
[rdd_1090_0]
18/11/12 12:27:45 INFO Executor: Finished task 0.0 in stage 239.0 (TID 437). 257302 bytes result sent to driver
18/11/12 12:27:45 INFO TaskSetManager: Starting task 0.0 in stage 240.0 (TID 438, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:45 INFO Executor: Running task 0.0 in stage 240.0 (TID 438)
18/11/12 12:27:45 INFO TaskSetManager: Finished task 0.0 in stage 239.0 (TID 437) in 14 ms on localhost (executor driver) (1/1)
18/11/12 12:27:45 INFO TaskSchedulerImpl: Removed TaskSet 239.0, whose tasks have all completed, from pool 
18/11/12 12:27:45 INFO DAGScheduler: ResultStage 239 (first at XGBoost.scala:352) finished in 2.814 s
18/11/12 12:27:45 INFO DAGScheduler: Job 177 finished: first at XGBoost.scala:352, took 2.814494 s
18/11/12 12:27:45 INFO MapPartitionsRDD: Removing RDD 1090 from persistence list
18/11/12 12:27:45 INFO BlockManager: Removing RDD 1090
18/11/12 12:27:45 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:45 INFO DAGScheduler: Got job 179 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:45 INFO DAGScheduler: Final stage: ResultStage 241 (first at XGBoost.scala:352)
18/11/12 12:27:45 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:45 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:45 INFO DAGScheduler: Submitting ResultStage 241 (MapPartitionsRDD[1098] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:45 INFO BlockManager: Found block rdd_184_0 locally
18/11/12 12:27:45 INFO MemoryStore: Block broadcast_246 stored as values in memory (estimated size 543.8 KB, free 1977.5 MB)
[INFO] [11/12/2018 12:27:45.285] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] Received start signal from 10.131.142.191 [rank: 0]
[INFO] [11/12/2018 12:27:45.286] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] Worker 10.131.142.191 (rank: 0) has started.
[INFO] [11/12/2018 12:27:45.286] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] All workers have started.
18/11/12 12:27:45 INFO MemoryStore: Block broadcast_246_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1977.4 MB)
18/11/12 12:27:45 INFO BlockManagerInfo: Added broadcast_246_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1996.7 MB)
18/11/12 12:27:45 INFO SparkContext: Created broadcast 246 from broadcast at DAGScheduler.scala:1039
[12:27:45] Tree method is automatically selected to be 'approx' for distributed training.
18/11/12 12:27:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 241 (MapPartitionsRDD[1098] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:45 INFO TaskSchedulerImpl: Adding task set 241.0 with 1 tasks
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=9
[INFO] [11/12/2018 12:27:45.293] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [0]	train-error:0.150870
[INFO] [11/12/2018 12:27:45.297] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [1]	train-error:0.143133
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:45.302] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [2]	train-error:0.133462
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=10
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:45.307] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [3]	train-error:0.110251
[INFO] [11/12/2018 12:27:45.311] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [4]	train-error:0.106383
[INFO] [11/12/2018 12:27:45.316] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [5]	train-error:0.102515
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 52 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:45.322] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [6]	train-error:0.088975
[INFO] [11/12/2018 12:27:45.326] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [7]	train-error:0.077369
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.332] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [8]	train-error:0.077369
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.338] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [9]	train-error:0.069632
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:27:45 INFO CodeGenerator: Code generated in 13.856677 ms
[INFO] [11/12/2018 12:27:45.344] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [10]	train-error:0.065764
[INFO] [11/12/2018 12:27:45.350] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [11]	train-error:0.061896
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.356] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [12]	train-error:0.054159
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=11
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.360] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [13]	train-error:0.048356
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.366] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [14]	train-error:0.042553
[INFO] [11/12/2018 12:27:45.370] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [15]	train-error:0.042553
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 34 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.375] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [16]	train-error:0.032882
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.381] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [17]	train-error:0.021277
[INFO] [11/12/2018 12:27:45.387] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [18]	train-error:0.017408
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.392] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [19]	train-error:0.013540
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 44 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.397] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [20]	train-error:0.011605
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.404] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [21]	train-error:0.009671
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.411] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22]	train-error:0.005803
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.420] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [23]	train-error:0.003868
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.428] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [24]	train-error:0.001934
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.439] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [25]	train-error:0.001934
[INFO] [11/12/2018 12:27:45.445] [RabitTracker-akka.actor.default-dispatcher-5] [akka://RabitTracker/user/Handler] [26]	train-error:0.001934
18/11/12 12:27:45 INFO CodeGenerator: Code generated in 12.071346 ms
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.453] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [27]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.461] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [28]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.478] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [29]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.488] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [30]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:27:45 INFO CodeGenerator: Code generated in 51.062288 ms
[INFO] [11/12/2018 12:27:45.502] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [31]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:27:45 INFO SparkContext: Starting job: head at RichDataset.scala:425
18/11/12 12:27:45 INFO DAGScheduler: Got job 180 (head at RichDataset.scala:425) with 1 output partitions
18/11/12 12:27:45 INFO DAGScheduler: Final stage: ResultStage 242 (head at RichDataset.scala:425)
18/11/12 12:27:45 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:45 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:45 INFO DAGScheduler: Submitting ResultStage 242 (MapPartitionsRDD[1117] at head at RichDataset.scala:425), which has no missing parents
[INFO] [11/12/2018 12:27:45.520] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [32]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.533] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [33]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.549] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [34]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.562] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [35]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.577] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [36]	train-error:0.000000
18/11/12 12:27:45 INFO MemoryStore: Block broadcast_247 stored as values in memory (estimated size 640.9 KB, free 1976.7 MB)
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
18/11/12 12:27:45 INFO MemoryStore: Block broadcast_247_piece0 stored as bytes in memory (estimated size 188.1 KB, free 1976.5 MB)
18/11/12 12:27:45 INFO BlockManagerInfo: Added broadcast_247_piece0 in memory on 127.0.0.1:61956 (size: 188.1 KB, free: 1996.5 MB)
18/11/12 12:27:45 INFO SparkContext: Created broadcast 247 from broadcast at DAGScheduler.scala:1039
[INFO] [11/12/2018 12:27:45.592] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [37]	train-error:0.000000
18/11/12 12:27:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 242 (MapPartitionsRDD[1117] at head at RichDataset.scala:425) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:45 INFO TaskSchedulerImpl: Adding task set 242.0 with 1 tasks
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.599] [RabitTracker-akka.actor.default-dispatcher-11] [akka://RabitTracker/user/Handler] [38]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.608] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [39]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.613] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [40]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.619] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [41]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.624] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [42]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.629] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [43]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.633] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [44]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.639] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [45]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.644] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [46]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.651] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [47]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:45.661] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [48]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.674] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [49]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.682] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [50]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.693] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [51]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.706] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [52]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 72 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.717] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [53]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.731] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [54]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.741] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [55]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.756] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [56]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.769] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [57]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.779] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [58]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.789] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [59]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.795] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [60]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 80 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:45.800] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [61]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 40 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.806] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [62]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.811] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [63]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.816] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [64]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 70 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.821] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [65]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.826] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [66]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.831] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [67]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.836] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [68]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.841] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [69]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.846] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [70]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.852] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [71]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 54 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.857] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [72]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 84 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:45.864] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [73]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.873] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [74]	train-error:0.000000
[INFO] [11/12/2018 12:27:45.879] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [75]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 36 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.892] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [76]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 62 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.900] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [77]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.911] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [78]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=11
[INFO] [11/12/2018 12:27:45.924] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [79]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.934] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [80]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 66 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.945] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [81]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.957] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [82]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.969] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [83]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.982] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [84]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 58 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:45.994] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [85]	train-error:0.000000
[12:27:45] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 60 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.004] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [86]	train-error:0.000000
[INFO] [11/12/2018 12:27:46.011] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [87]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 46 extra nodes, 0 pruned nodes, max_depth=12
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 82 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:46.017] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [88]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.023] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [89]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 68 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.028] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [90]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 48 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.033] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [91]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 64 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.038] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [92]	train-error:0.000000
[INFO] [11/12/2018 12:27:46.044] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [93]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 78 extra nodes, 0 pruned nodes, max_depth=12
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 50 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.048] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [94]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.054] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [95]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.060] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [96]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 76 extra nodes, 0 pruned nodes, max_depth=10
[INFO] [11/12/2018 12:27:46.073] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [97]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 74 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.080] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [98]	train-error:0.000000
[12:27:46] /Users/nanzhu/code/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 56 extra nodes, 0 pruned nodes, max_depth=12
[INFO] [11/12/2018 12:27:46.092] [RabitTracker-akka.actor.default-dispatcher-8] [akka://RabitTracker/user/Handler] [99]	train-error:0.000000
[INFO] [11/12/2018 12:27:48.094] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] Received shutdown signal from 0
18/11/12 12:27:48 INFO MemoryStore: Block rdd_1106_0 stored as values in memory (estimated size 584.0 B, free 1976.5 MB)
18/11/12 12:27:48 INFO BlockManagerInfo: Added rdd_1106_0 in memory on 127.0.0.1:61956 (size: 584.0 B, free: 1996.5 MB)
18/11/12 12:27:48 INFO XGBoostSpark: Rabit returns with exit code 0
18/11/12 12:27:48 INFO Executor: 1 block locks were not released by TID = 438:
[rdd_1106_0]
18/11/12 12:27:48 INFO Executor: Finished task 0.0 in stage 240.0 (TID 438). 3428 bytes result sent to driver
18/11/12 12:27:48 INFO TaskSetManager: Starting task 0.0 in stage 241.0 (TID 439, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:48 INFO TaskSetManager: Finished task 0.0 in stage 240.0 (TID 438) in 2838 ms on localhost (executor driver) (1/1)
18/11/12 12:27:48 INFO Executor: Running task 0.0 in stage 241.0 (TID 439)
18/11/12 12:27:48 INFO TaskSchedulerImpl: Removed TaskSet 240.0, whose tasks have all completed, from pool 
18/11/12 12:27:48 INFO DAGScheduler: ResultStage 240 (foreachPartition at XGBoost.scala:287) finished in 5.631 s
18/11/12 12:27:48 INFO DAGScheduler: Job 178 finished: foreachPartition at XGBoost.scala:287, took 5.642047 s
18/11/12 12:27:48 INFO BlockManager: Found block rdd_1098_0 locally
18/11/12 12:27:48 INFO Executor: 1 block locks were not released by TID = 439:
[rdd_1098_0]
18/11/12 12:27:48 INFO Executor: Finished task 0.0 in stage 241.0 (TID 439). 264436 bytes result sent to driver
18/11/12 12:27:48 INFO TaskSetManager: Starting task 0.0 in stage 242.0 (TID 440, localhost, executor driver, partition 0, PROCESS_LOCAL, 8465 bytes)
18/11/12 12:27:48 INFO Executor: Running task 0.0 in stage 242.0 (TID 440)
18/11/12 12:27:48 INFO TaskSetManager: Finished task 0.0 in stage 241.0 (TID 439) in 11 ms on localhost (executor driver) (1/1)
18/11/12 12:27:48 INFO TaskSchedulerImpl: Removed TaskSet 241.0, whose tasks have all completed, from pool 
18/11/12 12:27:48 INFO DAGScheduler: ResultStage 241 (first at XGBoost.scala:352) finished in 2.834 s
18/11/12 12:27:48 INFO DAGScheduler: Job 179 finished: first at XGBoost.scala:352, took 2.835285 s
18/11/12 12:27:48 INFO MapPartitionsRDD: Removing RDD 1098 from persistence list
18/11/12 12:27:48 INFO BlockManager: Removing RDD 1098
18/11/12 12:27:48 INFO SparkContext: Starting job: first at XGBoost.scala:352
18/11/12 12:27:48 INFO DAGScheduler: Got job 181 (first at XGBoost.scala:352) with 1 output partitions
18/11/12 12:27:48 INFO DAGScheduler: Final stage: ResultStage 243 (first at XGBoost.scala:352)
18/11/12 12:27:48 INFO DAGScheduler: Parents of final stage: List()
18/11/12 12:27:48 INFO DAGScheduler: Missing parents: List()
18/11/12 12:27:48 INFO DAGScheduler: Submitting ResultStage 243 (MapPartitionsRDD[1106] at mapPartitions at XGBoost.scala:275), which has no missing parents
18/11/12 12:27:48 INFO BlockManager: Found block rdd_159_0 locally
18/11/12 12:27:48 INFO MemoryStore: Block rdd_180_0 stored as values in memory (estimated size 69.5 KB, free 1976.5 MB)
18/11/12 12:27:48 INFO BlockManagerInfo: Added rdd_180_0 in memory on 127.0.0.1:61956 (size: 69.5 KB, free: 1996.5 MB)
18/11/12 12:27:48 INFO MemoryStore: Block broadcast_248 stored as values in memory (estimated size 543.8 KB, free 1975.9 MB)
18/11/12 12:27:48 INFO MemoryStore: Block broadcast_248_piece0 stored as bytes in memory (estimated size 153.1 KB, free 1975.8 MB)
18/11/12 12:27:48 INFO BlockManagerInfo: Added broadcast_248_piece0 in memory on 127.0.0.1:61956 (size: 153.1 KB, free: 1996.3 MB)
18/11/12 12:27:48 INFO SparkContext: Created broadcast 248 from broadcast at DAGScheduler.scala:1039
18/11/12 12:27:48 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 243 (MapPartitionsRDD[1106] at mapPartitions at XGBoost.scala:275) (first 15 tasks are for partitions Vector(0))
18/11/12 12:27:48 INFO TaskSchedulerImpl: Adding task set 243.0 with 1 tasks
18/11/12 12:27:48 INFO CodeGenerator: Code generated in 18.023398 ms
Doing rabit call after Finalize

Process finished with exit code 255