l1evodiff

1606880 model parameters
138376 training sequences
34323 validation sequences
Training: Epoch 1 of 10 Step 1 ntokens 35400 Example 300 of 138376 loss = 3.5024 nll loss = 2.1794 accu = 0.3541

Training: Epoch 1 of 10 Step 2 ntokens 70800 Example 600 of 138376 loss = 3.4985 nll loss = 2.1663 accu = 0.3582

Training: Epoch 1 of 10 Step 3 ntokens 106200 Example 900 of 138376 loss = 3.4930 nll loss = 2.1655 accu = 0.3574

Training: Epoch 1 of 10 Step 4 ntokens 141600 Example 1200 of 138376 loss = 3.4911 nll loss = 2.1529 accu = 0.3613

Training: Epoch 1 of 10 Step 5 ntokens 177000 Example 1500 of 138376 loss = 3.4935 nll loss = 2.1627 accu = 0.3579

Training: Epoch 1 of 10 Step 6 ntokens 212400 Example 1800 of 138376 loss = 3.4889 nll loss = 2.1669 accu = 0.3568

Training: Epoch 1 of 10 Step 7 ntokens 247800 Example 2100 of 138376 loss = 3.4968 nll loss = 2.1591 accu = 0.3595

Training: Epoch 1 of 10 Step 8 ntokens 283200 Example 2400 of 138376 loss = 3.4918 nll loss = 2.1493 accu = 0.3625

Training: Epoch 1 of 10 Step 9 ntokens 318600 Example 2700 of 138376 loss = 3.4946 nll loss = 2.1501 accu = 0.3625

Training: Epoch 1 of 10 Step 10 ntokens 354000 Example 3000 of 138376 loss = 3.4906 nll loss = 2.1479 accu = 0.3632

Training: Epoch 1 of 10 Step 11 ntokens 389400 Example 3300 of 138376 loss = 3.4935 nll loss = 2.1449 accu = 0.3642

Training: Epoch 1 of 10 Step 12 ntokens 424800 Example 3600 of 138376 loss = 3.5019 nll loss = 2.1398 accu = 0.3661

Training: Epoch 1 of 10 Step 13 ntokens 460200 Example 3900 of 138376 loss = 3.5017 nll loss = 2.1410 accu = 0.3660

Training: Epoch 1 of 10 Step 14 ntokens 495600 Example 4200 of 138376 loss = 3.5037 nll loss = 2.1433 accu = 0.3652

Training: Epoch 1 of 10 Step 15 ntokens 531000 Example 4500 of 138376 loss = 3.4976 nll loss = 2.1423 accu = 0.3654

Training: Epoch 1 of 10 Step 16 ntokens 566400 Example 4800 of 138376 loss = 3.4954 nll loss = 2.1449 accu = 0.3647

Training: Epoch 1 of 10 Step 17 ntokens 601800 Example 5100 of 138376 loss = 3.4893 nll loss = 2.1455 accu = 0.3647

Training: Epoch 1 of 10 Step 18 ntokens 637200 Example 5400 of 138376 loss = 3.4946 nll loss = 2.1474 accu = 0.3641

Training: Epoch 1 of 10 Step 19 ntokens 672600 Example 5700 of 138376 loss = 3.4909 nll loss = 2.1423 accu = 0.3660

Training: Epoch 1 of 10 Step 20 ntokens 708000 Example 6000 of 138376 loss = 3.4874 nll loss = 2.1442 accu = 0.3655

Training: Epoch 1 of 10 Step 21 ntokens 743400 Example 6300 of 138376 loss = 3.4866 nll loss = 2.1433 accu = 0.3658

Training: Epoch 1 of 10 Step 22 ntokens 778800 Example 6600 of 138376 loss = 3.4897 nll loss = 2.1439 accu = 0.3655

Training: Epoch 1 of 10 Step 23 ntokens 814200 Example 6900 of 138376 loss = 3.4885 nll loss = 2.1434 accu = 0.3656

Training: Epoch 1 of 10 Step 24 ntokens 849600 Example 7200 of 138376 loss = 3.4880 nll loss = 2.1419 accu = 0.3662

Training: Epoch 1 of 10 Step 25 ntokens 885000 Example 7500 of 138376 loss = 3.4899 nll loss = 2.1417 accu = 0.3665

Training: Epoch 1 of 10 Step 26 ntokens 920400 Example 7800 of 138376 loss = 3.4924 nll loss = 2.1417 accu = 0.3664

Training: Epoch 1 of 10 Step 27 ntokens 955800 Example 8100 of 138376 loss = 3.4954 nll loss = 2.1420 accu = 0.3663

Training: Epoch 1 of 10 Step 28 ntokens 991200 Example 8400 of 138376 loss = 3.4933 nll loss = 2.1420 accu = 0.3663

Training: Epoch 1 of 10 Step 29 ntokens 1026600 Example 8700 of 138376 loss = 3.4939 nll loss = 2.1417 accu = 0.3665

Training: Epoch 1 of 10 Step 30 ntokens 1062000 Example 9000 of 138376 loss = 3.4916 nll loss = 2.1415 accu = 0.3666

Training: Epoch 1 of 10 Step 31 ntokens 1097400 Example 9300 of 138376 loss = 3.4925 nll loss = 2.1414 accu = 0.3666

Training: Epoch 1 of 10 Step 32 ntokens 1132800 Example 9600 of 138376 loss = 3.4923 nll loss = 2.1430 accu = 0.3661

Training: Epoch 1 of 10 Step 33 ntokens 1168200 Example 9900 of 138376 loss = 3.4963 nll loss = 2.1440 accu = 0.3657

Training: Epoch 1 of 10 Step 34 ntokens 1203600 Example 10200 of 138376 loss = 3.4974 nll loss = 2.1440 accu = 0.3658

Training: Epoch 1 of 10 Step 35 ntokens 1239000 Example 10500 of 138376 loss = 3.5000 nll loss = 2.1404 accu = 0.3670

Training: Epoch 1 of 10 Step 36 ntokens 1274400 Example 10800 of 138376 loss = 3.5012 nll loss = 2.1395 accu = 0.3671

Training: Epoch 1 of 10 Step 37 ntokens 1309800 Example 11100 of 138376 loss = 3.5016 nll loss = 2.1404 accu = 0.3668

Training: Epoch 1 of 10 Step 38 ntokens 1345200 Example 11400 of 138376 loss = 3.5009 nll loss = 2.1398 accu = 0.3670

Training: Epoch 1 of 10 Step 39 ntokens 1380600 Example 11700 of 138376 loss = 3.5005 nll loss = 2.1409 accu = 0.3666

Training: Epoch 1 of 10 Step 40 ntokens 1416000 Example 12000 of 138376 loss = 3.5002 nll loss = 2.1420 accu = 0.3661

Training: Epoch 1 of 10 Step 41 ntokens 1451400 Example 12300 of 138376 loss = 3.5008 nll loss = 2.1429 accu = 0.3658

Training: Epoch 1 of 10 Step 42 ntokens 1486800 Example 12600 of 138376 loss = 3.4974 nll loss = 2.1425 accu = 0.3660

Training: Epoch 1 of 10 Step 43 ntokens 1522200 Example 12900 of 138376 loss = 3.4971 nll loss = 2.1441 accu = 0.3654

Training: Epoch 1 of 10 Step 44 ntokens 1557600 Example 13200 of 138376 loss = 3.4955 nll loss = 2.1439 accu = 0.3654

Training: Epoch 1 of 10 Step 45 ntokens 1593000 Example 13500 of 138376 loss = 3.4962 nll loss = 2.1457 accu = 0.3648

Training: Epoch 1 of 10 Step 46 ntokens 1628400 Example 13800 of 138376 loss = 3.4966 nll loss = 2.1446 accu = 0.3651

Training: Epoch 1 of 10 Step 47 ntokens 1663800 Example 14100 of 138376 loss = 3.4964 nll loss = 2.1448 accu = 0.3650

Training: Epoch 1 of 10 Step 48 ntokens 1699200 Example 14400 of 138376 loss = 3.4983 nll loss = 2.1438 accu = 0.3654

Training: Epoch 1 of 10 Step 49 ntokens 1734600 Example 14700 of 138376 loss = 3.4988 nll loss = 2.1432 accu = 0.3656

Training: Epoch 1 of 10 Step 50 ntokens 1770000 Example 15000 of 138376 loss = 3.5002 nll loss = 2.1434 accu = 0.3655

Training: Epoch 1 of 10 Step 51 ntokens 1805400 Example 15300 of 138376 loss = 3.5016 nll loss = 2.1425 accu = 0.3658

Training: Epoch 1 of 10 Step 52 ntokens 1840800 Example 15600 of 138376 loss = 3.5021 nll loss = 2.1442 accu = 0.3652

Training: Epoch 1 of 10 Step 53 ntokens 1876200 Example 15900 of 138376 loss = 3.5023 nll loss = 2.1430 accu = 0.3656

Training: Epoch 1 of 10 Step 54 ntokens 1911600 Example 16200 of 138376 loss = 3.5025 nll loss = 2.1426 accu = 0.3657

Training: Epoch 1 of 10 Step 55 ntokens 1947000 Example 16500 of 138376 loss = 3.5022 nll loss = 2.1426 accu = 0.3658

Training: Epoch 1 of 10 Step 56 ntokens 1982400 Example 16800 of 138376 loss = 3.5019 nll loss = 2.1413 accu = 0.3663

Training: Epoch 1 of 10 Step 57 ntokens 2017800 Example 17100 of 138376 loss = 3.5015 nll loss = 2.1410 accu = 0.3664

Training: Epoch 1 of 10 Step 58 ntokens 2053200 Example 17400 of 138376 loss = 3.4998 nll loss = 2.1418 accu = 0.3661

Training: Epoch 1 of 10 Step 59 ntokens 2088600 Example 17700 of 138376 loss = 3.5004 nll loss = 2.1434 accu = 0.3656

Training: Epoch 1 of 10 Step 60 ntokens 2124000 Example 18000 of 138376 loss = 3.5003 nll loss = 2.1430 accu = 0.3657

Training: Epoch 1 of 10 Step 61 ntokens 2159400 Example 18300 of 138376 loss = 3.5013 nll loss = 2.1441 accu = 0.3654

Training: Epoch 1 of 10 Step 62 ntokens 2194800 Example 18600 of 138376 loss = 3.5040 nll loss = 2.1444 accu = 0.3653

Training: Epoch 1 of 10 Step 63 ntokens 2230200 Example 18900 of 138376 loss = 3.5042 nll loss = 2.1435 accu = 0.3656

Training: Epoch 1 of 10 Step 64 ntokens 2265600 Example 19200 of 138376 loss = 3.5052 nll loss = 2.1433 accu = 0.3657

Training: Epoch 1 of 10 Step 65 ntokens 2301000 Example 19500 of 138376 loss = 3.5046 nll loss = 2.1433 accu = 0.3657

Training: Epoch 1 of 10 Step 66 ntokens 2336400 Example 19800 of 138376 loss = 3.5036 nll loss = 2.1428 accu = 0.3659

Training: Epoch 1 of 10 Step 67 ntokens 2371800 Example 20100 of 138376 loss = 3.5030 nll loss = 2.1416 accu = 0.3663

Training: Epoch 1 of 10 Step 68 ntokens 2407200 Example 20400 of 138376 loss = 3.5030 nll loss = 2.1413 accu = 0.3665

Training: Epoch 1 of 10 Step 69 ntokens 2442600 Example 20700 of 138376 loss = 3.5023 nll loss = 2.1419 accu = 0.3663

Training: Epoch 1 of 10 Step 70 ntokens 2478000 Example 21000 of 138376 loss = 3.5017 nll loss = 2.1427 accu = 0.3660

Training: Epoch 1 of 10 Step 71 ntokens 2513400 Example 21300 of 138376 loss = 3.5010 nll loss = 2.1429 accu = 0.3660

Training: Epoch 1 of 10 Step 72 ntokens 2548800 Example 21600 of 138376 loss = 3.5019 nll loss = 2.1434 accu = 0.3658

Training: Epoch 1 of 10 Step 73 ntokens 2584200 Example 21900 of 138376 loss = 3.5017 nll loss = 2.1433 accu = 0.3658

Training: Epoch 1 of 10 Step 74 ntokens 2619600 Example 22200 of 138376 loss = 3.5005 nll loss = 2.1425 accu = 0.3661

Training: Epoch 1 of 10 Step 75 ntokens 2655000 Example 22500 of 138376 loss = 3.5017 nll loss = 2.1417 accu = 0.3664

Training: Epoch 1 of 10 Step 76 ntokens 2690400 Example 22800 of 138376 loss = 3.5032 nll loss = 2.1424 accu = 0.3661

Training: Epoch 1 of 10 Step 77 ntokens 2725800 Example 23100 of 138376 loss = 3.5024 nll loss = 2.1415 accu = 0.3664

Training: Epoch 1 of 10 Step 78 ntokens 2761200 Example 23400 of 138376 loss = 3.5025 nll loss = 2.1423 accu = 0.3662

Training: Epoch 1 of 10 Step 79 ntokens 2796600 Example 23700 of 138376 loss = 3.5017 nll loss = 2.1426 accu = 0.3660

Training: Epoch 1 of 10 Step 80 ntokens 2832000 Example 24000 of 138376 loss = 3.5015 nll loss = 2.1424 accu = 0.3661

Training: Epoch 1 of 10 Step 81 ntokens 2867400 Example 24300 of 138376 loss = 3.5024 nll loss = 2.1424 accu = 0.3662

Training: Epoch 1 of 10 Step 82 ntokens 2902800 Example 24600 of 138376 loss = 3.5031 nll loss = 2.1413 accu = 0.3666

Training: Epoch 1 of 10 Step 83 ntokens 2938200 Example 24900 of 138376 loss = 3.5020 nll loss = 2.1412 accu = 0.3666

Training: Epoch 1 of 10 Step 84 ntokens 2973600 Example 25200 of 138376 loss = 3.5009 nll loss = 2.1410 accu = 0.3667

Training: Epoch 1 of 10 Step 85 ntokens 3009000 Example 25500 of 138376 loss = 3.5001 nll loss = 2.1410 accu = 0.3666

Training: Epoch 1 of 10 Step 86 ntokens 3044400 Example 25800 of 138376 loss = 3.5004 nll loss = 2.1415 accu = 0.3665

Training: Epoch 1 of 10 Step 87 ntokens 3079800 Example 26100 of 138376 loss = 3.4998 nll loss = 2.1413 accu = 0.3665

Training: Epoch 1 of 10 Step 88 ntokens 3115200 Example 26400 of 138376 loss = 3.5010 nll loss = 2.1413 accu = 0.3666

Training: Epoch 1 of 10 Step 89 ntokens 3150600 Example 26700 of 138376 loss = 3.5008 nll loss = 2.1408 accu = 0.3667

Training: Epoch 1 of 10 Step 90 ntokens 3186000 Example 27000 of 138376 loss = 3.5006 nll loss = 2.1406 accu = 0.3668

Training: Epoch 1 of 10 Step 91 ntokens 3221400 Example 27300 of 138376 loss = 3.5002 nll loss = 2.1403 accu = 0.3669

Training: Epoch 1 of 10 Step 92 ntokens 3256800 Example 27600 of 138376 loss = 3.5005 nll loss = 2.1403 accu = 0.3669

Training: Epoch 1 of 10 Step 93 ntokens 3292200 Example 27900 of 138376 loss = 3.4993 nll loss = 2.1404 accu = 0.3669

Training: Epoch 1 of 10 Step 94 ntokens 3327600 Example 28200 of 138376 loss = 3.4987 nll loss = 2.1397 accu = 0.3672

Training: Epoch 1 of 10 Step 95 ntokens 3363000 Example 28500 of 138376 loss = 3.4993 nll loss = 2.1393 accu = 0.3674

Training: Epoch 1 of 10 Step 96 ntokens 3398400 Example 28800 of 138376 loss = 3.4995 nll loss = 2.1392 accu = 0.3674

Training: Epoch 1 of 10 Step 97 ntokens 3433800 Example 29100 of 138376 loss = 3.4988 nll loss = 2.1385 accu = 0.3676

Training: Epoch 1 of 10 Step 98 ntokens 3469200 Example 29400 of 138376 loss = 3.4985 nll loss = 2.1376 accu = 0.3679

Training: Epoch 1 of 10 Step 99 ntokens 3504600 Example 29700 of 138376 loss = 3.4978 nll loss = 2.1380 accu = 0.3678

Training: Epoch 1 of 10 Step 100 ntokens 3540000 Example 30000 of 138376 loss = 3.4981 nll loss = 2.1375 accu = 0.3680

Training: Epoch 1 of 10 Step 101 ntokens 3575400 Example 30300 of 138376 loss = 3.4977 nll loss = 2.1374 accu = 0.3680

Training: Epoch 1 of 10 Step 102 ntokens 3610800 Example 30600 of 138376 loss = 3.4976 nll loss = 2.1372 accu = 0.3681

Training: Epoch 1 of 10 Step 103 ntokens 3646200 Example 30900 of 138376 loss = 3.4980 nll loss = 2.1374 accu = 0.3680

Training: Epoch 1 of 10 Step 104 ntokens 3681600 Example 31200 of 138376 loss = 3.4980 nll loss = 2.1368 accu = 0.3682

Training: Epoch 1 of 10 Step 105 ntokens 3717000 Example 31500 of 138376 loss = 3.4979 nll loss = 2.1365 accu = 0.3683

Training: Epoch 1 of 10 Step 106 ntokens 3752400 Example 31800 of 138376 loss = 3.4969 nll loss = 2.1365 accu = 0.3683

Training: Epoch 1 of 10 Step 107 ntokens 3787800 Example 32100 of 138376 loss = 3.4965 nll loss = 2.1357 accu = 0.3686

Training: Epoch 1 of 10 Step 108 ntokens 3823200 Example 32400 of 138376 loss = 3.4971 nll loss = 2.1362 accu = 0.3685

Training: Epoch 1 of 10 Step 109 ntokens 3858600 Example 32700 of 138376 loss = 3.4976 nll loss = 2.1362 accu = 0.3685

Training: Epoch 1 of 10 Step 110 ntokens 3894000 Example 33000 of 138376 loss = 3.4967 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 111 ntokens 3929400 Example 33300 of 138376 loss = 3.4965 nll loss = 2.1351 accu = 0.3688

Training: Epoch 1 of 10 Step 112 ntokens 3964800 Example 33600 of 138376 loss = 3.4960 nll loss = 2.1352 accu = 0.3688

Training: Epoch 1 of 10 Step 113 ntokens 4000200 Example 33900 of 138376 loss = 3.4959 nll loss = 2.1352 accu = 0.3688

Training: Epoch 1 of 10 Step 114 ntokens 4035600 Example 34200 of 138376 loss = 3.4968 nll loss = 2.1354 accu = 0.3688

Training: Epoch 1 of 10 Step 115 ntokens 4071000 Example 34500 of 138376 loss = 3.4959 nll loss = 2.1357 accu = 0.3686

Training: Epoch 1 of 10 Step 116 ntokens 4106400 Example 34800 of 138376 loss = 3.4955 nll loss = 2.1361 accu = 0.3685

Training: Epoch 1 of 10 Step 117 ntokens 4141800 Example 35100 of 138376 loss = 3.4956 nll loss = 2.1360 accu = 0.3686

Training: Epoch 1 of 10 Step 118 ntokens 4177200 Example 35400 of 138376 loss = 3.4949 nll loss = 2.1365 accu = 0.3684

Training: Epoch 1 of 10 Step 119 ntokens 4212600 Example 35700 of 138376 loss = 3.4947 nll loss = 2.1367 accu = 0.3683

Training: Epoch 1 of 10 Step 120 ntokens 4248000 Example 36000 of 138376 loss = 3.4953 nll loss = 2.1368 accu = 0.3683

Training: Epoch 1 of 10 Step 121 ntokens 4283400 Example 36300 of 138376 loss = 3.4959 nll loss = 2.1373 accu = 0.3682

Training: Epoch 1 of 10 Step 122 ntokens 4318800 Example 36600 of 138376 loss = 3.4959 nll loss = 2.1373 accu = 0.3682

Training: Epoch 1 of 10 Step 123 ntokens 4354200 Example 36900 of 138376 loss = 3.4962 nll loss = 2.1372 accu = 0.3682

Training: Epoch 1 of 10 Step 124 ntokens 4389600 Example 37200 of 138376 loss = 3.4963 nll loss = 2.1373 accu = 0.3681

Training: Epoch 1 of 10 Step 125 ntokens 4425000 Example 37500 of 138376 loss = 3.4964 nll loss = 2.1370 accu = 0.3682

Training: Epoch 1 of 10 Step 126 ntokens 4460400 Example 37800 of 138376 loss = 3.4967 nll loss = 2.1373 accu = 0.3681

Training: Epoch 1 of 10 Step 127 ntokens 4495800 Example 38100 of 138376 loss = 3.4962 nll loss = 2.1366 accu = 0.3684

Training: Epoch 1 of 10 Step 128 ntokens 4531200 Example 38400 of 138376 loss = 3.4962 nll loss = 2.1368 accu = 0.3683

Training: Epoch 1 of 10 Step 129 ntokens 4566600 Example 38700 of 138376 loss = 3.4971 nll loss = 2.1369 accu = 0.3683

Training: Epoch 1 of 10 Step 130 ntokens 4602000 Example 39000 of 138376 loss = 3.4966 nll loss = 2.1366 accu = 0.3684

Training: Epoch 1 of 10 Step 131 ntokens 4637400 Example 39300 of 138376 loss = 3.4972 nll loss = 2.1369 accu = 0.3683

Training: Epoch 1 of 10 Step 132 ntokens 4672800 Example 39600 of 138376 loss = 3.4974 nll loss = 2.1373 accu = 0.3681

Training: Epoch 1 of 10 Step 133 ntokens 4708200 Example 39900 of 138376 loss = 3.4976 nll loss = 2.1377 accu = 0.3679

Training: Epoch 1 of 10 Step 134 ntokens 4743600 Example 40200 of 138376 loss = 3.4972 nll loss = 2.1381 accu = 0.3678

Training: Epoch 1 of 10 Step 135 ntokens 4779000 Example 40500 of 138376 loss = 3.4975 nll loss = 2.1375 accu = 0.3680

Training: Epoch 1 of 10 Step 136 ntokens 4814400 Example 40800 of 138376 loss = 3.4972 nll loss = 2.1377 accu = 0.3680

Training: Epoch 1 of 10 Step 137 ntokens 4849800 Example 41100 of 138376 loss = 3.4968 nll loss = 2.1384 accu = 0.3677

Training: Epoch 1 of 10 Step 138 ntokens 4885200 Example 41400 of 138376 loss = 3.4966 nll loss = 2.1385 accu = 0.3677

Training: Epoch 1 of 10 Step 139 ntokens 4920600 Example 41700 of 138376 loss = 3.4970 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 140 ntokens 4956000 Example 42000 of 138376 loss = 3.4975 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 141 ntokens 4991400 Example 42300 of 138376 loss = 3.4983 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 142 ntokens 5026800 Example 42600 of 138376 loss = 3.4986 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 143 ntokens 5062200 Example 42900 of 138376 loss = 3.4981 nll loss = 2.1386 accu = 0.3677

Training: Epoch 1 of 10 Step 144 ntokens 5097600 Example 43200 of 138376 loss = 3.4983 nll loss = 2.1387 accu = 0.3676

Training: Epoch 1 of 10 Step 145 ntokens 5133000 Example 43500 of 138376 loss = 3.4984 nll loss = 2.1385 accu = 0.3677

Training: Epoch 1 of 10 Step 146 ntokens 5168400 Example 43800 of 138376 loss = 3.4989 nll loss = 2.1385 accu = 0.3677

Training: Epoch 1 of 10 Step 147 ntokens 5203800 Example 44100 of 138376 loss = 3.4992 nll loss = 2.1387 accu = 0.3676

Training: Epoch 1 of 10 Step 148 ntokens 5239200 Example 44400 of 138376 loss = 3.4993 nll loss = 2.1390 accu = 0.3675

Training: Epoch 1 of 10 Step 149 ntokens 5274600 Example 44700 of 138376 loss = 3.4988 nll loss = 2.1393 accu = 0.3674

Training: Epoch 1 of 10 Step 150 ntokens 5310000 Example 45000 of 138376 loss = 3.4988 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 151 ntokens 5345400 Example 45300 of 138376 loss = 3.4985 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 152 ntokens 5380800 Example 45600 of 138376 loss = 3.4994 nll loss = 2.1386 accu = 0.3677

Training: Epoch 1 of 10 Step 153 ntokens 5416200 Example 45900 of 138376 loss = 3.5000 nll loss = 2.1388 accu = 0.3676

Training: Epoch 1 of 10 Step 154 ntokens 5451600 Example 46200 of 138376 loss = 3.4998 nll loss = 2.1384 accu = 0.3678

Training: Epoch 1 of 10 Step 155 ntokens 5487000 Example 46500 of 138376 loss = 3.5000 nll loss = 2.1381 accu = 0.3679

Training: Epoch 1 of 10 Step 156 ntokens 5522400 Example 46800 of 138376 loss = 3.5000 nll loss = 2.1374 accu = 0.3681

Training: Epoch 1 of 10 Step 157 ntokens 5557800 Example 47100 of 138376 loss = 3.4997 nll loss = 2.1371 accu = 0.3682

Training: Epoch 1 of 10 Step 158 ntokens 5593200 Example 47400 of 138376 loss = 3.4990 nll loss = 2.1364 accu = 0.3685

Training: Epoch 1 of 10 Step 159 ntokens 5628600 Example 47700 of 138376 loss = 3.4991 nll loss = 2.1361 accu = 0.3686

Training: Epoch 1 of 10 Step 160 ntokens 5664000 Example 48000 of 138376 loss = 3.4992 nll loss = 2.1361 accu = 0.3686

Training: Epoch 1 of 10 Step 161 ntokens 5699400 Example 48300 of 138376 loss = 3.4992 nll loss = 2.1358 accu = 0.3687

Training: Epoch 1 of 10 Step 162 ntokens 5734800 Example 48600 of 138376 loss = 3.4988 nll loss = 2.1353 accu = 0.3688

Training: Epoch 1 of 10 Step 163 ntokens 5770200 Example 48900 of 138376 loss = 3.4992 nll loss = 2.1357 accu = 0.3687

Training: Epoch 1 of 10 Step 164 ntokens 5805600 Example 49200 of 138376 loss = 3.4992 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 165 ntokens 5841000 Example 49500 of 138376 loss = 3.4987 nll loss = 2.1359 accu = 0.3686

Training: Epoch 1 of 10 Step 166 ntokens 5876400 Example 49800 of 138376 loss = 3.4989 nll loss = 2.1357 accu = 0.3687

Training: Epoch 1 of 10 Step 167 ntokens 5911800 Example 50100 of 138376 loss = 3.4986 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 168 ntokens 5947200 Example 50400 of 138376 loss = 3.4984 nll loss = 2.1353 accu = 0.3688

Training: Epoch 1 of 10 Step 169 ntokens 5982600 Example 50700 of 138376 loss = 3.4981 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 170 ntokens 6018000 Example 51000 of 138376 loss = 3.4981 nll loss = 2.1351 accu = 0.3688

Training: Epoch 1 of 10 Step 171 ntokens 6053400 Example 51300 of 138376 loss = 3.4987 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 172 ntokens 6088800 Example 51600 of 138376 loss = 3.4987 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 173 ntokens 6124200 Example 51900 of 138376 loss = 3.4992 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 174 ntokens 6159600 Example 52200 of 138376 loss = 3.4996 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 175 ntokens 6195000 Example 52500 of 138376 loss = 3.4998 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 176 ntokens 6230400 Example 52800 of 138376 loss = 3.4998 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 177 ntokens 6265800 Example 53100 of 138376 loss = 3.5004 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 178 ntokens 6301200 Example 53400 of 138376 loss = 3.5002 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 179 ntokens 6336600 Example 53700 of 138376 loss = 3.5002 nll loss = 2.1345 accu = 0.3690

Training: Epoch 1 of 10 Step 180 ntokens 6372000 Example 54000 of 138376 loss = 3.4999 nll loss = 2.1348 accu = 0.3689

Training: Epoch 1 of 10 Step 181 ntokens 6407400 Example 54300 of 138376 loss = 3.4995 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 182 ntokens 6442800 Example 54600 of 138376 loss = 3.5000 nll loss = 2.1343 accu = 0.3691

Training: Epoch 1 of 10 Step 183 ntokens 6478200 Example 54900 of 138376 loss = 3.5001 nll loss = 2.1340 accu = 0.3692

Training: Epoch 1 of 10 Step 184 ntokens 6513600 Example 55200 of 138376 loss = 3.4999 nll loss = 2.1343 accu = 0.3691

Training: Epoch 1 of 10 Step 185 ntokens 6549000 Example 55500 of 138376 loss = 3.4997 nll loss = 2.1346 accu = 0.3690

Training: Epoch 1 of 10 Step 186 ntokens 6584400 Example 55800 of 138376 loss = 3.5002 nll loss = 2.1350 accu = 0.3688

Training: Epoch 1 of 10 Step 187 ntokens 6619800 Example 56100 of 138376 loss = 3.5002 nll loss = 2.1354 accu = 0.3687

Training: Epoch 1 of 10 Step 188 ntokens 6655200 Example 56400 of 138376 loss = 3.4998 nll loss = 2.1350 accu = 0.3688

Training: Epoch 1 of 10 Step 189 ntokens 6690600 Example 56700 of 138376 loss = 3.4998 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 190 ntokens 6726000 Example 57000 of 138376 loss = 3.5000 nll loss = 2.1348 accu = 0.3689

Training: Epoch 1 of 10 Step 191 ntokens 6761400 Example 57300 of 138376 loss = 3.4999 nll loss = 2.1353 accu = 0.3687

Training: Epoch 1 of 10 Step 192 ntokens 6796800 Example 57600 of 138376 loss = 3.5005 nll loss = 2.1351 accu = 0.3688

Training: Epoch 1 of 10 Step 193 ntokens 6832200 Example 57900 of 138376 loss = 3.5009 nll loss = 2.1354 accu = 0.3687

Training: Epoch 1 of 10 Step 194 ntokens 6867600 Example 58200 of 138376 loss = 3.5004 nll loss = 2.1353 accu = 0.3687

Training: Epoch 1 of 10 Step 195 ntokens 6903000 Example 58500 of 138376 loss = 3.5003 nll loss = 2.1352 accu = 0.3687

Training: Epoch 1 of 10 Step 196 ntokens 6938400 Example 58800 of 138376 loss = 3.5006 nll loss = 2.1353 accu = 0.3687

Training: Epoch 1 of 10 Step 197 ntokens 6973800 Example 59100 of 138376 loss = 3.5004 nll loss = 2.1355 accu = 0.3686

Training: Epoch 1 of 10 Step 198 ntokens 7009200 Example 59400 of 138376 loss = 3.5006 nll loss = 2.1355 accu = 0.3687

Training: Epoch 1 of 10 Step 199 ntokens 7044600 Example 59700 of 138376 loss = 3.5011 nll loss = 2.1356 accu = 0.3686

Training: Epoch 1 of 10 Step 200 ntokens 7080000 Example 60000 of 138376 loss = 3.5014 nll loss = 2.1354 accu = 0.3687

Training: Epoch 1 of 10 Step 201 ntokens 7115400 Example 60300 of 138376 loss = 3.5019 nll loss = 2.1352 accu = 0.3688

Training: Epoch 1 of 10 Step 202 ntokens 7150800 Example 60600 of 138376 loss = 3.5023 nll loss = 2.1353 accu = 0.3687

Training: Epoch 1 of 10 Step 203 ntokens 7186200 Example 60900 of 138376 loss = 3.5020 nll loss = 2.1354 accu = 0.3687

Training: Epoch 1 of 10 Step 204 ntokens 7221600 Example 61200 of 138376 loss = 3.5020 nll loss = 2.1353 accu = 0.3687

Training: Epoch 1 of 10 Step 205 ntokens 7257000 Example 61500 of 138376 loss = 3.5026 nll loss = 2.1354 accu = 0.3687

Training: Epoch 1 of 10 Step 206 ntokens 7292400 Example 61800 of 138376 loss = 3.5027 nll loss = 2.1355 accu = 0.3687

Training: Epoch 1 of 10 Step 207 ntokens 7327800 Example 62100 of 138376 loss = 3.5027 nll loss = 2.1355 accu = 0.3687

Training: Epoch 1 of 10 Step 208 ntokens 7363200 Example 62400 of 138376 loss = 3.5028 nll loss = 2.1353 accu = 0.3688

Training: Epoch 1 of 10 Step 209 ntokens 7398600 Example 62700 of 138376 loss = 3.5027 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 210 ntokens 7434000 Example 63000 of 138376 loss = 3.5026 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 211 ntokens 7469400 Example 63300 of 138376 loss = 3.5030 nll loss = 2.1352 accu = 0.3688

Training: Epoch 1 of 10 Step 212 ntokens 7504800 Example 63600 of 138376 loss = 3.5035 nll loss = 2.1354 accu = 0.3688

Training: Epoch 1 of 10 Step 213 ntokens 7540200 Example 63900 of 138376 loss = 3.5034 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 214 ntokens 7575600 Example 64200 of 138376 loss = 3.5031 nll loss = 2.1352 accu = 0.3688

Training: Epoch 1 of 10 Step 215 ntokens 7611000 Example 64500 of 138376 loss = 3.5029 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 216 ntokens 7646400 Example 64800 of 138376 loss = 3.5031 nll loss = 2.1356 accu = 0.3686

Training: Epoch 1 of 10 Step 217 ntokens 7681800 Example 65100 of 138376 loss = 3.5033 nll loss = 2.1352 accu = 0.3688

Training: Epoch 1 of 10 Step 218 ntokens 7717200 Example 65400 of 138376 loss = 3.5036 nll loss = 2.1354 accu = 0.3687

Training: Epoch 1 of 10 Step 219 ntokens 7752600 Example 65700 of 138376 loss = 3.5037 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 220 ntokens 7788000 Example 66000 of 138376 loss = 3.5034 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 221 ntokens 7823400 Example 66300 of 138376 loss = 3.5029 nll loss = 2.1360 accu = 0.3686

Training: Epoch 1 of 10 Step 222 ntokens 7858800 Example 66600 of 138376 loss = 3.5025 nll loss = 2.1359 accu = 0.3686

Training: Epoch 1 of 10 Step 223 ntokens 7894200 Example 66900 of 138376 loss = 3.5025 nll loss = 2.1354 accu = 0.3688

Training: Epoch 1 of 10 Step 224 ntokens 7929600 Example 67200 of 138376 loss = 3.5026 nll loss = 2.1355 accu = 0.3687

Training: Epoch 1 of 10 Step 225 ntokens 7965000 Example 67500 of 138376 loss = 3.5028 nll loss = 2.1354 accu = 0.3688

Training: Epoch 1 of 10 Step 226 ntokens 8000400 Example 67800 of 138376 loss = 3.5025 nll loss = 2.1353 accu = 0.3688

Training: Epoch 1 of 10 Step 227 ntokens 8035800 Example 68100 of 138376 loss = 3.5026 nll loss = 2.1353 accu = 0.3688

Training: Epoch 1 of 10 Step 228 ntokens 8071200 Example 68400 of 138376 loss = 3.5025 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 229 ntokens 8106600 Example 68700 of 138376 loss = 3.5023 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 230 ntokens 8142000 Example 69000 of 138376 loss = 3.5021 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 231 ntokens 8177400 Example 69300 of 138376 loss = 3.5028 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 232 ntokens 8212800 Example 69600 of 138376 loss = 3.5027 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 233 ntokens 8248200 Example 69900 of 138376 loss = 3.5025 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 234 ntokens 8283600 Example 70200 of 138376 loss = 3.5023 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 235 ntokens 8319000 Example 70500 of 138376 loss = 3.5025 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 236 ntokens 8354400 Example 70800 of 138376 loss = 3.5025 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 237 ntokens 8389800 Example 71100 of 138376 loss = 3.5027 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 238 ntokens 8425200 Example 71400 of 138376 loss = 3.5029 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 239 ntokens 8460600 Example 71700 of 138376 loss = 3.5033 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 240 ntokens 8496000 Example 72000 of 138376 loss = 3.5035 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 241 ntokens 8531400 Example 72300 of 138376 loss = 3.5037 nll loss = 2.1346 accu = 0.3691

Training: Epoch 1 of 10 Step 242 ntokens 8566800 Example 72600 of 138376 loss = 3.5038 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 243 ntokens 8602200 Example 72900 of 138376 loss = 3.5036 nll loss = 2.1346 accu = 0.3691

Training: Epoch 1 of 10 Step 244 ntokens 8637600 Example 73200 of 138376 loss = 3.5036 nll loss = 2.1345 accu = 0.3691

Training: Epoch 1 of 10 Step 245 ntokens 8673000 Example 73500 of 138376 loss = 3.5035 nll loss = 2.1345 accu = 0.3691

Training: Epoch 1 of 10 Step 246 ntokens 8708400 Example 73800 of 138376 loss = 3.5039 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 247 ntokens 8743800 Example 74100 of 138376 loss = 3.5043 nll loss = 2.1349 accu = 0.3690

Training: Epoch 1 of 10 Step 248 ntokens 8779200 Example 74400 of 138376 loss = 3.5041 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 249 ntokens 8814600 Example 74700 of 138376 loss = 3.5037 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 250 ntokens 8850000 Example 75000 of 138376 loss = 3.5038 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 251 ntokens 8885400 Example 75300 of 138376 loss = 3.5040 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 252 ntokens 8920800 Example 75600 of 138376 loss = 3.5039 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 253 ntokens 8956200 Example 75900 of 138376 loss = 3.5039 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 254 ntokens 8991600 Example 76200 of 138376 loss = 3.5037 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 255 ntokens 9027000 Example 76500 of 138376 loss = 3.5032 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 256 ntokens 9062400 Example 76800 of 138376 loss = 3.5033 nll loss = 2.1346 accu = 0.3691

Training: Epoch 1 of 10 Step 257 ntokens 9097800 Example 77100 of 138376 loss = 3.5034 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 258 ntokens 9133200 Example 77400 of 138376 loss = 3.5039 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 259 ntokens 9168600 Example 77700 of 138376 loss = 3.5043 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 260 ntokens 9204000 Example 78000 of 138376 loss = 3.5045 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 261 ntokens 9239400 Example 78300 of 138376 loss = 3.5042 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 262 ntokens 9274800 Example 78600 of 138376 loss = 3.5042 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 263 ntokens 9310200 Example 78900 of 138376 loss = 3.5043 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 264 ntokens 9345600 Example 79200 of 138376 loss = 3.5039 nll loss = 2.1345 accu = 0.3691

Training: Epoch 1 of 10 Step 265 ntokens 9381000 Example 79500 of 138376 loss = 3.5036 nll loss = 2.1346 accu = 0.3690

Training: Epoch 1 of 10 Step 266 ntokens 9416400 Example 79800 of 138376 loss = 3.5033 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 267 ntokens 9451800 Example 80100 of 138376 loss = 3.5036 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 268 ntokens 9487200 Example 80400 of 138376 loss = 3.5034 nll loss = 2.1349 accu = 0.3690

Training: Epoch 1 of 10 Step 269 ntokens 9522600 Example 80700 of 138376 loss = 3.5039 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 270 ntokens 9558000 Example 81000 of 138376 loss = 3.5037 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 271 ntokens 9593400 Example 81300 of 138376 loss = 3.5038 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 272 ntokens 9628800 Example 81600 of 138376 loss = 3.5040 nll loss = 2.1349 accu = 0.3690

Training: Epoch 1 of 10 Step 273 ntokens 9664200 Example 81900 of 138376 loss = 3.5040 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 274 ntokens 9699600 Example 82200 of 138376 loss = 3.5037 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 275 ntokens 9735000 Example 82500 of 138376 loss = 3.5034 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 276 ntokens 9770400 Example 82800 of 138376 loss = 3.5039 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 277 ntokens 9805800 Example 83100 of 138376 loss = 3.5042 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 278 ntokens 9841200 Example 83400 of 138376 loss = 3.5045 nll loss = 2.1349 accu = 0.3689

Training: Epoch 1 of 10 Step 279 ntokens 9876600 Example 83700 of 138376 loss = 3.5044 nll loss = 2.1350 accu = 0.3689

Training: Epoch 1 of 10 Step 280 ntokens 9912000 Example 84000 of 138376 loss = 3.5043 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 281 ntokens 9947400 Example 84300 of 138376 loss = 3.5042 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 282 ntokens 9982800 Example 84600 of 138376 loss = 3.5036 nll loss = 2.1347 accu = 0.3690

Training: Epoch 1 of 10 Step 283 ntokens 10018200 Example 84900 of 138376 loss = 3.5038 nll loss = 2.1346 accu = 0.3691

Training: Epoch 1 of 10 Step 284 ntokens 10053600 Example 85200 of 138376 loss = 3.5038 nll loss = 2.1349 accu = 0.3690

Training: Epoch 1 of 10 Step 285 ntokens 10089000 Example 85500 of 138376 loss = 3.5037 nll loss = 2.1351 accu = 0.3689

Training: Epoch 1 of 10 Step 286 ntokens 10124400 Example 85800 of 138376 loss = 3.5037 nll loss = 2.1356 accu = 0.3687

Training: Epoch 1 of 10 Step 287 ntokens 10159800 Example 86100 of 138376 loss = 3.5037 nll loss = 2.1356 accu = 0.3688

Training: Epoch 1 of 10 Step 288 ntokens 10195200 Example 86400 of 138376 loss = 3.5032 nll loss = 2.1357 accu = 0.3687

Training: Epoch 1 of 10 Step 289 ntokens 10230600 Example 86700 of 138376 loss = 3.5033 nll loss = 2.1358 accu = 0.3687

Training: Epoch 1 of 10 Step 290 ntokens 10266000 Example 87000 of 138376 loss = 3.5031 nll loss = 2.1357 accu = 0.3687

Training: Epoch 1 of 10 Step 291 ntokens 10301400 Example 87300 of 138376 loss = 3.5031 nll loss = 2.1354 accu = 0.3688

Training: Epoch 1 of 10 Step 292 ntokens 10336800 Example 87600 of 138376 loss = 3.5030 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 293 ntokens 10372200 Example 87900 of 138376 loss = 3.5033 nll loss = 2.1353 accu = 0.3688

Training: Epoch 1 of 10 Step 294 ntokens 10407600 Example 88200 of 138376 loss = 3.5034 nll loss = 2.1354 accu = 0.3688

Training: Epoch 1 of 10 Step 295 ntokens 10443000 Example 88500 of 138376 loss = 3.5035 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 296 ntokens 10478400 Example 88800 of 138376 loss = 3.5035 nll loss = 2.1353 accu = 0.3689

Training: Epoch 1 of 10 Step 297 ntokens 10513800 Example 89100 of 138376 loss = 3.5035 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 298 ntokens 10549200 Example 89400 of 138376 loss = 3.5036 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 299 ntokens 10584600 Example 89700 of 138376 loss = 3.5035 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 300 ntokens 10620000 Example 90000 of 138376 loss = 3.5035 nll loss = 2.1356 accu = 0.3688

Training: Epoch 1 of 10 Step 301 ntokens 10655400 Example 90300 of 138376 loss = 3.5034 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 302 ntokens 10690800 Example 90600 of 138376 loss = 3.5031 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 303 ntokens 10726200 Example 90900 of 138376 loss = 3.5034 nll loss = 2.1356 accu = 0.3688

Training: Epoch 1 of 10 Step 304 ntokens 10761600 Example 91200 of 138376 loss = 3.5038 nll loss = 2.1357 accu = 0.3687

Training: Epoch 1 of 10 Step 305 ntokens 10797000 Example 91500 of 138376 loss = 3.5035 nll loss = 2.1357 accu = 0.3687

Training: Epoch 1 of 10 Step 306 ntokens 10832400 Example 91800 of 138376 loss = 3.5036 nll loss = 2.1355 accu = 0.3688

Training: Epoch 1 of 10 Step 307 ntokens 10867800 Example 92100 of 138376 loss = 3.5037 nll loss = 2.1356 accu = 0.3688

Training: Epoch 1 of 10 Step 308 ntokens 10903200 Example 92400 of 138376 loss = 3.5037 nll loss = 2.1354 accu = 0.3689

Training: Epoch 1 of 10 Step 309 ntokens 10938600 Example 92700 of 138376 loss = 3.5038 nll loss = 2.1353 accu = 0.3689

Training: Epoch 1 of 10 Step 310 ntokens 10974000 Example 93000 of 138376 loss = 3.5039 nll loss = 2.1353 accu = 0.3689

Training: Epoch 1 of 10 Step 311 ntokens 11009400 Example 93300 of 138376 loss = 3.5036 nll loss = 2.1350 accu = 0.3690

Training: Epoch 1 of 10 Step 312 ntokens 11044800 Example 93600 of 138376 loss = 3.5038 nll loss = 2.1349 accu = 0.3691

Training: Epoch 1 of 10 Step 313 ntokens 11080200 Example 93900 of 138376 loss = 3.5040 nll loss = 2.1351 accu = 0.3690

Training: Epoch 1 of 10 Step 314 ntokens 11115600 Example 94200 of 138376 loss = 3.5041 nll loss = 2.1352 accu = 0.3689

Training: Epoch 1 of 10 Step 315 ntokens 11151000 Example 94500 of 138376 loss = 3.5040 nll loss = 2.1351 accu = 0.3690

Training: Epoch 1 of 10 Step 316 ntokens 11186400 Example 94800 of 138376 loss = 3.5040 nll loss = 2.1352 accu = 0.3689

Training: Epoch 1 of 10 Step 317 ntokens 11221800 Example 95100 of 138376 loss = 3.5041 nll loss = 2.1354 accu = 0.3689

Training: Epoch 1 of 10 Step 318 ntokens 11257200 Example 95400 of 138376 loss = 3.5043 nll loss = 2.1353 accu = 0.3689

Training: Epoch 1 of 10 Step 319 ntokens 11292600 Example 95700 of 138376 loss = 3.5041 nll loss = 2.1352 accu = 0.3689

Training: Epoch 1 of 10 Step 320 ntokens 11328000 Example 96000 of 138376 loss = 3.5042 nll loss = 2.1352 accu = 0.3689

Training: Epoch 1 of 10 Step 321 ntokens 11363400 Example 96300 of 138376 loss = 3.5040 nll loss = 2.1350 accu = 0.3690

Training: Epoch 1 of 10 Step 322 ntokens 11398800 Example 96600 of 138376 loss = 3.5038 nll loss = 2.1350 accu = 0.3690

Training: Epoch 1 of 10 Step 323 ntokens 11434200 Example 96900 of 138376 loss = 3.5038 nll loss = 2.1348 accu = 0.3690

Training: Epoch 1 of 10 Step 324 ntokens 11469600 Example 97200 of 138376 loss = 3.5039 nll loss = 2.1349 accu = 0.3690

Training: Epoch 1 of 10 Step 325 ntokens 11505000 Example 97500 of 138376 loss = 3.5038 nll loss = 2.1351 accu = 0.3690

Training: Epoch 1 of 10 Step 326 ntokens 11540400 Example 97800 of 138376 loss = 3.5040 nll loss = 2.1350 accu = 0.3690

Training: Epoch 1 of 10 Step 327 ntokens 11575800 Example 98100 of 138376 loss = 3.5042 nll loss = 2.1347 accu = 0.3691

Training: Epoch 1 of 10 Step 328 ntokens 11611200 Example 98400 of 138376 loss = 3.5042 nll loss = 2.1346 accu = 0.3691

Training: Epoch 1 of 10 Step 329 ntokens 11646600 Example 98700 of 138376 loss = 3.5044 nll loss = 2.1347 accu = 0.3691

Training: Epoch 1 of 10 Step 330 ntokens 11682000 Example 99000 of 138376 loss = 3.5046 nll loss = 2.1347 accu = 0.3691

Training: Epoch 1 of 10 Step 331 ntokens 11717400 Example 99300 of 138376 loss = 3.5042 nll loss = 2.1346 accu = 0.3691

Training: Epoch 1 of 10 Step 332 ntokens 11752800 Example 99600 of 138376 loss = 3.5042 nll loss = 2.1343 accu = 0.3692

Training: Epoch 1 of 10 Step 333 ntokens 11788200 Example 99900 of 138376 loss = 3.5042 nll loss = 2.1341 accu = 0.3693

Training: Epoch 1 of 10 Step 334 ntokens 11823600 Example 100200 of 138376 loss = 3.5042 nll loss = 2.1340 accu = 0.3693

Training: Epoch 1 of 10 Step 335 ntokens 11859000 Example 100500 of 138376 loss = 3.5044 nll loss = 2.1341 accu = 0.3693

Training: Epoch 1 of 10 Step 336 ntokens 11894400 Example 100800 of 138376 loss = 3.5044 nll loss = 2.1341 accu = 0.3693

Training: Epoch 1 of 10 Step 337 ntokens 11929800 Example 101100 of 138376 loss = 3.5045 nll loss = 2.1341 accu = 0.3693

Training: Epoch 1 of 10 Step 338 ntokens 11965200 Example 101400 of 138376 loss = 3.5047 nll loss = 2.1339 accu = 0.3694

Training: Epoch 1 of 10 Step 339 ntokens 12000600 Example 101700 of 138376 loss = 3.5049 nll loss = 2.1335 accu = 0.3695

Training: Epoch 1 of 10 Step 340 ntokens 12036000 Example 102000 of 138376 loss = 3.5047 nll loss = 2.1337 accu = 0.3695

Training: Epoch 1 of 10 Step 341 ntokens 12071400 Example 102300 of 138376 loss = 3.5046 nll loss = 2.1335 accu = 0.3695

Training: Epoch 1 of 10 Step 342 ntokens 12106800 Example 102600 of 138376 loss = 3.5041 nll loss = 2.1335 accu = 0.3695

Training: Epoch 1 of 10 Step 343 ntokens 12142200 Example 102900 of 138376 loss = 3.5043 nll loss = 2.1337 accu = 0.3695

Training: Epoch 1 of 10 Step 344 ntokens 12177600 Example 103200 of 138376 loss = 3.5043 nll loss = 2.1336 accu = 0.3695

Training: Epoch 1 of 10 Step 345 ntokens 12213000 Example 103500 of 138376 loss = 3.5045 nll loss = 2.1336 accu = 0.3695

Training: Epoch 1 of 10 Step 346 ntokens 12248400 Example 103800 of 138376 loss = 3.5044 nll loss = 2.1332 accu = 0.3696

Training: Epoch 1 of 10 Step 347 ntokens 12283800 Example 104100 of 138376 loss = 3.5046 nll loss = 2.1333 accu = 0.3696

Training: Epoch 1 of 10 Step 348 ntokens 12319200 Example 104400 of 138376 loss = 3.5046 nll loss = 2.1332 accu = 0.3697

Training: Epoch 1 of 10 Step 349 ntokens 12354600 Example 104700 of 138376 loss = 3.5047 nll loss = 2.1329 accu = 0.3697

Training: Epoch 1 of 10 Step 350 ntokens 12390000 Example 105000 of 138376 loss = 3.5045 nll loss = 2.1326 accu = 0.3698

Training: Epoch 1 of 10 Step 351 ntokens 12425400 Example 105300 of 138376 loss = 3.5048 nll loss = 2.1328 accu = 0.3698

Training: Epoch 1 of 10 Step 352 ntokens 12460800 Example 105600 of 138376 loss = 3.5051 nll loss = 2.1325 accu = 0.3699

Training: Epoch 1 of 10 Step 353 ntokens 12496200 Example 105900 of 138376 loss = 3.5050 nll loss = 2.1324 accu = 0.3699

Training: Epoch 1 of 10 Step 354 ntokens 12531600 Example 106200 of 138376 loss = 3.5049 nll loss = 2.1322 accu = 0.3700

Training: Epoch 1 of 10 Step 355 ntokens 12567000 Example 106500 of 138376 loss = 3.5048 nll loss = 2.1322 accu = 0.3700

Training: Epoch 1 of 10 Step 356 ntokens 12602400 Example 106800 of 138376 loss = 3.5047 nll loss = 2.1322 accu = 0.3700

Training: Epoch 1 of 10 Step 357 ntokens 12637800 Example 107100 of 138376 loss = 3.5048 nll loss = 2.1323 accu = 0.3700

Training: Epoch 1 of 10 Step 358 ntokens 12673200 Example 107400 of 138376 loss = 3.5049 nll loss = 2.1324 accu = 0.3700

Training: Epoch 1 of 10 Step 359 ntokens 12708600 Example 107700 of 138376 loss = 3.5048 nll loss = 2.1323 accu = 0.3700

Training: Epoch 1 of 10 Step 360 ntokens 12744000 Example 108000 of 138376 loss = 3.5050 nll loss = 2.1324 accu = 0.3699

Training: Epoch 1 of 10 Step 361 ntokens 12779400 Example 108300 of 138376 loss = 3.5051 nll loss = 2.1325 accu = 0.3699

Training: Epoch 1 of 10 Step 362 ntokens 12814800 Example 108600 of 138376 loss = 3.5051 nll loss = 2.1324 accu = 0.3699

Training: Epoch 1 of 10 Step 363 ntokens 12850200 Example 108900 of 138376 loss = 3.5051 nll loss = 2.1324 accu = 0.3699

Training: Epoch 1 of 10 Step 364 ntokens 12885600 Example 109200 of 138376 loss = 3.5049 nll loss = 2.1324 accu = 0.3699

Training: Epoch 1 of 10 Step 365 ntokens 12921000 Example 109500 of 138376 loss = 3.5051 nll loss = 2.1322 accu = 0.3700

Training: Epoch 1 of 10 Step 366 ntokens 12956400 Example 109800 of 138376 loss = 3.5050 nll loss = 2.1321 accu = 0.3701

Training: Epoch 1 of 10 Step 367 ntokens 12991800 Example 110100 of 138376 loss = 3.5051 nll loss = 2.1321 accu = 0.3701

Training: Epoch 1 of 10 Step 368 ntokens 13027200 Example 110400 of 138376 loss = 3.5050 nll loss = 2.1321 accu = 0.3701

Training: Epoch 1 of 10 Step 369 ntokens 13062600 Example 110700 of 138376 loss = 3.5052 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 370 ntokens 13098000 Example 111000 of 138376 loss = 3.5051 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 371 ntokens 13133400 Example 111300 of 138376 loss = 3.5051 nll loss = 2.1319 accu = 0.3702

Training: Epoch 1 of 10 Step 372 ntokens 13168800 Example 111600 of 138376 loss = 3.5049 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 373 ntokens 13204200 Example 111900 of 138376 loss = 3.5047 nll loss = 2.1316 accu = 0.3703

Training: Epoch 1 of 10 Step 374 ntokens 13239600 Example 112200 of 138376 loss = 3.5044 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 375 ntokens 13275000 Example 112500 of 138376 loss = 3.5043 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 376 ntokens 13310400 Example 112800 of 138376 loss = 3.5042 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 377 ntokens 13345800 Example 113100 of 138376 loss = 3.5042 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 378 ntokens 13381200 Example 113400 of 138376 loss = 3.5042 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 379 ntokens 13416600 Example 113700 of 138376 loss = 3.5039 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 380 ntokens 13452000 Example 114000 of 138376 loss = 3.5038 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 381 ntokens 13487400 Example 114300 of 138376 loss = 3.5039 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 382 ntokens 13522800 Example 114600 of 138376 loss = 3.5037 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 383 ntokens 13558200 Example 114900 of 138376 loss = 3.5038 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 384 ntokens 13593600 Example 115200 of 138376 loss = 3.5038 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 385 ntokens 13629000 Example 115500 of 138376 loss = 3.5036 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 386 ntokens 13664400 Example 115800 of 138376 loss = 3.5033 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 387 ntokens 13699800 Example 116100 of 138376 loss = 3.5033 nll loss = 2.1319 accu = 0.3702

Training: Epoch 1 of 10 Step 388 ntokens 13735200 Example 116400 of 138376 loss = 3.5034 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 389 ntokens 13770600 Example 116700 of 138376 loss = 3.5034 nll loss = 2.1316 accu = 0.3703

Training: Epoch 1 of 10 Step 390 ntokens 13806000 Example 117000 of 138376 loss = 3.5033 nll loss = 2.1316 accu = 0.3703

Training: Epoch 1 of 10 Step 391 ntokens 13841400 Example 117300 of 138376 loss = 3.5031 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 392 ntokens 13876800 Example 117600 of 138376 loss = 3.5029 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 393 ntokens 13912200 Example 117900 of 138376 loss = 3.5028 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 394 ntokens 13947600 Example 118200 of 138376 loss = 3.5028 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 395 ntokens 13983000 Example 118500 of 138376 loss = 3.5028 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 396 ntokens 14018400 Example 118800 of 138376 loss = 3.5028 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 397 ntokens 14053800 Example 119100 of 138376 loss = 3.5027 nll loss = 2.1314 accu = 0.3703

Training: Epoch 1 of 10 Step 398 ntokens 14089200 Example 119400 of 138376 loss = 3.5025 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 399 ntokens 14124600 Example 119700 of 138376 loss = 3.5027 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 400 ntokens 14160000 Example 120000 of 138376 loss = 3.5027 nll loss = 2.1315 accu = 0.3703

Training: Epoch 1 of 10 Step 401 ntokens 14195400 Example 120300 of 138376 loss = 3.5028 nll loss = 2.1315 accu = 0.3703

Training: Epoch 1 of 10 Step 402 ntokens 14230800 Example 120600 of 138376 loss = 3.5028 nll loss = 2.1315 accu = 0.3703

Training: Epoch 1 of 10 Step 403 ntokens 14266200 Example 120900 of 138376 loss = 3.5031 nll loss = 2.1315 accu = 0.3703

Training: Epoch 1 of 10 Step 404 ntokens 14301600 Example 121200 of 138376 loss = 3.5030 nll loss = 2.1315 accu = 0.3703

Training: Epoch 1 of 10 Step 405 ntokens 14337000 Example 121500 of 138376 loss = 3.5030 nll loss = 2.1316 accu = 0.3702

Training: Epoch 1 of 10 Step 406 ntokens 14372400 Example 121800 of 138376 loss = 3.5033 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 407 ntokens 14407800 Example 122100 of 138376 loss = 3.5032 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 408 ntokens 14443200 Example 122400 of 138376 loss = 3.5032 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 409 ntokens 14478600 Example 122700 of 138376 loss = 3.5034 nll loss = 2.1320 accu = 0.3701

Training: Epoch 1 of 10 Step 410 ntokens 14514000 Example 123000 of 138376 loss = 3.5035 nll loss = 2.1320 accu = 0.3701

Training: Epoch 1 of 10 Step 411 ntokens 14549400 Example 123300 of 138376 loss = 3.5038 nll loss = 2.1319 accu = 0.3702

Training: Epoch 1 of 10 Step 412 ntokens 14584800 Example 123600 of 138376 loss = 3.5037 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 413 ntokens 14620200 Example 123900 of 138376 loss = 3.5035 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 414 ntokens 14655600 Example 124200 of 138376 loss = 3.5033 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 415 ntokens 14691000 Example 124500 of 138376 loss = 3.5031 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 416 ntokens 14726400 Example 124800 of 138376 loss = 3.5035 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 417 ntokens 14761800 Example 125100 of 138376 loss = 3.5034 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 418 ntokens 14797200 Example 125400 of 138376 loss = 3.5034 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 419 ntokens 14832600 Example 125700 of 138376 loss = 3.5032 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 420 ntokens 14868000 Example 126000 of 138376 loss = 3.5032 nll loss = 2.1317 accu = 0.3702

Training: Epoch 1 of 10 Step 421 ntokens 14903400 Example 126300 of 138376 loss = 3.5031 nll loss = 2.1318 accu = 0.3702

Training: Epoch 1 of 10 Step 422 ntokens 14938800 Example 126600 of 138376 loss = 3.5031 nll loss = 2.1318 accu = 0.3701

Training: Epoch 1 of 10 Step 423 ntokens 14974200 Example 126900 of 138376 loss = 3.5030 nll loss = 2.1320 accu = 0.3701

Training: Epoch 1 of 10 Step 424 ntokens 15009600 Example 127200 of 138376 loss = 3.5029 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 425 ntokens 15045000 Example 127500 of 138376 loss = 3.5031 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 426 ntokens 15080400 Example 127800 of 138376 loss = 3.5032 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 427 ntokens 15115800 Example 128100 of 138376 loss = 3.5031 nll loss = 2.1319 accu = 0.3701

Training: Epoch 1 of 10 Step 428 ntokens 15151200 Example 128400 of 138376 loss = 3.5030 nll loss = 2.1320 accu = 0.3701

Training: Epoch 1 of 10 Step 429 ntokens 15186600 Example 128700 of 138376 loss = 3.5029 nll loss = 2.1321 accu = 0.3700

Training: Epoch 1 of 10 Step 430 ntokens 15222000 Example 129000 of 138376 loss = 3.5028 nll loss = 2.1323 accu = 0.3700

Training: Epoch 1 of 10 Step 431 ntokens 15257400 Example 129300 of 138376 loss = 3.5029 nll loss = 2.1325 accu = 0.3699

Training: Epoch 1 of 10 Step 432 ntokens 15292800 Example 129600 of 138376 loss = 3.5027 nll loss = 2.1325 accu = 0.3699

Training: Epoch 1 of 10 Step 433 ntokens 15328200 Example 129900 of 138376 loss = 3.5026 nll loss = 2.1323 accu = 0.3700

Training: Epoch 1 of 10 Step 434 ntokens 15363600 Example 130200 of 138376 loss = 3.5025 nll loss = 2.1324 accu = 0.3700

Training: Epoch 1 of 10 Step 435 ntokens 15399000 Example 130500 of 138376 loss = 3.5026 nll loss = 2.1325 accu = 0.3699

Training: Epoch 1 of 10 Step 436 ntokens 15434400 Example 130800 of 138376 loss = 3.5026 nll loss = 2.1326 accu = 0.3699

Training: Epoch 1 of 10 Step 437 ntokens 15469800 Example 131100 of 138376 loss = 3.5028 nll loss = 2.1326 accu = 0.3699

Training: Epoch 1 of 10 Step 438 ntokens 15505200 Example 131400 of 138376 loss = 3.5030 nll loss = 2.1326 accu = 0.3699

Training: Epoch 1 of 10 Step 439 ntokens 15540600 Example 131700 of 138376 loss = 3.5031 nll loss = 2.1326 accu = 0.3699

Training: Epoch 1 of 10 Step 440 ntokens 15576000 Example 132000 of 138376 loss = 3.5030 nll loss = 2.1327 accu = 0.3699

Training: Epoch 1 of 10 Step 441 ntokens 15611400 Example 132300 of 138376 loss = 3.5026 nll loss = 2.1327 accu = 0.3699

Training: Epoch 1 of 10 Step 442 ntokens 15646800 Example 132600 of 138376 loss = 3.5026 nll loss = 2.1328 accu = 0.3698

Training: Epoch 1 of 10 Step 443 ntokens 15682200 Example 132900 of 138376 loss = 3.5026 nll loss = 2.1328 accu = 0.3699

Training: Epoch 1 of 10 Step 444 ntokens 15717600 Example 133200 of 138376 loss = 3.5022 nll loss = 2.1327 accu = 0.3699

Training: Epoch 1 of 10 Step 445 ntokens 15753000 Example 133500 of 138376 loss = 3.5022 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 446 ntokens 15788400 Example 133800 of 138376 loss = 3.5019 nll loss = 2.1328 accu = 0.3698

Training: Epoch 1 of 10 Step 447 ntokens 15823800 Example 134100 of 138376 loss = 3.5019 nll loss = 2.1328 accu = 0.3698

Training: Epoch 1 of 10 Step 448 ntokens 15859200 Example 134400 of 138376 loss = 3.5020 nll loss = 2.1329 accu = 0.3698

Training: Epoch 1 of 10 Step 449 ntokens 15894600 Example 134700 of 138376 loss = 3.5019 nll loss = 2.1331 accu = 0.3697

Training: Epoch 1 of 10 Step 450 ntokens 15930000 Example 135000 of 138376 loss = 3.5020 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 451 ntokens 15965400 Example 135300 of 138376 loss = 3.5019 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 452 ntokens 16000800 Example 135600 of 138376 loss = 3.5019 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 453 ntokens 16036200 Example 135900 of 138376 loss = 3.5022 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 454 ntokens 16071600 Example 136200 of 138376 loss = 3.5023 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 455 ntokens 16107000 Example 136500 of 138376 loss = 3.5022 nll loss = 2.1328 accu = 0.3699

Training: Epoch 1 of 10 Step 456 ntokens 16142400 Example 136800 of 138376 loss = 3.5024 nll loss = 2.1327 accu = 0.3699

Training: Epoch 1 of 10 Step 457 ntokens 16177800 Example 137100 of 138376 loss = 3.5024 nll loss = 2.1328 accu = 0.3699

Training: Epoch 1 of 10 Step 458 ntokens 16213200 Example 137400 of 138376 loss = 3.5022 nll loss = 2.1328 accu = 0.3698

Training: Epoch 1 of 10 Step 459 ntokens 16248600 Example 137700 of 138376 loss = 3.5023 nll loss = 2.1328 accu = 0.3698

Training: Epoch 1 of 10 Step 460 ntokens 16284000 Example 138000 of 138376 loss = 3.5024 nll loss = 2.1329 accu = 0.3698

Training: Epoch 1 of 10 Step 461 ntokens 16319400 Example 138300 of 138376 loss = 3.5023 nll loss = 2.1330 accu = 0.3698

Training: Epoch 1 of 10 Step 462 ntokens 16328368 Example 138376 of 138376 loss = 3.5021 nll loss = 2.1329 accu = 0.3698

Writing to checkpoint at 2024-05-28 16:50:31.521877
Validating: Epoch 1 of 10 Step 0 ntokens 16328368 Example 300 of 34323 loss = 3.4225 nll loss = 2.0832 accu = 0.3899

Validating: Epoch 1 of 10 Step 1 ntokens 16328368 Example 600 of 34323 loss = 3.4240 nll loss = 2.1183 accu = 0.3777

Validating: Epoch 1 of 10 Step 2 ntokens 16328368 Example 900 of 34323 loss = 3.4277 nll loss = 2.1264 accu = 0.3735

Validating: Epoch 1 of 10 Step 3 ntokens 16328368 Example 1200 of 34323 loss = 3.4502 nll loss = 2.1243 accu = 0.3741

Validating: Epoch 1 of 10 Step 4 ntokens 16328368 Example 1500 of 34323 loss = 3.4590 nll loss = 2.1217 accu = 0.3743

Validating: Epoch 1 of 10 Step 5 ntokens 16328368 Example 1800 of 34323 loss = 3.4658 nll loss = 2.1244 accu = 0.3723

Validating: Epoch 1 of 10 Step 6 ntokens 16328368 Example 2100 of 34323 loss = 3.4646 nll loss = 2.1264 accu = 0.3711

Validating: Epoch 1 of 10 Step 7 ntokens 16328368 Example 2400 of 34323 loss = 3.4694 nll loss = 2.1339 accu = 0.3684

Validating: Epoch 1 of 10 Step 8 ntokens 16328368 Example 2700 of 34323 loss = 3.4664 nll loss = 2.1437 accu = 0.3653

Validating: Epoch 1 of 10 Step 9 ntokens 16328368 Example 3000 of 34323 loss = 3.4669 nll loss = 2.1347 accu = 0.3687

Validating: Epoch 1 of 10 Step 10 ntokens 16328368 Example 3300 of 34323 loss = 3.4772 nll loss = 2.1392 accu = 0.3672

Validating: Epoch 1 of 10 Step 11 ntokens 16328368 Example 3600 of 34323 loss = 3.4858 nll loss = 2.1386 accu = 0.3673

Validating: Epoch 1 of 10 Step 12 ntokens 16328368 Example 3900 of 34323 loss = 3.4907 nll loss = 2.1433 accu = 0.3658

Validating: Epoch 1 of 10 Step 13 ntokens 16328368 Example 4200 of 34323 loss = 3.4795 nll loss = 2.1398 accu = 0.3670

Validating: Epoch 1 of 10 Step 14 ntokens 16328368 Example 4500 of 34323 loss = 3.4754 nll loss = 2.1342 accu = 0.3686

Validating: Epoch 1 of 10 Step 15 ntokens 16328368 Example 4800 of 34323 loss = 3.4804 nll loss = 2.1342 accu = 0.3685

Validating: Epoch 1 of 10 Step 16 ntokens 16328368 Example 5100 of 34323 loss = 3.4824 nll loss = 2.1339 accu = 0.3687

Validating: Epoch 1 of 10 Step 17 ntokens 16328368 Example 5400 of 34323 loss = 3.4846 nll loss = 2.1353 accu = 0.3682

Validating: Epoch 1 of 10 Step 18 ntokens 16328368 Example 5700 of 34323 loss = 3.4850 nll loss = 2.1315 accu = 0.3696

Validating: Epoch 1 of 10 Step 19 ntokens 16328368 Example 6000 of 34323 loss = 3.4898 nll loss = 2.1272 accu = 0.3712

Validating: Epoch 1 of 10 Step 20 ntokens 16328368 Example 6300 of 34323 loss = 3.4883 nll loss = 2.1265 accu = 0.3715

Validating: Epoch 1 of 10 Step 21 ntokens 16328368 Example 6600 of 34323 loss = 3.4859 nll loss = 2.1229 accu = 0.3726

Validating: Epoch 1 of 10 Step 22 ntokens 16328368 Example 6900 of 34323 loss = 3.4819 nll loss = 2.1227 accu = 0.3725

Validating: Epoch 1 of 10 Step 23 ntokens 16328368 Example 7200 of 34323 loss = 3.4820 nll loss = 2.1226 accu = 0.3725

Validating: Epoch 1 of 10 Step 24 ntokens 16328368 Example 7500 of 34323 loss = 3.4822 nll loss = 2.1257 accu = 0.3713

Validating: Epoch 1 of 10 Step 25 ntokens 16328368 Example 7800 of 34323 loss = 3.4822 nll loss = 2.1290 accu = 0.3703

Validating: Epoch 1 of 10 Step 26 ntokens 16328368 Example 8100 of 34323 loss = 3.4840 nll loss = 2.1267 accu = 0.3710

Validating: Epoch 1 of 10 Step 27 ntokens 16328368 Example 8400 of 34323 loss = 3.4852 nll loss = 2.1273 accu = 0.3708

Validating: Epoch 1 of 10 Step 28 ntokens 16328368 Example 8700 of 34323 loss = 3.4857 nll loss = 2.1272 accu = 0.3707

Validating: Epoch 1 of 10 Step 29 ntokens 16328368 Example 9000 of 34323 loss = 3.4873 nll loss = 2.1276 accu = 0.3705

Validating: Epoch 1 of 10 Step 30 ntokens 16328368 Example 9300 of 34323 loss = 3.4884 nll loss = 2.1276 accu = 0.3705

Validating: Epoch 1 of 10 Step 31 ntokens 16328368 Example 9600 of 34323 loss = 3.4872 nll loss = 2.1261 accu = 0.3710

Validating: Epoch 1 of 10 Step 32 ntokens 16328368 Example 9900 of 34323 loss = 3.4907 nll loss = 2.1263 accu = 0.3708

Validating: Epoch 1 of 10 Step 33 ntokens 16328368 Example 10200 of 34323 loss = 3.4918 nll loss = 2.1272 accu = 0.3705

Validating: Epoch 1 of 10 Step 34 ntokens 16328368 Example 10500 of 34323 loss = 3.4880 nll loss = 2.1256 accu = 0.3711

Validating: Epoch 1 of 10 Step 35 ntokens 16328368 Example 10800 of 34323 loss = 3.4883 nll loss = 2.1264 accu = 0.3708

Validating: Epoch 1 of 10 Step 36 ntokens 16328368 Example 11100 of 34323 loss = 3.4904 nll loss = 2.1254 accu = 0.3711

Validating: Epoch 1 of 10 Step 37 ntokens 16328368 Example 11400 of 34323 loss = 3.4900 nll loss = 2.1256 accu = 0.3710

Validating: Epoch 1 of 10 Step 38 ntokens 16328368 Example 11700 of 34323 loss = 3.4897 nll loss = 2.1254 accu = 0.3712

Validating: Epoch 1 of 10 Step 39 ntokens 16328368 Example 12000 of 34323 loss = 3.4894 nll loss = 2.1261 accu = 0.3710

Validating: Epoch 1 of 10 Step 40 ntokens 16328368 Example 12300 of 34323 loss = 3.4881 nll loss = 2.1248 accu = 0.3713

Validating: Epoch 1 of 10 Step 41 ntokens 16328368 Example 12600 of 34323 loss = 3.4882 nll loss = 2.1255 accu = 0.3711

Validating: Epoch 1 of 10 Step 42 ntokens 16328368 Example 12900 of 34323 loss = 3.4871 nll loss = 2.1268 accu = 0.3707

Validating: Epoch 1 of 10 Step 43 ntokens 16328368 Example 13200 of 34323 loss = 3.4906 nll loss = 2.1277 accu = 0.3705

Validating: Epoch 1 of 10 Step 44 ntokens 16328368 Example 13500 of 34323 loss = 3.4908 nll loss = 2.1289 accu = 0.3701

Validating: Epoch 1 of 10 Step 45 ntokens 16328368 Example 13800 of 34323 loss = 3.4906 nll loss = 2.1296 accu = 0.3699

Validating: Epoch 1 of 10 Step 46 ntokens 16328368 Example 14100 of 34323 loss = 3.4902 nll loss = 2.1272 accu = 0.3708

Validating: Epoch 1 of 10 Step 47 ntokens 16328368 Example 14400 of 34323 loss = 3.4895 nll loss = 2.1274 accu = 0.3707

Validating: Epoch 1 of 10 Step 48 ntokens 16328368 Example 14700 of 34323 loss = 3.4890 nll loss = 2.1277 accu = 0.3706

Validating: Epoch 1 of 10 Step 49 ntokens 16328368 Example 15000 of 34323 loss = 3.4903 nll loss = 2.1283 accu = 0.3705

Validating: Epoch 1 of 10 Step 50 ntokens 16328368 Example 15300 of 34323 loss = 3.4884 nll loss = 2.1271 accu = 0.3709

Validating: Epoch 1 of 10 Step 51 ntokens 16328368 Example 15600 of 34323 loss = 3.4894 nll loss = 2.1258 accu = 0.3714

Validating: Epoch 1 of 10 Step 52 ntokens 16328368 Example 15900 of 34323 loss = 3.4917 nll loss = 2.1257 accu = 0.3715

Validating: Epoch 1 of 10 Step 53 ntokens 16328368 Example 16200 of 34323 loss = 3.4912 nll loss = 2.1271 accu = 0.3709

Validating: Epoch 1 of 10 Step 54 ntokens 16328368 Example 16500 of 34323 loss = 3.4907 nll loss = 2.1273 accu = 0.3708

Validating: Epoch 1 of 10 Step 55 ntokens 16328368 Example 16800 of 34323 loss = 3.4908 nll loss = 2.1269 accu = 0.3710

Validating: Epoch 1 of 10 Step 56 ntokens 16328368 Example 17100 of 34323 loss = 3.4907 nll loss = 2.1266 accu = 0.3712

Validating: Epoch 1 of 10 Step 57 ntokens 16328368 Example 17400 of 34323 loss = 3.4911 nll loss = 2.1269 accu = 0.3711

Validating: Epoch 1 of 10 Step 58 ntokens 16328368 Example 17700 of 34323 loss = 3.4918 nll loss = 2.1272 accu = 0.3711

Validating: Epoch 1 of 10 Step 59 ntokens 16328368 Example 18000 of 34323 loss = 3.4931 nll loss = 2.1281 accu = 0.3708

Validating: Epoch 1 of 10 Step 60 ntokens 16328368 Example 18300 of 34323 loss = 3.4926 nll loss = 2.1293 accu = 0.3703

Validating: Epoch 1 of 10 Step 61 ntokens 16328368 Example 18600 of 34323 loss = 3.4941 nll loss = 2.1287 accu = 0.3705

Validating: Epoch 1 of 10 Step 62 ntokens 16328368 Example 18900 of 34323 loss = 3.4947 nll loss = 2.1293 accu = 0.3703

Validating: Epoch 1 of 10 Step 63 ntokens 16328368 Example 19200 of 34323 loss = 3.4929 nll loss = 2.1294 accu = 0.3702

Validating: Epoch 1 of 10 Step 64 ntokens 16328368 Example 19500 of 34323 loss = 3.4913 nll loss = 2.1291 accu = 0.3704

Validating: Epoch 1 of 10 Step 65 ntokens 16328368 Example 19800 of 34323 loss = 3.4918 nll loss = 2.1297 accu = 0.3702

Validating: Epoch 1 of 10 Step 66 ntokens 16328368 Example 20100 of 34323 loss = 3.4924 nll loss = 2.1296 accu = 0.3702

Validating: Epoch 1 of 10 Step 67 ntokens 16328368 Example 20400 of 34323 loss = 3.4895 nll loss = 2.1293 accu = 0.3703

Validating: Epoch 1 of 10 Step 68 ntokens 16328368 Example 20700 of 34323 loss = 3.4892 nll loss = 2.1296 accu = 0.3701

Validating: Epoch 1 of 10 Step 69 ntokens 16328368 Example 21000 of 34323 loss = 3.4900 nll loss = 2.1297 accu = 0.3702

Validating: Epoch 1 of 10 Step 70 ntokens 16328368 Example 21300 of 34323 loss = 3.4906 nll loss = 2.1283 accu = 0.3707

Validating: Epoch 1 of 10 Step 71 ntokens 16328368 Example 21600 of 34323 loss = 3.4911 nll loss = 2.1281 accu = 0.3707

Validating: Epoch 1 of 10 Step 72 ntokens 16328368 Example 21900 of 34323 loss = 3.4913 nll loss = 2.1266 accu = 0.3712

Validating: Epoch 1 of 10 Step 73 ntokens 16328368 Example 22200 of 34323 loss = 3.4920 nll loss = 2.1276 accu = 0.3709

Validating: Epoch 1 of 10 Step 74 ntokens 16328368 Example 22500 of 34323 loss = 3.4923 nll loss = 2.1275 accu = 0.3710

Validating: Epoch 1 of 10 Step 75 ntokens 16328368 Example 22800 of 34323 loss = 3.4911 nll loss = 2.1274 accu = 0.3710

Validating: Epoch 1 of 10 Step 76 ntokens 16328368 Example 23100 of 34323 loss = 3.4908 nll loss = 2.1277 accu = 0.3709

Validating: Epoch 1 of 10 Step 77 ntokens 16328368 Example 23400 of 34323 loss = 3.4914 nll loss = 2.1279 accu = 0.3709

Validating: Epoch 1 of 10 Step 78 ntokens 16328368 Example 23700 of 34323 loss = 3.4916 nll loss = 2.1276 accu = 0.3710

Validating: Epoch 1 of 10 Step 79 ntokens 16328368 Example 24000 of 34323 loss = 3.4919 nll loss = 2.1279 accu = 0.3709

Validating: Epoch 1 of 10 Step 80 ntokens 16328368 Example 24300 of 34323 loss = 3.4934 nll loss = 2.1275 accu = 0.3710

Validating: Epoch 1 of 10 Step 81 ntokens 16328368 Example 24600 of 34323 loss = 3.4935 nll loss = 2.1277 accu = 0.3709

Validating: Epoch 1 of 10 Step 82 ntokens 16328368 Example 24900 of 34323 loss = 3.4935 nll loss = 2.1271 accu = 0.3712

Validating: Epoch 1 of 10 Step 83 ntokens 16328368 Example 25200 of 34323 loss = 3.4933 nll loss = 2.1266 accu = 0.3713

Validating: Epoch 1 of 10 Step 84 ntokens 16328368 Example 25500 of 34323 loss = 3.4935 nll loss = 2.1264 accu = 0.3714

Validating: Epoch 1 of 10 Step 85 ntokens 16328368 Example 25800 of 34323 loss = 3.4935 nll loss = 2.1270 accu = 0.3712

Validating: Epoch 1 of 10 Step 86 ntokens 16328368 Example 26100 of 34323 loss = 3.4942 nll loss = 2.1278 accu = 0.3709

Validating: Epoch 1 of 10 Step 87 ntokens 16328368 Example 26400 of 34323 loss = 3.4939 nll loss = 2.1278 accu = 0.3709

Validating: Epoch 1 of 10 Step 88 ntokens 16328368 Example 26700 of 34323 loss = 3.4945 nll loss = 2.1290 accu = 0.3705

Validating: Epoch 1 of 10 Step 89 ntokens 16328368 Example 27000 of 34323 loss = 3.4947 nll loss = 2.1284 accu = 0.3707

Validating: Epoch 1 of 10 Step 90 ntokens 16328368 Example 27300 of 34323 loss = 3.4952 nll loss = 2.1286 accu = 0.3706

Validating: Epoch 1 of 10 Step 91 ntokens 16328368 Example 27600 of 34323 loss = 3.4957 nll loss = 2.1292 accu = 0.3705

Validating: Epoch 1 of 10 Step 92 ntokens 16328368 Example 27900 of 34323 loss = 3.4948 nll loss = 2.1297 accu = 0.3703

Validating: Epoch 1 of 10 Step 93 ntokens 16328368 Example 28200 of 34323 loss = 3.4946 nll loss = 2.1296 accu = 0.3703

Validating: Epoch 1 of 10 Step 94 ntokens 16328368 Example 28500 of 34323 loss = 3.4947 nll loss = 2.1301 accu = 0.3701

Validating: Epoch 1 of 10 Step 95 ntokens 16328368 Example 28800 of 34323 loss = 3.4953 nll loss = 2.1299 accu = 0.3702

Validating: Epoch 1 of 10 Step 96 ntokens 16328368 Example 29100 of 34323 loss = 3.4959 nll loss = 2.1296 accu = 0.3703

Validating: Epoch 1 of 10 Step 97 ntokens 16328368 Example 29400 of 34323 loss = 3.4965 nll loss = 2.1298 accu = 0.3702

Validating: Epoch 1 of 10 Step 98 ntokens 16328368 Example 29700 of 34323 loss = 3.4961 nll loss = 2.1303 accu = 0.3701

Validating: Epoch 1 of 10 Step 99 ntokens 16328368 Example 30000 of 34323 loss = 3.4963 nll loss = 2.1302 accu = 0.3701

Validating: Epoch 1 of 10 Step 100 ntokens 16328368 Example 30300 of 34323 loss = 3.4963 nll loss = 2.1304 accu = 0.3701

Validating: Epoch 1 of 10 Step 101 ntokens 16328368 Example 30600 of 34323 loss = 3.4966 nll loss = 2.1297 accu = 0.3704

Validating: Epoch 1 of 10 Step 102 ntokens 16328368 Example 30900 of 34323 loss = 3.4961 nll loss = 2.1298 accu = 0.3703

Validating: Epoch 1 of 10 Step 103 ntokens 16328368 Example 31200 of 34323 loss = 3.4962 nll loss = 2.1295 accu = 0.3704

Validating: Epoch 1 of 10 Step 104 ntokens 16328368 Example 31500 of 34323 loss = 3.4969 nll loss = 2.1297 accu = 0.3703

Validating: Epoch 1 of 10 Step 105 ntokens 16328368 Example 31800 of 34323 loss = 3.4969 nll loss = 2.1303 accu = 0.3701

Validating: Epoch 1 of 10 Step 106 ntokens 16328368 Example 32100 of 34323 loss = 3.4965 nll loss = 2.1302 accu = 0.3702

Validating: Epoch 1 of 10 Step 107 ntokens 16328368 Example 32400 of 34323 loss = 3.4963 nll loss = 2.1302 accu = 0.3702

Validating: Epoch 1 of 10 Step 108 ntokens 16328368 Example 32700 of 34323 loss = 3.4980 nll loss = 2.1297 accu = 0.3704

Validating: Epoch 1 of 10 Step 109 ntokens 16328368 Example 33000 of 34323 loss = 3.4982 nll loss = 2.1296 accu = 0.3704

Validating: Epoch 1 of 10 Step 110 ntokens 16328368 Example 33300 of 34323 loss = 3.4974 nll loss = 2.1285 accu = 0.3708

Validating: Epoch 1 of 10 Step 111 ntokens 16328368 Example 33600 of 34323 loss = 3.4966 nll loss = 2.1287 accu = 0.3707

Validating: Epoch 1 of 10 Step 112 ntokens 16328368 Example 33900 of 34323 loss = 3.4967 nll loss = 2.1291 accu = 0.3706

Validating: Epoch 1 of 10 Step 113 ntokens 16328368 Example 34200 of 34323 loss = 3.4961 nll loss = 2.1294 accu = 0.3705

Validating: Epoch 1 of 10 Step 114 ntokens 16328368 Example 34323 of 34323 loss = 3.4962 nll loss = 2.1292 accu = 0.3706

Validation complete in 0:00:15.045667
Epoch complete in 0:02:30.853807
Training: Epoch 2 of 10 Step 462 ntokens 16363768 Example 300 of 138376 loss = 3.4619 nll loss = 2.1412 accu = 0.3706

Training: Epoch 2 of 10 Step 463 ntokens 16399168 Example 600 of 138376 loss = 3.4704 nll loss = 2.1821 accu = 0.3540

Training: Epoch 2 of 10 Step 464 ntokens 16434568 Example 900 of 138376 loss = 3.4873 nll loss = 2.1670 accu = 0.3596

Training: Epoch 2 of 10 Step 465 ntokens 16469968 Example 1200 of 138376 loss = 3.4804 nll loss = 2.1610 accu = 0.3611

Training: Epoch 2 of 10 Step 466 ntokens 16505368 Example 1500 of 138376 loss = 3.4779 nll loss = 2.1521 accu = 0.3644

Training: Epoch 2 of 10 Step 467 ntokens 16540768 Example 1800 of 138376 loss = 3.4636 nll loss = 2.1507 accu = 0.3647

Training: Epoch 2 of 10 Step 468 ntokens 16576168 Example 2100 of 138376 loss = 3.4730 nll loss = 2.1510 accu = 0.3651

Training: Epoch 2 of 10 Step 469 ntokens 16611568 Example 2400 of 138376 loss = 3.4764 nll loss = 2.1414 accu = 0.3683

Training: Epoch 2 of 10 Step 470 ntokens 16646968 Example 2700 of 138376 loss = 3.4723 nll loss = 2.1332 accu = 0.3709

Training: Epoch 2 of 10 Step 471 ntokens 16682368 Example 3000 of 138376 loss = 3.4738 nll loss = 2.1394 accu = 0.3681

Training: Epoch 2 of 10 Step 472 ntokens 16717768 Example 3300 of 138376 loss = 3.4810 nll loss = 2.1440 accu = 0.3665

Training: Epoch 2 of 10 Step 473 ntokens 16753168 Example 3600 of 138376 loss = 3.4920 nll loss = 2.1471 accu = 0.3654

Training: Epoch 2 of 10 Step 474 ntokens 16788568 Example 3900 of 138376 loss = 3.4913 nll loss = 2.1410 accu = 0.3670

Training: Epoch 2 of 10 Step 475 ntokens 16823968 Example 4200 of 138376 loss = 3.4902 nll loss = 2.1389 accu = 0.3677

Training: Epoch 2 of 10 Step 476 ntokens 16859368 Example 4500 of 138376 loss = 3.4932 nll loss = 2.1362 accu = 0.3686

Training: Epoch 2 of 10 Step 477 ntokens 16894768 Example 4800 of 138376 loss = 3.4906 nll loss = 2.1341 accu = 0.3697

Training: Epoch 2 of 10 Step 478 ntokens 16930168 Example 5100 of 138376 loss = 3.4948 nll loss = 2.1328 accu = 0.3702

Training: Epoch 2 of 10 Step 479 ntokens 16965568 Example 5400 of 138376 loss = 3.4983 nll loss = 2.1336 accu = 0.3697

Training: Epoch 2 of 10 Step 480 ntokens 17000968 Example 5700 of 138376 loss = 3.4973 nll loss = 2.1304 accu = 0.3710

Training: Epoch 2 of 10 Step 481 ntokens 17036368 Example 6000 of 138376 loss = 3.4964 nll loss = 2.1335 accu = 0.3698

Training: Epoch 2 of 10 Step 482 ntokens 17071768 Example 6300 of 138376 loss = 3.4998 nll loss = 2.1364 accu = 0.3687

Training: Epoch 2 of 10 Step 483 ntokens 17107168 Example 6600 of 138376 loss = 3.4998 nll loss = 2.1343 accu = 0.3695

Training: Epoch 2 of 10 Step 484 ntokens 17142568 Example 6900 of 138376 loss = 3.5010 nll loss = 2.1337 accu = 0.3697

Training: Epoch 2 of 10 Step 485 ntokens 17177968 Example 7200 of 138376 loss = 3.4955 nll loss = 2.1351 accu = 0.3692

Training: Epoch 2 of 10 Step 486 ntokens 17213368 Example 7500 of 138376 loss = 3.4920 nll loss = 2.1342 accu = 0.3693

Training: Epoch 2 of 10 Step 487 ntokens 17248768 Example 7800 of 138376 loss = 3.4964 nll loss = 2.1349 accu = 0.3691

Training: Epoch 2 of 10 Step 488 ntokens 17284168 Example 8100 of 138376 loss = 3.4983 nll loss = 2.1339 accu = 0.3692

Training: Epoch 2 of 10 Step 489 ntokens 17319568 Example 8400 of 138376 loss = 3.4955 nll loss = 2.1313 accu = 0.3702

Training: Epoch 2 of 10 Step 490 ntokens 17354968 Example 8700 of 138376 loss = 3.4929 nll loss = 2.1313 accu = 0.3701

Training: Epoch 2 of 10 Step 491 ntokens 17390368 Example 9000 of 138376 loss = 3.4946 nll loss = 2.1288 accu = 0.3709

Training: Epoch 2 of 10 Step 492 ntokens 17425768 Example 9300 of 138376 loss = 3.4933 nll loss = 2.1282 accu = 0.3710

Training: Epoch 2 of 10 Step 493 ntokens 17461168 Example 9600 of 138376 loss = 3.4923 nll loss = 2.1289 accu = 0.3708

Training: Epoch 2 of 10 Step 494 ntokens 17496568 Example 9900 of 138376 loss = 3.4958 nll loss = 2.1276 accu = 0.3712

Training: Epoch 2 of 10 Step 495 ntokens 17531968 Example 10200 of 138376 loss = 3.4963 nll loss = 2.1280 accu = 0.3711

Training: Epoch 2 of 10 Step 496 ntokens 17567368 Example 10500 of 138376 loss = 3.4918 nll loss = 2.1255 accu = 0.3721

Training: Epoch 2 of 10 Step 497 ntokens 17602768 Example 10800 of 138376 loss = 3.4930 nll loss = 2.1256 accu = 0.3719

Training: Epoch 2 of 10 Step 498 ntokens 17638168 Example 11100 of 138376 loss = 3.4953 nll loss = 2.1253 accu = 0.3721

Training: Epoch 2 of 10 Step 499 ntokens 17673568 Example 11400 of 138376 loss = 3.4986 nll loss = 2.1249 accu = 0.3722

Training: Epoch 2 of 10 Step 500 ntokens 17708968 Example 11700 of 138376 loss = 3.4987 nll loss = 2.1239 accu = 0.3725

Training: Epoch 2 of 10 Step 501 ntokens 17744368 Example 12000 of 138376 loss = 3.4974 nll loss = 2.1233 accu = 0.3727

Training: Epoch 2 of 10 Step 502 ntokens 17779768 Example 12300 of 138376 loss = 3.4993 nll loss = 2.1232 accu = 0.3728

Training: Epoch 2 of 10 Step 503 ntokens 17815168 Example 12600 of 138376 loss = 3.4967 nll loss = 2.1227 accu = 0.3731

Training: Epoch 2 of 10 Step 504 ntokens 17850568 Example 12900 of 138376 loss = 3.4977 nll loss = 2.1222 accu = 0.3732

Training: Epoch 2 of 10 Step 505 ntokens 17885968 Example 13200 of 138376 loss = 3.4991 nll loss = 2.1232 accu = 0.3729

Training: Epoch 2 of 10 Step 506 ntokens 17921368 Example 13500 of 138376 loss = 3.5004 nll loss = 2.1247 accu = 0.3724

Training: Epoch 2 of 10 Step 507 ntokens 17956768 Example 13800 of 138376 loss = 3.4998 nll loss = 2.1239 accu = 0.3726

Training: Epoch 2 of 10 Step 508 ntokens 17992168 Example 14100 of 138376 loss = 3.4979 nll loss = 2.1242 accu = 0.3725

Training: Epoch 2 of 10 Step 509 ntokens 18027568 Example 14400 of 138376 loss = 3.4981 nll loss = 2.1249 accu = 0.3722

Training: Epoch 2 of 10 Step 510 ntokens 18062968 Example 14700 of 138376 loss = 3.4972 nll loss = 2.1248 accu = 0.3723

Training: Epoch 2 of 10 Step 511 ntokens 18098368 Example 15000 of 138376 loss = 3.4957 nll loss = 2.1242 accu = 0.3725

Training: Epoch 2 of 10 Step 512 ntokens 18133768 Example 15300 of 138376 loss = 3.4963 nll loss = 2.1242 accu = 0.3726

Training: Epoch 2 of 10 Step 513 ntokens 18169168 Example 15600 of 138376 loss = 3.4972 nll loss = 2.1226 accu = 0.3731

Training: Epoch 2 of 10 Step 514 ntokens 18204568 Example 15900 of 138376 loss = 3.4976 nll loss = 2.1218 accu = 0.3735

Training: Epoch 2 of 10 Step 515 ntokens 18239968 Example 16200 of 138376 loss = 3.4961 nll loss = 2.1213 accu = 0.3736

Training: Epoch 2 of 10 Step 516 ntokens 18275368 Example 16500 of 138376 loss = 3.4970 nll loss = 2.1223 accu = 0.3734

Training: Epoch 2 of 10 Step 517 ntokens 18310768 Example 16800 of 138376 loss = 3.4975 nll loss = 2.1233 accu = 0.3730

Training: Epoch 2 of 10 Step 518 ntokens 18346168 Example 17100 of 138376 loss = 3.4968 nll loss = 2.1225 accu = 0.3732

Training: Epoch 2 of 10 Step 519 ntokens 18381568 Example 17400 of 138376 loss = 3.4980 nll loss = 2.1214 accu = 0.3736

Training: Epoch 2 of 10 Step 520 ntokens 18416968 Example 17700 of 138376 loss = 3.4959 nll loss = 2.1206 accu = 0.3739

Training: Epoch 2 of 10 Step 521 ntokens 18452368 Example 18000 of 138376 loss = 3.4968 nll loss = 2.1193 accu = 0.3743

Training: Epoch 2 of 10 Step 522 ntokens 18487768 Example 18300 of 138376 loss = 3.4969 nll loss = 2.1200 accu = 0.3740

Training: Epoch 2 of 10 Step 523 ntokens 18523168 Example 18600 of 138376 loss = 3.4964 nll loss = 2.1204 accu = 0.3739

Training: Epoch 2 of 10 Step 524 ntokens 18558568 Example 18900 of 138376 loss = 3.4958 nll loss = 2.1202 accu = 0.3739

Training: Epoch 2 of 10 Step 525 ntokens 18593968 Example 19200 of 138376 loss = 3.4963 nll loss = 2.1202 accu = 0.3739

Training: Epoch 2 of 10 Step 526 ntokens 18629368 Example 19500 of 138376 loss = 3.4961 nll loss = 2.1201 accu = 0.3740

Training: Epoch 2 of 10 Step 527 ntokens 18664768 Example 19800 of 138376 loss = 3.4961 nll loss = 2.1210 accu = 0.3737

Training: Epoch 2 of 10 Step 528 ntokens 18700168 Example 20100 of 138376 loss = 3.4967 nll loss = 2.1204 accu = 0.3738

Training: Epoch 2 of 10 Step 529 ntokens 18735568 Example 20400 of 138376 loss = 3.4957 nll loss = 2.1202 accu = 0.3740

Training: Epoch 2 of 10 Step 530 ntokens 18770968 Example 20700 of 138376 loss = 3.4942 nll loss = 2.1196 accu = 0.3742

Training: Epoch 2 of 10 Step 531 ntokens 18806368 Example 21000 of 138376 loss = 3.4947 nll loss = 2.1200 accu = 0.3741

Training: Epoch 2 of 10 Step 532 ntokens 18841768 Example 21300 of 138376 loss = 3.4943 nll loss = 2.1199 accu = 0.3741

Training: Epoch 2 of 10 Step 533 ntokens 18877168 Example 21600 of 138376 loss = 3.4936 nll loss = 2.1204 accu = 0.3739

Training: Epoch 2 of 10 Step 534 ntokens 18912568 Example 21900 of 138376 loss = 3.4928 nll loss = 2.1201 accu = 0.3740

Training: Epoch 2 of 10 Step 535 ntokens 18947968 Example 22200 of 138376 loss = 3.4930 nll loss = 2.1203 accu = 0.3739

Training: Epoch 2 of 10 Step 536 ntokens 18983368 Example 22500 of 138376 loss = 3.4933 nll loss = 2.1206 accu = 0.3739

Training: Epoch 2 of 10 Step 537 ntokens 19018768 Example 22800 of 138376 loss = 3.4945 nll loss = 2.1206 accu = 0.3739

Training: Epoch 2 of 10 Step 538 ntokens 19054168 Example 23100 of 138376 loss = 3.4939 nll loss = 2.1217 accu = 0.3735

Training: Epoch 2 of 10 Step 539 ntokens 19089568 Example 23400 of 138376 loss = 3.4934 nll loss = 2.1218 accu = 0.3734

Training: Epoch 2 of 10 Step 540 ntokens 19124968 Example 23700 of 138376 loss = 3.4938 nll loss = 2.1223 accu = 0.3733

Training: Epoch 2 of 10 Step 541 ntokens 19160368 Example 24000 of 138376 loss = 3.4935 nll loss = 2.1213 accu = 0.3736

Training: Epoch 2 of 10 Step 542 ntokens 19195768 Example 24300 of 138376 loss = 3.4938 nll loss = 2.1209 accu = 0.3738

Training: Epoch 2 of 10 Step 543 ntokens 19231168 Example 24600 of 138376 loss = 3.4928 nll loss = 2.1205 accu = 0.3739

Training: Epoch 2 of 10 Step 544 ntokens 19266568 Example 24900 of 138376 loss = 3.4941 nll loss = 2.1202 accu = 0.3740

Training: Epoch 2 of 10 Step 545 ntokens 19301968 Example 25200 of 138376 loss = 3.4947 nll loss = 2.1189 accu = 0.3744

Training: Epoch 2 of 10 Step 546 ntokens 19337368 Example 25500 of 138376 loss = 3.4949 nll loss = 2.1187 accu = 0.3745

Training: Epoch 2 of 10 Step 547 ntokens 19372768 Example 25800 of 138376 loss = 3.4966 nll loss = 2.1184 accu = 0.3745

Training: Epoch 2 of 10 Step 548 ntokens 19408168 Example 26100 of 138376 loss = 3.4966 nll loss = 2.1186 accu = 0.3744

Training: Epoch 2 of 10 Step 549 ntokens 19443568 Example 26400 of 138376 loss = 3.4969 nll loss = 2.1185 accu = 0.3745

Training: Epoch 2 of 10 Step 550 ntokens 19478968 Example 26700 of 138376 loss = 3.4964 nll loss = 2.1174 accu = 0.3748

Training: Epoch 2 of 10 Step 551 ntokens 19514368 Example 27000 of 138376 loss = 3.4971 nll loss = 2.1173 accu = 0.3749

Training: Epoch 2 of 10 Step 552 ntokens 19549768 Example 27300 of 138376 loss = 3.4977 nll loss = 2.1170 accu = 0.3750

Training: Epoch 2 of 10 Step 553 ntokens 19585168 Example 27600 of 138376 loss = 3.4973 nll loss = 2.1171 accu = 0.3749

Training: Epoch 2 of 10 Step 554 ntokens 19620568 Example 27900 of 138376 loss = 3.4972 nll loss = 2.1159 accu = 0.3754

Training: Epoch 2 of 10 Step 555 ntokens 19655968 Example 28200 of 138376 loss = 3.4964 nll loss = 2.1161 accu = 0.3753

Training: Epoch 2 of 10 Step 556 ntokens 19691368 Example 28500 of 138376 loss = 3.4963 nll loss = 2.1173 accu = 0.3749

Training: Epoch 2 of 10 Step 557 ntokens 19726768 Example 28800 of 138376 loss = 3.4959 nll loss = 2.1172 accu = 0.3749

Training: Epoch 2 of 10 Step 558 ntokens 19762168 Example 29100 of 138376 loss = 3.4953 nll loss = 2.1169 accu = 0.3750

Training: Epoch 2 of 10 Step 559 ntokens 19797568 Example 29400 of 138376 loss = 3.4949 nll loss = 2.1172 accu = 0.3749

Training: Epoch 2 of 10 Step 560 ntokens 19832968 Example 29700 of 138376 loss = 3.4951 nll loss = 2.1177 accu = 0.3748

Training: Epoch 2 of 10 Step 561 ntokens 19868368 Example 30000 of 138376 loss = 3.4960 nll loss = 2.1183 accu = 0.3746

Training: Epoch 2 of 10 Step 562 ntokens 19903768 Example 30300 of 138376 loss = 3.4952 nll loss = 2.1186 accu = 0.3745

Training: Epoch 2 of 10 Step 563 ntokens 19939168 Example 30600 of 138376 loss = 3.4954 nll loss = 2.1184 accu = 0.3745

Training: Epoch 2 of 10 Step 564 ntokens 19974568 Example 30900 of 138376 loss = 3.4945 nll loss = 2.1178 accu = 0.3747

Training: Epoch 2 of 10 Step 565 ntokens 20009968 Example 31200 of 138376 loss = 3.4948 nll loss = 2.1180 accu = 0.3747

Training: Epoch 2 of 10 Step 566 ntokens 20045368 Example 31500 of 138376 loss = 3.4957 nll loss = 2.1184 accu = 0.3746

Training: Epoch 2 of 10 Step 567 ntokens 20080768 Example 31800 of 138376 loss = 3.4964 nll loss = 2.1178 accu = 0.3748

Training: Epoch 2 of 10 Step 568 ntokens 20116168 Example 32100 of 138376 loss = 3.4959 nll loss = 2.1181 accu = 0.3747

Training: Epoch 2 of 10 Step 569 ntokens 20151568 Example 32400 of 138376 loss = 3.4961 nll loss = 2.1185 accu = 0.3745

Training: Epoch 2 of 10 Step 570 ntokens 20186968 Example 32700 of 138376 loss = 3.4956 nll loss = 2.1187 accu = 0.3744

Training: Epoch 2 of 10 Step 571 ntokens 20222368 Example 33000 of 138376 loss = 3.4955 nll loss = 2.1185 accu = 0.3745

Training: Epoch 2 of 10 Step 572 ntokens 20257768 Example 33300 of 138376 loss = 3.4955 nll loss = 2.1185 accu = 0.3745

Training: Epoch 2 of 10 Step 573 ntokens 20293168 Example 33600 of 138376 loss = 3.4954 nll loss = 2.1185 accu = 0.3745

Training: Epoch 2 of 10 Step 574 ntokens 20328568 Example 33900 of 138376 loss = 3.4959 nll loss = 2.1179 accu = 0.3748

Training: Epoch 2 of 10 Step 575 ntokens 20363968 Example 34200 of 138376 loss = 3.4956 nll loss = 2.1177 accu = 0.3748

Training: Epoch 2 of 10 Step 576 ntokens 20399368 Example 34500 of 138376 loss = 3.4955 nll loss = 2.1181 accu = 0.3747

Training: Epoch 2 of 10 Step 577 ntokens 20434768 Example 34800 of 138376 loss = 3.4959 nll loss = 2.1180 accu = 0.3747

Training: Epoch 2 of 10 Step 578 ntokens 20470168 Example 35100 of 138376 loss = 3.4955 nll loss = 2.1185 accu = 0.3746

Training: Epoch 2 of 10 Step 579 ntokens 20505568 Example 35400 of 138376 loss = 3.4955 nll loss = 2.1185 accu = 0.3745

Training: Epoch 2 of 10 Step 580 ntokens 20540968 Example 35700 of 138376 loss = 3.4960 nll loss = 2.1188 accu = 0.3744

Training: Epoch 2 of 10 Step 581 ntokens 20576368 Example 36000 of 138376 loss = 3.4967 nll loss = 2.1190 accu = 0.3743

Training: Epoch 2 of 10 Step 582 ntokens 20611768 Example 36300 of 138376 loss = 3.4975 nll loss = 2.1189 accu = 0.3744

Training: Epoch 2 of 10 Step 583 ntokens 20647168 Example 36600 of 138376 loss = 3.4977 nll loss = 2.1192 accu = 0.3743

Training: Epoch 2 of 10 Step 584 ntokens 20682568 Example 36900 of 138376 loss = 3.4976 nll loss = 2.1193 accu = 0.3743

Training: Epoch 2 of 10 Step 585 ntokens 20717968 Example 37200 of 138376 loss = 3.4970 nll loss = 2.1197 accu = 0.3741

Training: Epoch 2 of 10 Step 586 ntokens 20753368 Example 37500 of 138376 loss = 3.4974 nll loss = 2.1196 accu = 0.3741

Training: Epoch 2 of 10 Step 587 ntokens 20788768 Example 37800 of 138376 loss = 3.4975 nll loss = 2.1198 accu = 0.3740

Training: Epoch 2 of 10 Step 588 ntokens 20824168 Example 38100 of 138376 loss = 3.4966 nll loss = 2.1203 accu = 0.3739

Training: Epoch 2 of 10 Step 589 ntokens 20859568 Example 38400 of 138376 loss = 3.4968 nll loss = 2.1201 accu = 0.3740

Training: Epoch 2 of 10 Step 590 ntokens 20894968 Example 38700 of 138376 loss = 3.4972 nll loss = 2.1198 accu = 0.3741

Training: Epoch 2 of 10 Step 591 ntokens 20930368 Example 39000 of 138376 loss = 3.4974 nll loss = 2.1201 accu = 0.3740

Training: Epoch 2 of 10 Step 592 ntokens 20965768 Example 39300 of 138376 loss = 3.4977 nll loss = 2.1204 accu = 0.3739

Training: Epoch 2 of 10 Step 593 ntokens 21001168 Example 39600 of 138376 loss = 3.4972 nll loss = 2.1205 accu = 0.3738

Training: Epoch 2 of 10 Step 594 ntokens 21036568 Example 39900 of 138376 loss = 3.4975 nll loss = 2.1202 accu = 0.3740

Training: Epoch 2 of 10 Step 595 ntokens 21071968 Example 40200 of 138376 loss = 3.4979 nll loss = 2.1200 accu = 0.3740

Training: Epoch 2 of 10 Step 596 ntokens 21107368 Example 40500 of 138376 loss = 3.4979 nll loss = 2.1204 accu = 0.3739

Training: Epoch 2 of 10 Step 597 ntokens 21142768 Example 40800 of 138376 loss = 3.4981 nll loss = 2.1205 accu = 0.3739

Training: Epoch 2 of 10 Step 598 ntokens 21178168 Example 41100 of 138376 loss = 3.4975 nll loss = 2.1204 accu = 0.3739

Training: Epoch 2 of 10 Step 599 ntokens 21213568 Example 41400 of 138376 loss = 3.4973 nll loss = 2.1200 accu = 0.3740

Training: Epoch 2 of 10 Step 600 ntokens 21248968 Example 41700 of 138376 loss = 3.4971 nll loss = 2.1206 accu = 0.3738

Training: Epoch 2 of 10 Step 601 ntokens 21284368 Example 42000 of 138376 loss = 3.4968 nll loss = 2.1206 accu = 0.3739

Training: Epoch 2 of 10 Step 602 ntokens 21319768 Example 42300 of 138376 loss = 3.4971 nll loss = 2.1203 accu = 0.3740

Training: Epoch 2 of 10 Step 603 ntokens 21355168 Example 42600 of 138376 loss = 3.4971 nll loss = 2.1206 accu = 0.3739

Training: Epoch 2 of 10 Step 604 ntokens 21390568 Example 42900 of 138376 loss = 3.4969 nll loss = 2.1205 accu = 0.3739

Training: Epoch 2 of 10 Step 605 ntokens 21425968 Example 43200 of 138376 loss = 3.4970 nll loss = 2.1208 accu = 0.3738

Training: Epoch 2 of 10 Step 606 ntokens 21461368 Example 43500 of 138376 loss = 3.4972 nll loss = 2.1208 accu = 0.3738

Training: Epoch 2 of 10 Step 607 ntokens 21496768 Example 43800 of 138376 loss = 3.4968 nll loss = 2.1207 accu = 0.3739

Training: Epoch 2 of 10 Step 608 ntokens 21532168 Example 44100 of 138376 loss = 3.4961 nll loss = 2.1208 accu = 0.3738

Training: Epoch 2 of 10 Step 609 ntokens 21567568 Example 44400 of 138376 loss = 3.4956 nll loss = 2.1208 accu = 0.3739

Training: Epoch 2 of 10 Step 610 ntokens 21602968 Example 44700 of 138376 loss = 3.4950 nll loss = 2.1207 accu = 0.3739

Training: Epoch 2 of 10 Step 611 ntokens 21638368 Example 45000 of 138376 loss = 3.4952 nll loss = 2.1207 accu = 0.3739

Training: Epoch 2 of 10 Step 612 ntokens 21673768 Example 45300 of 138376 loss = 3.4951 nll loss = 2.1212 accu = 0.3737

Training: Epoch 2 of 10 Step 613 ntokens 21709168 Example 45600 of 138376 loss = 3.4947 nll loss = 2.1212 accu = 0.3737

Training: Epoch 2 of 10 Step 614 ntokens 21744568 Example 45900 of 138376 loss = 3.4945 nll loss = 2.1206 accu = 0.3739

Training: Epoch 2 of 10 Step 615 ntokens 21779968 Example 46200 of 138376 loss = 3.4944 nll loss = 2.1205 accu = 0.3739

Training: Epoch 2 of 10 Step 616 ntokens 21815368 Example 46500 of 138376 loss = 3.4947 nll loss = 2.1208 accu = 0.3738

Training: Epoch 2 of 10 Step 617 ntokens 21850768 Example 46800 of 138376 loss = 3.4950 nll loss = 2.1208 accu = 0.3739

Training: Epoch 2 of 10 Step 618 ntokens 21886168 Example 47100 of 138376 loss = 3.4953 nll loss = 2.1211 accu = 0.3737

Training: Epoch 2 of 10 Step 619 ntokens 21921568 Example 47400 of 138376 loss = 3.4954 nll loss = 2.1209 accu = 0.3738

Training: Epoch 2 of 10 Step 620 ntokens 21956968 Example 47700 of 138376 loss = 3.4948 nll loss = 2.1211 accu = 0.3738

Training: Epoch 2 of 10 Step 621 ntokens 21992368 Example 48000 of 138376 loss = 3.4949 nll loss = 2.1212 accu = 0.3738

Training: Epoch 2 of 10 Step 622 ntokens 22027768 Example 48300 of 138376 loss = 3.4948 nll loss = 2.1210 accu = 0.3738

Training: Epoch 2 of 10 Step 623 ntokens 22063168 Example 48600 of 138376 loss = 3.4947 nll loss = 2.1212 accu = 0.3737

Training: Epoch 2 of 10 Step 624 ntokens 22098568 Example 48900 of 138376 loss = 3.4952 nll loss = 2.1214 accu = 0.3737

Training: Epoch 2 of 10 Step 625 ntokens 22133968 Example 49200 of 138376 loss = 3.4959 nll loss = 2.1220 accu = 0.3735

Training: Epoch 2 of 10 Step 626 ntokens 22169368 Example 49500 of 138376 loss = 3.4957 nll loss = 2.1219 accu = 0.3735

Training: Epoch 2 of 10 Step 627 ntokens 22204768 Example 49800 of 138376 loss = 3.4952 nll loss = 2.1217 accu = 0.3736

Training: Epoch 2 of 10 Step 628 ntokens 22240168 Example 50100 of 138376 loss = 3.4957 nll loss = 2.1222 accu = 0.3734

Training: Epoch 2 of 10 Step 629 ntokens 22275568 Example 50400 of 138376 loss = 3.4961 nll loss = 2.1222 accu = 0.3734

Training: Epoch 2 of 10 Step 630 ntokens 22310968 Example 50700 of 138376 loss = 3.4963 nll loss = 2.1223 accu = 0.3734

Training: Epoch 2 of 10 Step 631 ntokens 22346368 Example 51000 of 138376 loss = 3.4961 nll loss = 2.1224 accu = 0.3734

Training: Epoch 2 of 10 Step 632 ntokens 22381768 Example 51300 of 138376 loss = 3.4966 nll loss = 2.1225 accu = 0.3733

Training: Epoch 2 of 10 Step 633 ntokens 22417168 Example 51600 of 138376 loss = 3.4965 nll loss = 2.1229 accu = 0.3732

Training: Epoch 2 of 10 Step 634 ntokens 22452568 Example 51900 of 138376 loss = 3.4964 nll loss = 2.1229 accu = 0.3732

Training: Epoch 2 of 10 Step 635 ntokens 22487968 Example 52200 of 138376 loss = 3.4971 nll loss = 2.1230 accu = 0.3732

Training: Epoch 2 of 10 Step 636 ntokens 22523368 Example 52500 of 138376 loss = 3.4966 nll loss = 2.1227 accu = 0.3733

Training: Epoch 2 of 10 Step 637 ntokens 22558768 Example 52800 of 138376 loss = 3.4960 nll loss = 2.1230 accu = 0.3732

Training: Epoch 2 of 10 Step 638 ntokens 22594168 Example 53100 of 138376 loss = 3.4968 nll loss = 2.1228 accu = 0.3732

Training: Epoch 2 of 10 Step 639 ntokens 22629568 Example 53400 of 138376 loss = 3.4975 nll loss = 2.1231 accu = 0.3731

Training: Epoch 2 of 10 Step 640 ntokens 22664968 Example 53700 of 138376 loss = 3.4978 nll loss = 2.1233 accu = 0.3730

Training: Epoch 2 of 10 Step 641 ntokens 22700368 Example 54000 of 138376 loss = 3.4977 nll loss = 2.1237 accu = 0.3729

Training: Epoch 2 of 10 Step 642 ntokens 22735768 Example 54300 of 138376 loss = 3.4980 nll loss = 2.1240 accu = 0.3728

Training: Epoch 2 of 10 Step 643 ntokens 22771168 Example 54600 of 138376 loss = 3.4981 nll loss = 2.1242 accu = 0.3727

Training: Epoch 2 of 10 Step 644 ntokens 22806568 Example 54900 of 138376 loss = 3.4985 nll loss = 2.1241 accu = 0.3728

Training: Epoch 2 of 10 Step 645 ntokens 22841968 Example 55200 of 138376 loss = 3.4978 nll loss = 2.1240 accu = 0.3728

Training: Epoch 2 of 10 Step 646 ntokens 22877368 Example 55500 of 138376 loss = 3.4982 nll loss = 2.1242 accu = 0.3727

Training: Epoch 2 of 10 Step 647 ntokens 22912768 Example 55800 of 138376 loss = 3.4981 nll loss = 2.1240 accu = 0.3728

Training: Epoch 2 of 10 Step 648 ntokens 22948168 Example 56100 of 138376 loss = 3.4977 nll loss = 2.1238 accu = 0.3728

Training: Epoch 2 of 10 Step 649 ntokens 22983568 Example 56400 of 138376 loss = 3.4981 nll loss = 2.1237 accu = 0.3729

Training: Epoch 2 of 10 Step 650 ntokens 23018968 Example 56700 of 138376 loss = 3.4978 nll loss = 2.1237 accu = 0.3729

Training: Epoch 2 of 10 Step 651 ntokens 23054368 Example 57000 of 138376 loss = 3.4978 nll loss = 2.1238 accu = 0.3729

Training: Epoch 2 of 10 Step 652 ntokens 23089768 Example 57300 of 138376 loss = 3.4976 nll loss = 2.1245 accu = 0.3727

Training: Epoch 2 of 10 Step 653 ntokens 23125168 Example 57600 of 138376 loss = 3.4978 nll loss = 2.1247 accu = 0.3726

Training: Epoch 2 of 10 Step 654 ntokens 23160568 Example 57900 of 138376 loss = 3.4976 nll loss = 2.1246 accu = 0.3726

Training: Epoch 2 of 10 Step 655 ntokens 23195968 Example 58200 of 138376 loss = 3.4977 nll loss = 2.1248 accu = 0.3726

Training: Epoch 2 of 10 Step 656 ntokens 23231368 Example 58500 of 138376 loss = 3.4980 nll loss = 2.1248 accu = 0.3726

Training: Epoch 2 of 10 Step 657 ntokens 23266768 Example 58800 of 138376 loss = 3.4982 nll loss = 2.1247 accu = 0.3726

Training: Epoch 2 of 10 Step 658 ntokens 23302168 Example 59100 of 138376 loss = 3.4984 nll loss = 2.1245 accu = 0.3727

Training: Epoch 2 of 10 Step 659 ntokens 23337568 Example 59400 of 138376 loss = 3.4984 nll loss = 2.1247 accu = 0.3726

Training: Epoch 2 of 10 Step 660 ntokens 23372968 Example 59700 of 138376 loss = 3.4985 nll loss = 2.1247 accu = 0.3726

Training: Epoch 2 of 10 Step 661 ntokens 23408368 Example 60000 of 138376 loss = 3.4986 nll loss = 2.1249 accu = 0.3725

Training: Epoch 2 of 10 Step 662 ntokens 23443768 Example 60300 of 138376 loss = 3.4979 nll loss = 2.1249 accu = 0.3725

Training: Epoch 2 of 10 Step 663 ntokens 23479168 Example 60600 of 138376 loss = 3.4974 nll loss = 2.1248 accu = 0.3725

Training: Epoch 2 of 10 Step 664 ntokens 23514568 Example 60900 of 138376 loss = 3.4979 nll loss = 2.1251 accu = 0.3725

Training: Epoch 2 of 10 Step 665 ntokens 23549968 Example 61200 of 138376 loss = 3.4980 nll loss = 2.1252 accu = 0.3724

Training: Epoch 2 of 10 Step 666 ntokens 23585368 Example 61500 of 138376 loss = 3.4981 nll loss = 2.1251 accu = 0.3724

Training: Epoch 2 of 10 Step 667 ntokens 23620768 Example 61800 of 138376 loss = 3.4980 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 668 ntokens 23656168 Example 62100 of 138376 loss = 3.4980 nll loss = 2.1258 accu = 0.3722

Training: Epoch 2 of 10 Step 669 ntokens 23691568 Example 62400 of 138376 loss = 3.4974 nll loss = 2.1254 accu = 0.3723

Training: Epoch 2 of 10 Step 670 ntokens 23726968 Example 62700 of 138376 loss = 3.4980 nll loss = 2.1253 accu = 0.3723

Training: Epoch 2 of 10 Step 671 ntokens 23762368 Example 63000 of 138376 loss = 3.4989 nll loss = 2.1256 accu = 0.3722

Training: Epoch 2 of 10 Step 672 ntokens 23797768 Example 63300 of 138376 loss = 3.4987 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 673 ntokens 23833168 Example 63600 of 138376 loss = 3.4989 nll loss = 2.1260 accu = 0.3721

Training: Epoch 2 of 10 Step 674 ntokens 23868568 Example 63900 of 138376 loss = 3.4985 nll loss = 2.1262 accu = 0.3720

Training: Epoch 2 of 10 Step 675 ntokens 23903968 Example 64200 of 138376 loss = 3.4985 nll loss = 2.1260 accu = 0.3721

Training: Epoch 2 of 10 Step 676 ntokens 23939368 Example 64500 of 138376 loss = 3.4984 nll loss = 2.1262 accu = 0.3720

Training: Epoch 2 of 10 Step 677 ntokens 23974768 Example 64800 of 138376 loss = 3.4984 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 678 ntokens 24010168 Example 65100 of 138376 loss = 3.4983 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 679 ntokens 24045568 Example 65400 of 138376 loss = 3.4980 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 680 ntokens 24080968 Example 65700 of 138376 loss = 3.4980 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 681 ntokens 24116368 Example 66000 of 138376 loss = 3.4982 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 682 ntokens 24151768 Example 66300 of 138376 loss = 3.4985 nll loss = 2.1267 accu = 0.3718

Training: Epoch 2 of 10 Step 683 ntokens 24187168 Example 66600 of 138376 loss = 3.4982 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 684 ntokens 24222568 Example 66900 of 138376 loss = 3.4981 nll loss = 2.1268 accu = 0.3718

Training: Epoch 2 of 10 Step 685 ntokens 24257968 Example 67200 of 138376 loss = 3.4979 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 686 ntokens 24293368 Example 67500 of 138376 loss = 3.4978 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 687 ntokens 24328768 Example 67800 of 138376 loss = 3.4979 nll loss = 2.1268 accu = 0.3718

Training: Epoch 2 of 10 Step 688 ntokens 24364168 Example 68100 of 138376 loss = 3.4974 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 689 ntokens 24399568 Example 68400 of 138376 loss = 3.4974 nll loss = 2.1274 accu = 0.3716

Training: Epoch 2 of 10 Step 690 ntokens 24434968 Example 68700 of 138376 loss = 3.4974 nll loss = 2.1275 accu = 0.3715

Training: Epoch 2 of 10 Step 691 ntokens 24470368 Example 69000 of 138376 loss = 3.4970 nll loss = 2.1274 accu = 0.3716

Training: Epoch 2 of 10 Step 692 ntokens 24505768 Example 69300 of 138376 loss = 3.4976 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 693 ntokens 24541168 Example 69600 of 138376 loss = 3.4977 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 694 ntokens 24576568 Example 69900 of 138376 loss = 3.4977 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 695 ntokens 24611968 Example 70200 of 138376 loss = 3.4974 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 696 ntokens 24647368 Example 70500 of 138376 loss = 3.4974 nll loss = 2.1267 accu = 0.3718

Training: Epoch 2 of 10 Step 697 ntokens 24682768 Example 70800 of 138376 loss = 3.4973 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 698 ntokens 24718168 Example 71100 of 138376 loss = 3.4976 nll loss = 2.1270 accu = 0.3717

Training: Epoch 2 of 10 Step 699 ntokens 24753568 Example 71400 of 138376 loss = 3.4975 nll loss = 2.1270 accu = 0.3717

Training: Epoch 2 of 10 Step 700 ntokens 24788968 Example 71700 of 138376 loss = 3.4979 nll loss = 2.1270 accu = 0.3717

Training: Epoch 2 of 10 Step 701 ntokens 24824368 Example 72000 of 138376 loss = 3.4983 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 702 ntokens 24859768 Example 72300 of 138376 loss = 3.4982 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 703 ntokens 24895168 Example 72600 of 138376 loss = 3.4987 nll loss = 2.1264 accu = 0.3719

Training: Epoch 2 of 10 Step 704 ntokens 24930568 Example 72900 of 138376 loss = 3.4990 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 705 ntokens 24965968 Example 73200 of 138376 loss = 3.4993 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 706 ntokens 25001368 Example 73500 of 138376 loss = 3.5001 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 707 ntokens 25036768 Example 73800 of 138376 loss = 3.5004 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 708 ntokens 25072168 Example 74100 of 138376 loss = 3.5006 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 709 ntokens 25107568 Example 74400 of 138376 loss = 3.5005 nll loss = 2.1268 accu = 0.3718

Training: Epoch 2 of 10 Step 710 ntokens 25142968 Example 74700 of 138376 loss = 3.5003 nll loss = 2.1271 accu = 0.3718

Training: Epoch 2 of 10 Step 711 ntokens 25178368 Example 75000 of 138376 loss = 3.5005 nll loss = 2.1274 accu = 0.3717

Training: Epoch 2 of 10 Step 712 ntokens 25213768 Example 75300 of 138376 loss = 3.5005 nll loss = 2.1274 accu = 0.3717

Training: Epoch 2 of 10 Step 713 ntokens 25249168 Example 75600 of 138376 loss = 3.5010 nll loss = 2.1271 accu = 0.3718

Training: Epoch 2 of 10 Step 714 ntokens 25284568 Example 75900 of 138376 loss = 3.5011 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 715 ntokens 25319968 Example 76200 of 138376 loss = 3.5015 nll loss = 2.1271 accu = 0.3718

Training: Epoch 2 of 10 Step 716 ntokens 25355368 Example 76500 of 138376 loss = 3.5018 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 717 ntokens 25390768 Example 76800 of 138376 loss = 3.5017 nll loss = 2.1270 accu = 0.3718

Training: Epoch 2 of 10 Step 718 ntokens 25426168 Example 77100 of 138376 loss = 3.5013 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 719 ntokens 25461568 Example 77400 of 138376 loss = 3.5010 nll loss = 2.1268 accu = 0.3719

Training: Epoch 2 of 10 Step 720 ntokens 25496968 Example 77700 of 138376 loss = 3.5012 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 721 ntokens 25532368 Example 78000 of 138376 loss = 3.5013 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 722 ntokens 25567768 Example 78300 of 138376 loss = 3.5013 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 723 ntokens 25603168 Example 78600 of 138376 loss = 3.5016 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 724 ntokens 25638568 Example 78900 of 138376 loss = 3.5013 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 725 ntokens 25673968 Example 79200 of 138376 loss = 3.5013 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 726 ntokens 25709368 Example 79500 of 138376 loss = 3.5013 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 727 ntokens 25744768 Example 79800 of 138376 loss = 3.5015 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 728 ntokens 25780168 Example 80100 of 138376 loss = 3.5016 nll loss = 2.1267 accu = 0.3719

Training: Epoch 2 of 10 Step 729 ntokens 25815568 Example 80400 of 138376 loss = 3.5011 nll loss = 2.1267 accu = 0.3719

Training: Epoch 2 of 10 Step 730 ntokens 25850968 Example 80700 of 138376 loss = 3.5015 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 731 ntokens 25886368 Example 81000 of 138376 loss = 3.5017 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 732 ntokens 25921768 Example 81300 of 138376 loss = 3.5017 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 733 ntokens 25957168 Example 81600 of 138376 loss = 3.5018 nll loss = 2.1267 accu = 0.3718

Training: Epoch 2 of 10 Step 734 ntokens 25992568 Example 81900 of 138376 loss = 3.5016 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 735 ntokens 26027968 Example 82200 of 138376 loss = 3.5014 nll loss = 2.1267 accu = 0.3719

Training: Epoch 2 of 10 Step 736 ntokens 26063368 Example 82500 of 138376 loss = 3.5012 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 737 ntokens 26098768 Example 82800 of 138376 loss = 3.5014 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 738 ntokens 26134168 Example 83100 of 138376 loss = 3.5013 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 739 ntokens 26169568 Example 83400 of 138376 loss = 3.5013 nll loss = 2.1265 accu = 0.3719

Training: Epoch 2 of 10 Step 740 ntokens 26204968 Example 83700 of 138376 loss = 3.5017 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 741 ntokens 26240368 Example 84000 of 138376 loss = 3.5011 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 742 ntokens 26275768 Example 84300 of 138376 loss = 3.5011 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 743 ntokens 26311168 Example 84600 of 138376 loss = 3.5012 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 744 ntokens 26346568 Example 84900 of 138376 loss = 3.5011 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 745 ntokens 26381968 Example 85200 of 138376 loss = 3.5015 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 746 ntokens 26417368 Example 85500 of 138376 loss = 3.5014 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 747 ntokens 26452768 Example 85800 of 138376 loss = 3.5016 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 748 ntokens 26488168 Example 86100 of 138376 loss = 3.5014 nll loss = 2.1268 accu = 0.3719

Training: Epoch 2 of 10 Step 749 ntokens 26523568 Example 86400 of 138376 loss = 3.5013 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 750 ntokens 26558968 Example 86700 of 138376 loss = 3.5014 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 751 ntokens 26594368 Example 87000 of 138376 loss = 3.5017 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 752 ntokens 26629768 Example 87300 of 138376 loss = 3.5019 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 753 ntokens 26665168 Example 87600 of 138376 loss = 3.5019 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 754 ntokens 26700568 Example 87900 of 138376 loss = 3.5014 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 755 ntokens 26735968 Example 88200 of 138376 loss = 3.5014 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 756 ntokens 26771368 Example 88500 of 138376 loss = 3.5010 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 757 ntokens 26806768 Example 88800 of 138376 loss = 3.5009 nll loss = 2.1266 accu = 0.3720

Training: Epoch 2 of 10 Step 758 ntokens 26842168 Example 89100 of 138376 loss = 3.5007 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 759 ntokens 26877568 Example 89400 of 138376 loss = 3.5006 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 760 ntokens 26912968 Example 89700 of 138376 loss = 3.5003 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 761 ntokens 26948368 Example 90000 of 138376 loss = 3.5001 nll loss = 2.1261 accu = 0.3721

Training: Epoch 2 of 10 Step 762 ntokens 26983768 Example 90300 of 138376 loss = 3.5002 nll loss = 2.1260 accu = 0.3721

Training: Epoch 2 of 10 Step 763 ntokens 27019168 Example 90600 of 138376 loss = 3.5001 nll loss = 2.1261 accu = 0.3721

Training: Epoch 2 of 10 Step 764 ntokens 27054568 Example 90900 of 138376 loss = 3.4998 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 765 ntokens 27089968 Example 91200 of 138376 loss = 3.4996 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 766 ntokens 27125368 Example 91500 of 138376 loss = 3.4996 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 767 ntokens 27160768 Example 91800 of 138376 loss = 3.4992 nll loss = 2.1263 accu = 0.3720

Training: Epoch 2 of 10 Step 768 ntokens 27196168 Example 92100 of 138376 loss = 3.4989 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 769 ntokens 27231568 Example 92400 of 138376 loss = 3.4989 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 770 ntokens 27266968 Example 92700 of 138376 loss = 3.4989 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 771 ntokens 27302368 Example 93000 of 138376 loss = 3.4987 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 772 ntokens 27337768 Example 93300 of 138376 loss = 3.4985 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 773 ntokens 27373168 Example 93600 of 138376 loss = 3.4990 nll loss = 2.1268 accu = 0.3718

Training: Epoch 2 of 10 Step 774 ntokens 27408568 Example 93900 of 138376 loss = 3.4989 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 775 ntokens 27443968 Example 94200 of 138376 loss = 3.4992 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 776 ntokens 27479368 Example 94500 of 138376 loss = 3.4993 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 777 ntokens 27514768 Example 94800 of 138376 loss = 3.4995 nll loss = 2.1270 accu = 0.3718

Training: Epoch 2 of 10 Step 778 ntokens 27550168 Example 95100 of 138376 loss = 3.4995 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 779 ntokens 27585568 Example 95400 of 138376 loss = 3.4995 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 780 ntokens 27620968 Example 95700 of 138376 loss = 3.4990 nll loss = 2.1270 accu = 0.3718

Training: Epoch 2 of 10 Step 781 ntokens 27656368 Example 96000 of 138376 loss = 3.4988 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 782 ntokens 27691768 Example 96300 of 138376 loss = 3.4986 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 783 ntokens 27727168 Example 96600 of 138376 loss = 3.4986 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 784 ntokens 27762568 Example 96900 of 138376 loss = 3.4987 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 785 ntokens 27797968 Example 97200 of 138376 loss = 3.4990 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 786 ntokens 27833368 Example 97500 of 138376 loss = 3.4991 nll loss = 2.1273 accu = 0.3717

Training: Epoch 2 of 10 Step 787 ntokens 27868768 Example 97800 of 138376 loss = 3.4993 nll loss = 2.1274 accu = 0.3716

Training: Epoch 2 of 10 Step 788 ntokens 27904168 Example 98100 of 138376 loss = 3.4993 nll loss = 2.1274 accu = 0.3716

Training: Epoch 2 of 10 Step 789 ntokens 27939568 Example 98400 of 138376 loss = 3.4992 nll loss = 2.1275 accu = 0.3716

Training: Epoch 2 of 10 Step 790 ntokens 27974968 Example 98700 of 138376 loss = 3.4994 nll loss = 2.1274 accu = 0.3716

Training: Epoch 2 of 10 Step 791 ntokens 28010368 Example 99000 of 138376 loss = 3.4991 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 792 ntokens 28045768 Example 99300 of 138376 loss = 3.4991 nll loss = 2.1274 accu = 0.3716

Training: Epoch 2 of 10 Step 793 ntokens 28081168 Example 99600 of 138376 loss = 3.4994 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 794 ntokens 28116568 Example 99900 of 138376 loss = 3.4995 nll loss = 2.1272 accu = 0.3717

Training: Epoch 2 of 10 Step 795 ntokens 28151968 Example 100200 of 138376 loss = 3.4996 nll loss = 2.1271 accu = 0.3717

Training: Epoch 2 of 10 Step 796 ntokens 28187368 Example 100500 of 138376 loss = 3.4997 nll loss = 2.1270 accu = 0.3718

Training: Epoch 2 of 10 Step 797 ntokens 28222768 Example 100800 of 138376 loss = 3.5000 nll loss = 2.1271 accu = 0.3718

Training: Epoch 2 of 10 Step 798 ntokens 28258168 Example 101100 of 138376 loss = 3.4998 nll loss = 2.1271 accu = 0.3718

Training: Epoch 2 of 10 Step 799 ntokens 28293568 Example 101400 of 138376 loss = 3.5001 nll loss = 2.1268 accu = 0.3719

Training: Epoch 2 of 10 Step 800 ntokens 28328968 Example 101700 of 138376 loss = 3.4999 nll loss = 2.1269 accu = 0.3718

Training: Epoch 2 of 10 Step 801 ntokens 28364368 Example 102000 of 138376 loss = 3.4998 nll loss = 2.1267 accu = 0.3719

Training: Epoch 2 of 10 Step 802 ntokens 28399768 Example 102300 of 138376 loss = 3.4999 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 803 ntokens 28435168 Example 102600 of 138376 loss = 3.4997 nll loss = 2.1266 accu = 0.3719

Training: Epoch 2 of 10 Step 804 ntokens 28470568 Example 102900 of 138376 loss = 3.5000 nll loss = 2.1268 accu = 0.3719

Training: Epoch 2 of 10 Step 805 ntokens 28505968 Example 103200 of 138376 loss = 3.4996 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 806 ntokens 28541368 Example 103500 of 138376 loss = 3.4996 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 807 ntokens 28576768 Example 103800 of 138376 loss = 3.4997 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 808 ntokens 28612168 Example 104100 of 138376 loss = 3.5000 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 809 ntokens 28647568 Example 104400 of 138376 loss = 3.5003 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 810 ntokens 28682968 Example 104700 of 138376 loss = 3.5005 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 811 ntokens 28718368 Example 105000 of 138376 loss = 3.5008 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 812 ntokens 28753768 Example 105300 of 138376 loss = 3.5007 nll loss = 2.1265 accu = 0.3720

Training: Epoch 2 of 10 Step 813 ntokens 28789168 Example 105600 of 138376 loss = 3.5007 nll loss = 2.1264 accu = 0.3720

Training: Epoch 2 of 10 Step 814 ntokens 28824568 Example 105900 of 138376 loss = 3.5005 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 815 ntokens 28859968 Example 106200 of 138376 loss = 3.5005 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 816 ntokens 28895368 Example 106500 of 138376 loss = 3.5007 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 817 ntokens 28930768 Example 106800 of 138376 loss = 3.5009 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 818 ntokens 28966168 Example 107100 of 138376 loss = 3.5010 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 819 ntokens 29001568 Example 107400 of 138376 loss = 3.5009 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 820 ntokens 29036968 Example 107700 of 138376 loss = 3.5008 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 821 ntokens 29072368 Example 108000 of 138376 loss = 3.5010 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 822 ntokens 29107768 Example 108300 of 138376 loss = 3.5010 nll loss = 2.1258 accu = 0.3722

Training: Epoch 2 of 10 Step 823 ntokens 29143168 Example 108600 of 138376 loss = 3.5008 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 824 ntokens 29178568 Example 108900 of 138376 loss = 3.5010 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 825 ntokens 29213968 Example 109200 of 138376 loss = 3.5011 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 826 ntokens 29249368 Example 109500 of 138376 loss = 3.5013 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 827 ntokens 29284768 Example 109800 of 138376 loss = 3.5015 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 828 ntokens 29320168 Example 110100 of 138376 loss = 3.5013 nll loss = 2.1258 accu = 0.3722

Training: Epoch 2 of 10 Step 829 ntokens 29355568 Example 110400 of 138376 loss = 3.5014 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 830 ntokens 29390968 Example 110700 of 138376 loss = 3.5016 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 831 ntokens 29426368 Example 111000 of 138376 loss = 3.5017 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 832 ntokens 29461768 Example 111300 of 138376 loss = 3.5016 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 833 ntokens 29497168 Example 111600 of 138376 loss = 3.5017 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 834 ntokens 29532568 Example 111900 of 138376 loss = 3.5016 nll loss = 2.1258 accu = 0.3722

Training: Epoch 2 of 10 Step 835 ntokens 29567968 Example 112200 of 138376 loss = 3.5016 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 836 ntokens 29603368 Example 112500 of 138376 loss = 3.5018 nll loss = 2.1252 accu = 0.3724

Training: Epoch 2 of 10 Step 837 ntokens 29638768 Example 112800 of 138376 loss = 3.5018 nll loss = 2.1252 accu = 0.3724

Training: Epoch 2 of 10 Step 838 ntokens 29674168 Example 113100 of 138376 loss = 3.5020 nll loss = 2.1253 accu = 0.3724

Training: Epoch 2 of 10 Step 839 ntokens 29709568 Example 113400 of 138376 loss = 3.5019 nll loss = 2.1254 accu = 0.3724

Training: Epoch 2 of 10 Step 840 ntokens 29744968 Example 113700 of 138376 loss = 3.5019 nll loss = 2.1254 accu = 0.3724

Training: Epoch 2 of 10 Step 841 ntokens 29780368 Example 114000 of 138376 loss = 3.5018 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 842 ntokens 29815768 Example 114300 of 138376 loss = 3.5017 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 843 ntokens 29851168 Example 114600 of 138376 loss = 3.5017 nll loss = 2.1254 accu = 0.3724

Training: Epoch 2 of 10 Step 844 ntokens 29886568 Example 114900 of 138376 loss = 3.5017 nll loss = 2.1253 accu = 0.3724

Training: Epoch 2 of 10 Step 845 ntokens 29921968 Example 115200 of 138376 loss = 3.5019 nll loss = 2.1251 accu = 0.3724

Training: Epoch 2 of 10 Step 846 ntokens 29957368 Example 115500 of 138376 loss = 3.5019 nll loss = 2.1252 accu = 0.3724

Training: Epoch 2 of 10 Step 847 ntokens 29992768 Example 115800 of 138376 loss = 3.5020 nll loss = 2.1251 accu = 0.3724

Training: Epoch 2 of 10 Step 848 ntokens 30028168 Example 116100 of 138376 loss = 3.5019 nll loss = 2.1254 accu = 0.3724

Training: Epoch 2 of 10 Step 849 ntokens 30063568 Example 116400 of 138376 loss = 3.5017 nll loss = 2.1253 accu = 0.3724

Training: Epoch 2 of 10 Step 850 ntokens 30098968 Example 116700 of 138376 loss = 3.5019 nll loss = 2.1254 accu = 0.3723

Training: Epoch 2 of 10 Step 851 ntokens 30134368 Example 117000 of 138376 loss = 3.5019 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 852 ntokens 30169768 Example 117300 of 138376 loss = 3.5019 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 853 ntokens 30205168 Example 117600 of 138376 loss = 3.5023 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 854 ntokens 30240568 Example 117900 of 138376 loss = 3.5022 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 855 ntokens 30275968 Example 118200 of 138376 loss = 3.5021 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 856 ntokens 30311368 Example 118500 of 138376 loss = 3.5020 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 857 ntokens 30346768 Example 118800 of 138376 loss = 3.5019 nll loss = 2.1254 accu = 0.3723

Training: Epoch 2 of 10 Step 858 ntokens 30382168 Example 119100 of 138376 loss = 3.5021 nll loss = 2.1253 accu = 0.3724

Training: Epoch 2 of 10 Step 859 ntokens 30417568 Example 119400 of 138376 loss = 3.5025 nll loss = 2.1252 accu = 0.3724

Training: Epoch 2 of 10 Step 860 ntokens 30452968 Example 119700 of 138376 loss = 3.5023 nll loss = 2.1251 accu = 0.3725

Training: Epoch 2 of 10 Step 861 ntokens 30488368 Example 120000 of 138376 loss = 3.5021 nll loss = 2.1250 accu = 0.3725

Training: Epoch 2 of 10 Step 862 ntokens 30523768 Example 120300 of 138376 loss = 3.5021 nll loss = 2.1251 accu = 0.3724

Training: Epoch 2 of 10 Step 863 ntokens 30559168 Example 120600 of 138376 loss = 3.5023 nll loss = 2.1250 accu = 0.3725

Training: Epoch 2 of 10 Step 864 ntokens 30594568 Example 120900 of 138376 loss = 3.5023 nll loss = 2.1251 accu = 0.3724

Training: Epoch 2 of 10 Step 865 ntokens 30629968 Example 121200 of 138376 loss = 3.5025 nll loss = 2.1252 accu = 0.3724

Training: Epoch 2 of 10 Step 866 ntokens 30665368 Example 121500 of 138376 loss = 3.5027 nll loss = 2.1254 accu = 0.3724

Training: Epoch 2 of 10 Step 867 ntokens 30700768 Example 121800 of 138376 loss = 3.5030 nll loss = 2.1254 accu = 0.3724

Training: Epoch 2 of 10 Step 868 ntokens 30736168 Example 122100 of 138376 loss = 3.5031 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 869 ntokens 30771568 Example 122400 of 138376 loss = 3.5033 nll loss = 2.1255 accu = 0.3723

Training: Epoch 2 of 10 Step 870 ntokens 30806968 Example 122700 of 138376 loss = 3.5031 nll loss = 2.1254 accu = 0.3723

Training: Epoch 2 of 10 Step 871 ntokens 30842368 Example 123000 of 138376 loss = 3.5035 nll loss = 2.1254 accu = 0.3723

Training: Epoch 2 of 10 Step 872 ntokens 30877768 Example 123300 of 138376 loss = 3.5034 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 873 ntokens 30913168 Example 123600 of 138376 loss = 3.5035 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 874 ntokens 30948568 Example 123900 of 138376 loss = 3.5038 nll loss = 2.1258 accu = 0.3722

Training: Epoch 2 of 10 Step 875 ntokens 30983968 Example 124200 of 138376 loss = 3.5035 nll loss = 2.1257 accu = 0.3722

Training: Epoch 2 of 10 Step 876 ntokens 31019368 Example 124500 of 138376 loss = 3.5033 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 877 ntokens 31054768 Example 124800 of 138376 loss = 3.5032 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 878 ntokens 31090168 Example 125100 of 138376 loss = 3.5032 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 879 ntokens 31125568 Example 125400 of 138376 loss = 3.5036 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 880 ntokens 31160968 Example 125700 of 138376 loss = 3.5040 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 881 ntokens 31196368 Example 126000 of 138376 loss = 3.5039 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 882 ntokens 31231768 Example 126300 of 138376 loss = 3.5038 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 883 ntokens 31267168 Example 126600 of 138376 loss = 3.5037 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 884 ntokens 31302568 Example 126900 of 138376 loss = 3.5037 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 885 ntokens 31337968 Example 127200 of 138376 loss = 3.5034 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 886 ntokens 31373368 Example 127500 of 138376 loss = 3.5035 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 887 ntokens 31408768 Example 127800 of 138376 loss = 3.5035 nll loss = 2.1258 accu = 0.3723

Training: Epoch 2 of 10 Step 888 ntokens 31444168 Example 128100 of 138376 loss = 3.5034 nll loss = 2.1256 accu = 0.3724

Training: Epoch 2 of 10 Step 889 ntokens 31479568 Example 128400 of 138376 loss = 3.5035 nll loss = 2.1255 accu = 0.3724

Training: Epoch 2 of 10 Step 890 ntokens 31514968 Example 128700 of 138376 loss = 3.5033 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 891 ntokens 31550368 Example 129000 of 138376 loss = 3.5033 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 892 ntokens 31585768 Example 129300 of 138376 loss = 3.5033 nll loss = 2.1255 accu = 0.3724

Training: Epoch 2 of 10 Step 893 ntokens 31621168 Example 129600 of 138376 loss = 3.5032 nll loss = 2.1255 accu = 0.3724

Training: Epoch 2 of 10 Step 894 ntokens 31656568 Example 129900 of 138376 loss = 3.5034 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 895 ntokens 31691968 Example 130200 of 138376 loss = 3.5034 nll loss = 2.1255 accu = 0.3724

Training: Epoch 2 of 10 Step 896 ntokens 31727368 Example 130500 of 138376 loss = 3.5035 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 897 ntokens 31762768 Example 130800 of 138376 loss = 3.5033 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 898 ntokens 31798168 Example 131100 of 138376 loss = 3.5032 nll loss = 2.1256 accu = 0.3723

Training: Epoch 2 of 10 Step 899 ntokens 31833568 Example 131400 of 138376 loss = 3.5032 nll loss = 2.1257 accu = 0.3723

Training: Epoch 2 of 10 Step 900 ntokens 31868968 Example 131700 of 138376 loss = 3.5032 nll loss = 2.1258 accu = 0.3723

Training: Epoch 2 of 10 Step 901 ntokens 31904368 Example 132000 of 138376 loss = 3.5032 nll loss = 2.1258 accu = 0.3723

Training: Epoch 2 of 10 Step 902 ntokens 31939768 Example 132300 of 138376 loss = 3.5031 nll loss = 2.1259 accu = 0.3723

Training: Epoch 2 of 10 Step 903 ntokens 31975168 Example 132600 of 138376 loss = 3.5028 nll loss = 2.1259 accu = 0.3723

Training: Epoch 2 of 10 Step 904 ntokens 32010568 Example 132900 of 138376 loss = 3.5028 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 905 ntokens 32045968 Example 133200 of 138376 loss = 3.5025 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 906 ntokens 32081368 Example 133500 of 138376 loss = 3.5025 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 907 ntokens 32116768 Example 133800 of 138376 loss = 3.5025 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 908 ntokens 32152168 Example 134100 of 138376 loss = 3.5028 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 909 ntokens 32187568 Example 134400 of 138376 loss = 3.5029 nll loss = 2.1264 accu = 0.3721

Training: Epoch 2 of 10 Step 910 ntokens 32222968 Example 134700 of 138376 loss = 3.5029 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 911 ntokens 32258368 Example 135000 of 138376 loss = 3.5029 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 912 ntokens 32293768 Example 135300 of 138376 loss = 3.5028 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 913 ntokens 32329168 Example 135600 of 138376 loss = 3.5029 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 914 ntokens 32364568 Example 135900 of 138376 loss = 3.5029 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 915 ntokens 32399968 Example 136200 of 138376 loss = 3.5029 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 916 ntokens 32435368 Example 136500 of 138376 loss = 3.5029 nll loss = 2.1260 accu = 0.3722

Training: Epoch 2 of 10 Step 917 ntokens 32470768 Example 136800 of 138376 loss = 3.5032 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 918 ntokens 32506168 Example 137100 of 138376 loss = 3.5032 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 919 ntokens 32541568 Example 137400 of 138376 loss = 3.5032 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 920 ntokens 32576968 Example 137700 of 138376 loss = 3.5032 nll loss = 2.1261 accu = 0.3722

Training: Epoch 2 of 10 Step 921 ntokens 32612368 Example 138000 of 138376 loss = 3.5031 nll loss = 2.1259 accu = 0.3722

Training: Epoch 2 of 10 Step 922 ntokens 32647768 Example 138300 of 138376 loss = 3.5033 nll loss = 2.1262 accu = 0.3721

Training: Epoch 2 of 10 Step 923 ntokens 32656736 Example 138376 of 138376 loss = 3.5033 nll loss = 2.1262 accu = 0.3721

Writing to checkpoint at 2024-05-28 16:53:02.376346
Validating: Epoch 2 of 10 Step 0 ntokens 32656736 Example 300 of 34323 loss = 3.6065 nll loss = 2.1799 accu = 0.3567

Validating: Epoch 2 of 10 Step 1 ntokens 32656736 Example 600 of 34323 loss = 3.5071 nll loss = 2.1787 accu = 0.3552

Validating: Epoch 2 of 10 Step 2 ntokens 32656736 Example 900 of 34323 loss = 3.4586 nll loss = 2.1491 accu = 0.3645

Validating: Epoch 2 of 10 Step 3 ntokens 32656736 Example 1200 of 34323 loss = 3.4553 nll loss = 2.1390 accu = 0.3687

Validating: Epoch 2 of 10 Step 4 ntokens 32656736 Example 1500 of 34323 loss = 3.4755 nll loss = 2.1420 accu = 0.3680

Validating: Epoch 2 of 10 Step 5 ntokens 32656736 Example 1800 of 34323 loss = 3.4573 nll loss = 2.1406 accu = 0.3684

Validating: Epoch 2 of 10 Step 6 ntokens 32656736 Example 2100 of 34323 loss = 3.4584 nll loss = 2.1331 accu = 0.3705

Validating: Epoch 2 of 10 Step 7 ntokens 32656736 Example 2400 of 34323 loss = 3.4755 nll loss = 2.1332 accu = 0.3703

Validating: Epoch 2 of 10 Step 8 ntokens 32656736 Example 2700 of 34323 loss = 3.4726 nll loss = 2.1295 accu = 0.3715

Validating: Epoch 2 of 10 Step 9 ntokens 32656736 Example 3000 of 34323 loss = 3.4704 nll loss = 2.1233 accu = 0.3733

Validating: Epoch 2 of 10 Step 10 ntokens 32656736 Example 3300 of 34323 loss = 3.4722 nll loss = 2.1252 accu = 0.3728

Validating: Epoch 2 of 10 Step 11 ntokens 32656736 Example 3600 of 34323 loss = 3.4696 nll loss = 2.1196 accu = 0.3748

Validating: Epoch 2 of 10 Step 12 ntokens 32656736 Example 3900 of 34323 loss = 3.4716 nll loss = 2.1203 accu = 0.3746

Validating: Epoch 2 of 10 Step 13 ntokens 32656736 Example 4200 of 34323 loss = 3.4657 nll loss = 2.1212 accu = 0.3742

Validating: Epoch 2 of 10 Step 14 ntokens 32656736 Example 4500 of 34323 loss = 3.4615 nll loss = 2.1161 accu = 0.3760

Validating: Epoch 2 of 10 Step 15 ntokens 32656736 Example 4800 of 34323 loss = 3.4676 nll loss = 2.1211 accu = 0.3741

Validating: Epoch 2 of 10 Step 16 ntokens 32656736 Example 5100 of 34323 loss = 3.4647 nll loss = 2.1212 accu = 0.3740

Validating: Epoch 2 of 10 Step 17 ntokens 32656736 Example 5400 of 34323 loss = 3.4608 nll loss = 2.1181 accu = 0.3752

Validating: Epoch 2 of 10 Step 18 ntokens 32656736 Example 5700 of 34323 loss = 3.4584 nll loss = 2.1193 accu = 0.3747

Validating: Epoch 2 of 10 Step 19 ntokens 32656736 Example 6000 of 34323 loss = 3.4565 nll loss = 2.1204 accu = 0.3744

Validating: Epoch 2 of 10 Step 20 ntokens 32656736 Example 6300 of 34323 loss = 3.4587 nll loss = 2.1177 accu = 0.3753

Validating: Epoch 2 of 10 Step 21 ntokens 32656736 Example 6600 of 34323 loss = 3.4630 nll loss = 2.1177 accu = 0.3753

Validating: Epoch 2 of 10 Step 22 ntokens 32656736 Example 6900 of 34323 loss = 3.4610 nll loss = 2.1186 accu = 0.3751

Validating: Epoch 2 of 10 Step 23 ntokens 32656736 Example 7200 of 34323 loss = 3.4625 nll loss = 2.1203 accu = 0.3745

Validating: Epoch 2 of 10 Step 24 ntokens 32656736 Example 7500 of 34323 loss = 3.4633 nll loss = 2.1195 accu = 0.3748

Validating: Epoch 2 of 10 Step 25 ntokens 32656736 Example 7800 of 34323 loss = 3.4656 nll loss = 2.1205 accu = 0.3744

Validating: Epoch 2 of 10 Step 26 ntokens 32656736 Example 8100 of 34323 loss = 3.4634 nll loss = 2.1187 accu = 0.3749

Validating: Epoch 2 of 10 Step 27 ntokens 32656736 Example 8400 of 34323 loss = 3.4645 nll loss = 2.1194 accu = 0.3746

Validating: Epoch 2 of 10 Step 28 ntokens 32656736 Example 8700 of 34323 loss = 3.4688 nll loss = 2.1199 accu = 0.3744

Validating: Epoch 2 of 10 Step 29 ntokens 32656736 Example 9000 of 34323 loss = 3.4695 nll loss = 2.1199 accu = 0.3743

Validating: Epoch 2 of 10 Step 30 ntokens 32656736 Example 9300 of 34323 loss = 3.4704 nll loss = 2.1192 accu = 0.3745

Validating: Epoch 2 of 10 Step 31 ntokens 32656736 Example 9600 of 34323 loss = 3.4742 nll loss = 2.1221 accu = 0.3734

Validating: Epoch 2 of 10 Step 32 ntokens 32656736 Example 9900 of 34323 loss = 3.4750 nll loss = 2.1201 accu = 0.3740

Validating: Epoch 2 of 10 Step 33 ntokens 32656736 Example 10200 of 34323 loss = 3.4785 nll loss = 2.1199 accu = 0.3739

Validating: Epoch 2 of 10 Step 34 ntokens 32656736 Example 10500 of 34323 loss = 3.4795 nll loss = 2.1187 accu = 0.3743

Validating: Epoch 2 of 10 Step 35 ntokens 32656736 Example 10800 of 34323 loss = 3.4799 nll loss = 2.1222 accu = 0.3731

Validating: Epoch 2 of 10 Step 36 ntokens 32656736 Example 11100 of 34323 loss = 3.4802 nll loss = 2.1231 accu = 0.3728

Validating: Epoch 2 of 10 Step 37 ntokens 32656736 Example 11400 of 34323 loss = 3.4800 nll loss = 2.1241 accu = 0.3724

Validating: Epoch 2 of 10 Step 38 ntokens 32656736 Example 11700 of 34323 loss = 3.4793 nll loss = 2.1233 accu = 0.3728

Validating: Epoch 2 of 10 Step 39 ntokens 32656736 Example 12000 of 34323 loss = 3.4814 nll loss = 2.1230 accu = 0.3728

Validating: Epoch 2 of 10 Step 40 ntokens 32656736 Example 12300 of 34323 loss = 3.4788 nll loss = 2.1224 accu = 0.3730

Validating: Epoch 2 of 10 Step 41 ntokens 32656736 Example 12600 of 34323 loss = 3.4767 nll loss = 2.1211 accu = 0.3735

Validating: Epoch 2 of 10 Step 42 ntokens 32656736 Example 12900 of 34323 loss = 3.4760 nll loss = 2.1230 accu = 0.3730

Validating: Epoch 2 of 10 Step 43 ntokens 32656736 Example 13200 of 34323 loss = 3.4765 nll loss = 2.1227 accu = 0.3731

Validating: Epoch 2 of 10 Step 44 ntokens 32656736 Example 13500 of 34323 loss = 3.4783 nll loss = 2.1215 accu = 0.3735

Validating: Epoch 2 of 10 Step 45 ntokens 32656736 Example 13800 of 34323 loss = 3.4786 nll loss = 2.1211 accu = 0.3736

Validating: Epoch 2 of 10 Step 46 ntokens 32656736 Example 14100 of 34323 loss = 3.4783 nll loss = 2.1225 accu = 0.3732

Validating: Epoch 2 of 10 Step 47 ntokens 32656736 Example 14400 of 34323 loss = 3.4778 nll loss = 2.1221 accu = 0.3734

Validating: Epoch 2 of 10 Step 48 ntokens 32656736 Example 14700 of 34323 loss = 3.4764 nll loss = 2.1212 accu = 0.3738

Validating: Epoch 2 of 10 Step 49 ntokens 32656736 Example 15000 of 34323 loss = 3.4789 nll loss = 2.1201 accu = 0.3741

Validating: Epoch 2 of 10 Step 50 ntokens 32656736 Example 15300 of 34323 loss = 3.4786 nll loss = 2.1197 accu = 0.3743

Validating: Epoch 2 of 10 Step 51 ntokens 32656736 Example 15600 of 34323 loss = 3.4792 nll loss = 2.1199 accu = 0.3742

Validating: Epoch 2 of 10 Step 52 ntokens 32656736 Example 15900 of 34323 loss = 3.4808 nll loss = 2.1197 accu = 0.3742

Validating: Epoch 2 of 10 Step 53 ntokens 32656736 Example 16200 of 34323 loss = 3.4817 nll loss = 2.1188 accu = 0.3745

Validating: Epoch 2 of 10 Step 54 ntokens 32656736 Example 16500 of 34323 loss = 3.4814 nll loss = 2.1181 accu = 0.3747

Validating: Epoch 2 of 10 Step 55 ntokens 32656736 Example 16800 of 34323 loss = 3.4805 nll loss = 2.1184 accu = 0.3747

Validating: Epoch 2 of 10 Step 56 ntokens 32656736 Example 17100 of 34323 loss = 3.4793 nll loss = 2.1197 accu = 0.3743

Validating: Epoch 2 of 10 Step 57 ntokens 32656736 Example 17400 of 34323 loss = 3.4794 nll loss = 2.1199 accu = 0.3742

Validating: Epoch 2 of 10 Step 58 ntokens 32656736 Example 17700 of 34323 loss = 3.4811 nll loss = 2.1206 accu = 0.3740

Validating: Epoch 2 of 10 Step 59 ntokens 32656736 Example 18000 of 34323 loss = 3.4801 nll loss = 2.1223 accu = 0.3734

Validating: Epoch 2 of 10 Step 60 ntokens 32656736 Example 18300 of 34323 loss = 3.4789 nll loss = 2.1235 accu = 0.3729

Validating: Epoch 2 of 10 Step 61 ntokens 32656736 Example 18600 of 34323 loss = 3.4801 nll loss = 2.1234 accu = 0.3729

Validating: Epoch 2 of 10 Step 62 ntokens 32656736 Example 18900 of 34323 loss = 3.4821 nll loss = 2.1234 accu = 0.3729

Validating: Epoch 2 of 10 Step 63 ntokens 32656736 Example 19200 of 34323 loss = 3.4832 nll loss = 2.1225 accu = 0.3732

Validating: Epoch 2 of 10 Step 64 ntokens 32656736 Example 19500 of 34323 loss = 3.4837 nll loss = 2.1221 accu = 0.3734

Validating: Epoch 2 of 10 Step 65 ntokens 32656736 Example 19800 of 34323 loss = 3.4841 nll loss = 2.1215 accu = 0.3736

Validating: Epoch 2 of 10 Step 66 ntokens 32656736 Example 20100 of 34323 loss = 3.4839 nll loss = 2.1215 accu = 0.3736

Validating: Epoch 2 of 10 Step 67 ntokens 32656736 Example 20400 of 34323 loss = 3.4852 nll loss = 2.1218 accu = 0.3735

Validating: Epoch 2 of 10 Step 68 ntokens 32656736 Example 20700 of 34323 loss = 3.4865 nll loss = 2.1219 accu = 0.3735

Validating: Epoch 2 of 10 Step 69 ntokens 32656736 Example 21000 of 34323 loss = 3.4864 nll loss = 2.1221 accu = 0.3734

Validating: Epoch 2 of 10 Step 70 ntokens 32656736 Example 21300 of 34323 loss = 3.4862 nll loss = 2.1225 accu = 0.3733

Validating: Epoch 2 of 10 Step 71 ntokens 32656736 Example 21600 of 34323 loss = 3.4868 nll loss = 2.1222 accu = 0.3734

Validating: Epoch 2 of 10 Step 72 ntokens 32656736 Example 21900 of 34323 loss = 3.4874 nll loss = 2.1233 accu = 0.3729

Validating: Epoch 2 of 10 Step 73 ntokens 32656736 Example 22200 of 34323 loss = 3.4871 nll loss = 2.1240 accu = 0.3727

Validating: Epoch 2 of 10 Step 74 ntokens 32656736 Example 22500 of 34323 loss = 3.4886 nll loss = 2.1244 accu = 0.3726

Validating: Epoch 2 of 10 Step 75 ntokens 32656736 Example 22800 of 34323 loss = 3.4880 nll loss = 2.1251 accu = 0.3724

Validating: Epoch 2 of 10 Step 76 ntokens 32656736 Example 23100 of 34323 loss = 3.4878 nll loss = 2.1241 accu = 0.3728

Validating: Epoch 2 of 10 Step 77 ntokens 32656736 Example 23400 of 34323 loss = 3.4870 nll loss = 2.1233 accu = 0.3730

Validating: Epoch 2 of 10 Step 78 ntokens 32656736 Example 23700 of 34323 loss = 3.4866 nll loss = 2.1245 accu = 0.3727

Validating: Epoch 2 of 10 Step 79 ntokens 32656736 Example 24000 of 34323 loss = 3.4870 nll loss = 2.1253 accu = 0.3724

Validating: Epoch 2 of 10 Step 80 ntokens 32656736 Example 24300 of 34323 loss = 3.4867 nll loss = 2.1257 accu = 0.3724

Validating: Epoch 2 of 10 Step 81 ntokens 32656736 Example 24600 of 34323 loss = 3.4865 nll loss = 2.1261 accu = 0.3722

Validating: Epoch 2 of 10 Step 82 ntokens 32656736 Example 24900 of 34323 loss = 3.4858 nll loss = 2.1260 accu = 0.3722

Validating: Epoch 2 of 10 Step 83 ntokens 32656736 Example 25200 of 34323 loss = 3.4859 nll loss = 2.1266 accu = 0.3720

Validating: Epoch 2 of 10 Step 84 ntokens 32656736 Example 25500 of 34323 loss = 3.4863 nll loss = 2.1272 accu = 0.3718

Validating: Epoch 2 of 10 Step 85 ntokens 32656736 Example 25800 of 34323 loss = 3.4867 nll loss = 2.1265 accu = 0.3720

Validating: Epoch 2 of 10 Step 86 ntokens 32656736 Example 26100 of 34323 loss = 3.4867 nll loss = 2.1257 accu = 0.3723

Validating: Epoch 2 of 10 Step 87 ntokens 32656736 Example 26400 of 34323 loss = 3.4857 nll loss = 2.1260 accu = 0.3722

Validating: Epoch 2 of 10 Step 88 ntokens 32656736 Example 26700 of 34323 loss = 3.4862 nll loss = 2.1264 accu = 0.3720

Validating: Epoch 2 of 10 Step 89 ntokens 32656736 Example 27000 of 34323 loss = 3.4863 nll loss = 2.1269 accu = 0.3719

Validating: Epoch 2 of 10 Step 90 ntokens 32656736 Example 27300 of 34323 loss = 3.4871 nll loss = 2.1258 accu = 0.3723

Validating: Epoch 2 of 10 Step 91 ntokens 32656736 Example 27600 of 34323 loss = 3.4872 nll loss = 2.1266 accu = 0.3720

Validating: Epoch 2 of 10 Step 92 ntokens 32656736 Example 27900 of 34323 loss = 3.4870 nll loss = 2.1264 accu = 0.3720

Validating: Epoch 2 of 10 Step 93 ntokens 32656736 Example 28200 of 34323 loss = 3.4875 nll loss = 2.1259 accu = 0.3722

Validating: Epoch 2 of 10 Step 94 ntokens 32656736 Example 28500 of 34323 loss = 3.4871 nll loss = 2.1262 accu = 0.3720

Validating: Epoch 2 of 10 Step 95 ntokens 32656736 Example 28800 of 34323 loss = 3.4888 nll loss = 2.1262 accu = 0.3720

Validating: Epoch 2 of 10 Step 96 ntokens 32656736 Example 29100 of 34323 loss = 3.4888 nll loss = 2.1264 accu = 0.3719

Validating: Epoch 2 of 10 Step 97 ntokens 32656736 Example 29400 of 34323 loss = 3.4887 nll loss = 2.1268 accu = 0.3718

Validating: Epoch 2 of 10 Step 98 ntokens 32656736 Example 29700 of 34323 loss = 3.4880 nll loss = 2.1263 accu = 0.3719

Validating: Epoch 2 of 10 Step 99 ntokens 32656736 Example 30000 of 34323 loss = 3.4880 nll loss = 2.1263 accu = 0.3720

Validating: Epoch 2 of 10 Step 100 ntokens 32656736 Example 30300 of 34323 loss = 3.4882 nll loss = 2.1261 accu = 0.3720

Validating: Epoch 2 of 10 Step 101 ntokens 32656736 Example 30600 of 34323 loss = 3.4880 nll loss = 2.1266 accu = 0.3718

Validating: Epoch 2 of 10 Step 102 ntokens 32656736 Example 30900 of 34323 loss = 3.4882 nll loss = 2.1274 accu = 0.3715

Validating: Epoch 2 of 10 Step 103 ntokens 32656736 Example 31200 of 34323 loss = 3.4880 nll loss = 2.1267 accu = 0.3718

Validating: Epoch 2 of 10 Step 104 ntokens 32656736 Example 31500 of 34323 loss = 3.4882 nll loss = 2.1267 accu = 0.3718

Validating: Epoch 2 of 10 Step 105 ntokens 32656736 Example 31800 of 34323 loss = 3.4887 nll loss = 2.1266 accu = 0.3718

Validating: Epoch 2 of 10 Step 106 ntokens 32656736 Example 32100 of 34323 loss = 3.4881 nll loss = 2.1269 accu = 0.3717

Validating: Epoch 2 of 10 Step 107 ntokens 32656736 Example 32400 of 34323 loss = 3.4878 nll loss = 2.1265 accu = 0.3718

Validating: Epoch 2 of 10 Step 108 ntokens 32656736 Example 32700 of 34323 loss = 3.4885 nll loss = 2.1268 accu = 0.3717

Validating: Epoch 2 of 10 Step 109 ntokens 32656736 Example 33000 of 34323 loss = 3.4890 nll loss = 2.1268 accu = 0.3717

Validating: Epoch 2 of 10 Step 110 ntokens 32656736 Example 33300 of 34323 loss = 3.4899 nll loss = 2.1265 accu = 0.3718

Validating: Epoch 2 of 10 Step 111 ntokens 32656736 Example 33600 of 34323 loss = 3.4910 nll loss = 2.1267 accu = 0.3717

Validating: Epoch 2 of 10 Step 112 ntokens 32656736 Example 33900 of 34323 loss = 3.4926 nll loss = 2.1271 accu = 0.3716

Validating: Epoch 2 of 10 Step 113 ntokens 32656736 Example 34200 of 34323 loss = 3.4918 nll loss = 2.1271 accu = 0.3716

Validating: Epoch 2 of 10 Step 114 ntokens 32656736 Example 34323 of 34323 loss = 3.4916 nll loss = 2.1273 accu = 0.3716

Validation complete in 0:00:15.053926
Epoch complete in 0:02:30.234753
Training: Epoch 3 of 10 Step 923 ntokens 49020504 Example 300 of 138376 loss = 3.5801 nll loss = 2.1972 accu = 0.3465

Training: Epoch 3 of 10 Step 924 ntokens 49055904 Example 600 of 138376 loss = 3.5437 nll loss = 2.1443 accu = 0.3669

Training: Epoch 3 of 10 Step 925 ntokens 49091304 Example 900 of 138376 loss = 3.5245 nll loss = 2.1455 accu = 0.3654

Training: Epoch 3 of 10 Step 926 ntokens 49126704 Example 1200 of 138376 loss = 3.5334 nll loss = 2.1523 accu = 0.3637

Training: Epoch 3 of 10 Step 927 ntokens 49162104 Example 1500 of 138376 loss = 3.5513 nll loss = 2.1546 accu = 0.3629

Training: Epoch 3 of 10 Step 928 ntokens 49197504 Example 1800 of 138376 loss = 3.5337 nll loss = 2.1447 accu = 0.3663

Training: Epoch 3 of 10 Step 929 ntokens 49232904 Example 2100 of 138376 loss = 3.5360 nll loss = 2.1399 accu = 0.3678

Training: Epoch 3 of 10 Step 930 ntokens 49268304 Example 2400 of 138376 loss = 3.5316 nll loss = 2.1383 accu = 0.3683

Training: Epoch 3 of 10 Step 931 ntokens 49303704 Example 2700 of 138376 loss = 3.5426 nll loss = 2.1359 accu = 0.3688

Training: Epoch 3 of 10 Step 932 ntokens 49339104 Example 3000 of 138376 loss = 3.5293 nll loss = 2.1333 accu = 0.3694

Training: Epoch 3 of 10 Step 933 ntokens 49374504 Example 3300 of 138376 loss = 3.5253 nll loss = 2.1351 accu = 0.3686

Training: Epoch 3 of 10 Step 934 ntokens 49409904 Example 3600 of 138376 loss = 3.5285 nll loss = 2.1370 accu = 0.3681

Training: Epoch 3 of 10 Step 935 ntokens 49445304 Example 3900 of 138376 loss = 3.5293 nll loss = 2.1348 accu = 0.3688

Training: Epoch 3 of 10 Step 936 ntokens 49480704 Example 4200 of 138376 loss = 3.5323 nll loss = 2.1260 accu = 0.3721

Training: Epoch 3 of 10 Step 937 ntokens 49516104 Example 4500 of 138376 loss = 3.5259 nll loss = 2.1221 accu = 0.3736

Training: Epoch 3 of 10 Step 938 ntokens 49551504 Example 4800 of 138376 loss = 3.5235 nll loss = 2.1215 accu = 0.3739

Training: Epoch 3 of 10 Step 939 ntokens 49586904 Example 5100 of 138376 loss = 3.5212 nll loss = 2.1170 accu = 0.3754

Training: Epoch 3 of 10 Step 940 ntokens 49622304 Example 5400 of 138376 loss = 3.5240 nll loss = 2.1169 accu = 0.3756

Training: Epoch 3 of 10 Step 941 ntokens 49657704 Example 5700 of 138376 loss = 3.5190 nll loss = 2.1180 accu = 0.3752

Training: Epoch 3 of 10 Step 942 ntokens 49693104 Example 6000 of 138376 loss = 3.5197 nll loss = 2.1203 accu = 0.3743

Training: Epoch 3 of 10 Step 943 ntokens 49728504 Example 6300 of 138376 loss = 3.5191 nll loss = 2.1201 accu = 0.3745

Training: Epoch 3 of 10 Step 944 ntokens 49763904 Example 6600 of 138376 loss = 3.5162 nll loss = 2.1248 accu = 0.3729

Training: Epoch 3 of 10 Step 945 ntokens 49799304 Example 6900 of 138376 loss = 3.5205 nll loss = 2.1244 accu = 0.3731

Training: Epoch 3 of 10 Step 946 ntokens 49834704 Example 7200 of 138376 loss = 3.5228 nll loss = 2.1250 accu = 0.3729

Training: Epoch 3 of 10 Step 947 ntokens 49870104 Example 7500 of 138376 loss = 3.5220 nll loss = 2.1250 accu = 0.3729

Training: Epoch 3 of 10 Step 948 ntokens 49905504 Example 7800 of 138376 loss = 3.5212 nll loss = 2.1239 accu = 0.3733

Training: Epoch 3 of 10 Step 949 ntokens 49940904 Example 8100 of 138376 loss = 3.5216 nll loss = 2.1243 accu = 0.3732

Training: Epoch 3 of 10 Step 950 ntokens 49976304 Example 8400 of 138376 loss = 3.5191 nll loss = 2.1234 accu = 0.3735

Training: Epoch 3 of 10 Step 951 ntokens 50011704 Example 8700 of 138376 loss = 3.5173 nll loss = 2.1226 accu = 0.3737

Training: Epoch 3 of 10 Step 952 ntokens 50047104 Example 9000 of 138376 loss = 3.5182 nll loss = 2.1223 accu = 0.3738

Training: Epoch 3 of 10 Step 953 ntokens 50082504 Example 9300 of 138376 loss = 3.5164 nll loss = 2.1230 accu = 0.3736

Training: Epoch 3 of 10 Step 954 ntokens 50117904 Example 9600 of 138376 loss = 3.5140 nll loss = 2.1225 accu = 0.3738

Training: Epoch 3 of 10 Step 955 ntokens 50153304 Example 9900 of 138376 loss = 3.5136 nll loss = 2.1228 accu = 0.3738

Training: Epoch 3 of 10 Step 956 ntokens 50188704 Example 10200 of 138376 loss = 3.5096 nll loss = 2.1226 accu = 0.3739

Training: Epoch 3 of 10 Step 957 ntokens 50224104 Example 10500 of 138376 loss = 3.5069 nll loss = 2.1252 accu = 0.3731

Training: Epoch 3 of 10 Step 958 ntokens 50259504 Example 10800 of 138376 loss = 3.5077 nll loss = 2.1263 accu = 0.3726

Training: Epoch 3 of 10 Step 959 ntokens 50294904 Example 11100 of 138376 loss = 3.5110 nll loss = 2.1265 accu = 0.3725

Training: Epoch 3 of 10 Step 960 ntokens 50330304 Example 11400 of 138376 loss = 3.5106 nll loss = 2.1260 accu = 0.3727

Training: Epoch 3 of 10 Step 961 ntokens 50365704 Example 11700 of 138376 loss = 3.5108 nll loss = 2.1264 accu = 0.3726

Training: Epoch 3 of 10 Step 962 ntokens 50401104 Example 12000 of 138376 loss = 3.5082 nll loss = 2.1270 accu = 0.3722

Training: Epoch 3 of 10 Step 963 ntokens 50436504 Example 12300 of 138376 loss = 3.5076 nll loss = 2.1251 accu = 0.3729

Training: Epoch 3 of 10 Step 964 ntokens 50471904 Example 12600 of 138376 loss = 3.5096 nll loss = 2.1233 accu = 0.3735

Training: Epoch 3 of 10 Step 965 ntokens 50507304 Example 12900 of 138376 loss = 3.5110 nll loss = 2.1255 accu = 0.3727

Training: Epoch 3 of 10 Step 966 ntokens 50542704 Example 13200 of 138376 loss = 3.5095 nll loss = 2.1249 accu = 0.3728

Training: Epoch 3 of 10 Step 967 ntokens 50578104 Example 13500 of 138376 loss = 3.5105 nll loss = 2.1254 accu = 0.3726

Training: Epoch 3 of 10 Step 968 ntokens 50613504 Example 13800 of 138376 loss = 3.5113 nll loss = 2.1253 accu = 0.3726

Training: Epoch 3 of 10 Step 969 ntokens 50648904 Example 14100 of 138376 loss = 3.5119 nll loss = 2.1257 accu = 0.3725

Training: Epoch 3 of 10 Step 970 ntokens 50684304 Example 14400 of 138376 loss = 3.5095 nll loss = 2.1263 accu = 0.3723

Training: Epoch 3 of 10 Step 971 ntokens 50719704 Example 14700 of 138376 loss = 3.5098 nll loss = 2.1247 accu = 0.3728

Training: Epoch 3 of 10 Step 972 ntokens 50755104 Example 15000 of 138376 loss = 3.5071 nll loss = 2.1238 accu = 0.3732

Training: Epoch 3 of 10 Step 973 ntokens 50790504 Example 15300 of 138376 loss = 3.5052 nll loss = 2.1230 accu = 0.3734

Training: Epoch 3 of 10 Step 974 ntokens 50825904 Example 15600 of 138376 loss = 3.5059 nll loss = 2.1244 accu = 0.3729

Training: Epoch 3 of 10 Step 975 ntokens 50861304 Example 15900 of 138376 loss = 3.5054 nll loss = 2.1239 accu = 0.3730

Training: Epoch 3 of 10 Step 976 ntokens 50896704 Example 16200 of 138376 loss = 3.5049 nll loss = 2.1233 accu = 0.3733

Training: Epoch 3 of 10 Step 977 ntokens 50932104 Example 16500 of 138376 loss = 3.5069 nll loss = 2.1243 accu = 0.3729

Training: Epoch 3 of 10 Step 978 ntokens 50967504 Example 16800 of 138376 loss = 3.5058 nll loss = 2.1242 accu = 0.3730

Training: Epoch 3 of 10 Step 979 ntokens 51002904 Example 17100 of 138376 loss = 3.5052 nll loss = 2.1231 accu = 0.3734

Training: Epoch 3 of 10 Step 980 ntokens 51038304 Example 17400 of 138376 loss = 3.5042 nll loss = 2.1229 accu = 0.3735

Training: Epoch 3 of 10 Step 981 ntokens 51073704 Example 17700 of 138376 loss = 3.5030 nll loss = 2.1236 accu = 0.3733

Training: Epoch 3 of 10 Step 982 ntokens 51109104 Example 18000 of 138376 loss = 3.5035 nll loss = 2.1230 accu = 0.3735

Training: Epoch 3 of 10 Step 983 ntokens 51144504 Example 18300 of 138376 loss = 3.5047 nll loss = 2.1229 accu = 0.3736

Training: Epoch 3 of 10 Step 984 ntokens 51179904 Example 18600 of 138376 loss = 3.5038 nll loss = 2.1220 accu = 0.3740

Training: Epoch 3 of 10 Step 985 ntokens 51215304 Example 18900 of 138376 loss = 3.5040 nll loss = 2.1220 accu = 0.3739

Training: Epoch 3 of 10 Step 986 ntokens 51250704 Example 19200 of 138376 loss = 3.5029 nll loss = 2.1230 accu = 0.3735

Training: Epoch 3 of 10 Step 987 ntokens 51286104 Example 19500 of 138376 loss = 3.5026 nll loss = 2.1232 accu = 0.3734

Training: Epoch 3 of 10 Step 988 ntokens 51321504 Example 19800 of 138376 loss = 3.5014 nll loss = 2.1229 accu = 0.3735

Training: Epoch 3 of 10 Step 989 ntokens 51356904 Example 20100 of 138376 loss = 3.5009 nll loss = 2.1235 accu = 0.3733

Training: Epoch 3 of 10 Step 990 ntokens 51392304 Example 20400 of 138376 loss = 3.4991 nll loss = 2.1227 accu = 0.3736

Training: Epoch 3 of 10 Step 991 ntokens 51427704 Example 20700 of 138376 loss = 3.4983 nll loss = 2.1231 accu = 0.3735

Training: Epoch 3 of 10 Step 992 ntokens 51463104 Example 21000 of 138376 loss = 3.4970 nll loss = 2.1244 accu = 0.3730

Training: Epoch 3 of 10 Step 993 ntokens 51498504 Example 21300 of 138376 loss = 3.4973 nll loss = 2.1248 accu = 0.3728

Training: Epoch 3 of 10 Step 994 ntokens 51533904 Example 21600 of 138376 loss = 3.4978 nll loss = 2.1255 accu = 0.3726

Training: Epoch 3 of 10 Step 995 ntokens 51569304 Example 21900 of 138376 loss = 3.4969 nll loss = 2.1253 accu = 0.3727

Training: Epoch 3 of 10 Step 996 ntokens 51604704 Example 22200 of 138376 loss = 3.4965 nll loss = 2.1248 accu = 0.3728

Training: Epoch 3 of 10 Step 997 ntokens 51640104 Example 22500 of 138376 loss = 3.4969 nll loss = 2.1240 accu = 0.3731

Training: Epoch 3 of 10 Step 998 ntokens 51675504 Example 22800 of 138376 loss = 3.4970 nll loss = 2.1239 accu = 0.3731

Training: Epoch 3 of 10 Step 999 ntokens 51710904 Example 23100 of 138376 loss = 3.4977 nll loss = 2.1240 accu = 0.3731

Training: Epoch 3 of 10 Step 1000 ntokens 51746304 Example 23400 of 138376 loss = 3.4987 nll loss = 2.1249 accu = 0.3728

Training: Epoch 3 of 10 Step 1001 ntokens 51781704 Example 23700 of 138376 loss = 3.4987 nll loss = 2.1252 accu = 0.3727

Training: Epoch 3 of 10 Step 1002 ntokens 51817104 Example 24000 of 138376 loss = 3.4989 nll loss = 2.1263 accu = 0.3723

Training: Epoch 3 of 10 Step 1003 ntokens 51852504 Example 24300 of 138376 loss = 3.4986 nll loss = 2.1265 accu = 0.3722

Training: Epoch 3 of 10 Step 1004 ntokens 51887904 Example 24600 of 138376 loss = 3.4998 nll loss = 2.1270 accu = 0.3720

Training: Epoch 3 of 10 Step 1005 ntokens 51923304 Example 24900 of 138376 loss = 3.5001 nll loss = 2.1268 accu = 0.3721

Training: Epoch 3 of 10 Step 1006 ntokens 51958704 Example 25200 of 138376 loss = 3.5003 nll loss = 2.1273 accu = 0.3719

Training: Epoch 3 of 10 Step 1007 ntokens 51994104 Example 25500 of 138376 loss = 3.4999 nll loss = 2.1266 accu = 0.3721

Training: Epoch 3 of 10 Step 1008 ntokens 52029504 Example 25800 of 138376 loss = 3.5001 nll loss = 2.1281 accu = 0.3715

Training: Epoch 3 of 10 Step 1009 ntokens 52064904 Example 26100 of 138376 loss = 3.5000 nll loss = 2.1277 accu = 0.3717

Training: Epoch 3 of 10 Step 1010 ntokens 52100304 Example 26400 of 138376 loss = 3.4990 nll loss = 2.1282 accu = 0.3715

Training: Epoch 3 of 10 Step 1011 ntokens 52135704 Example 26700 of 138376 loss = 3.4992 nll loss = 2.1283 accu = 0.3714

Training: Epoch 3 of 10 Step 1012 ntokens 52171104 Example 27000 of 138376 loss = 3.4990 nll loss = 2.1294 accu = 0.3710

Training: Epoch 3 of 10 Step 1013 ntokens 52206504 Example 27300 of 138376 loss = 3.4995 nll loss = 2.1294 accu = 0.3711

Training: Epoch 3 of 10 Step 1014 ntokens 52241904 Example 27600 of 138376 loss = 3.5000 nll loss = 2.1294 accu = 0.3710

Training: Epoch 3 of 10 Step 1015 ntokens 52277304 Example 27900 of 138376 loss = 3.4998 nll loss = 2.1288 accu = 0.3712

Training: Epoch 3 of 10 Step 1016 ntokens 52312704 Example 28200 of 138376 loss = 3.4986 nll loss = 2.1290 accu = 0.3712

Training: Epoch 3 of 10 Step 1017 ntokens 52348104 Example 28500 of 138376 loss = 3.4975 nll loss = 2.1282 accu = 0.3715

Training: Epoch 3 of 10 Step 1018 ntokens 52383504 Example 28800 of 138376 loss = 3.4969 nll loss = 2.1286 accu = 0.3713

Training: Epoch 3 of 10 Step 1019 ntokens 52418904 Example 29100 of 138376 loss = 3.4971 nll loss = 2.1284 accu = 0.3714

Training: Epoch 3 of 10 Step 1020 ntokens 52454304 Example 29400 of 138376 loss = 3.4979 nll loss = 2.1282 accu = 0.3715

Training: Epoch 3 of 10 Step 1021 ntokens 52489704 Example 29700 of 138376 loss = 3.4977 nll loss = 2.1281 accu = 0.3715

Training: Epoch 3 of 10 Step 1022 ntokens 52525104 Example 30000 of 138376 loss = 3.4977 nll loss = 2.1284 accu = 0.3714

Training: Epoch 3 of 10 Step 1023 ntokens 52560504 Example 30300 of 138376 loss = 3.4980 nll loss = 2.1289 accu = 0.3713

Training: Epoch 3 of 10 Step 1024 ntokens 52595904 Example 30600 of 138376 loss = 3.4984 nll loss = 2.1286 accu = 0.3714

Training: Epoch 3 of 10 Step 1025 ntokens 52631304 Example 30900 of 138376 loss = 3.4982 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1026 ntokens 52666704 Example 31200 of 138376 loss = 3.4986 nll loss = 2.1283 accu = 0.3715

Training: Epoch 3 of 10 Step 1027 ntokens 52702104 Example 31500 of 138376 loss = 3.4987 nll loss = 2.1277 accu = 0.3717

Training: Epoch 3 of 10 Step 1028 ntokens 52737504 Example 31800 of 138376 loss = 3.4985 nll loss = 2.1274 accu = 0.3718

Training: Epoch 3 of 10 Step 1029 ntokens 52772904 Example 32100 of 138376 loss = 3.4986 nll loss = 2.1273 accu = 0.3718

Training: Epoch 3 of 10 Step 1030 ntokens 52808304 Example 32400 of 138376 loss = 3.4980 nll loss = 2.1273 accu = 0.3718

Training: Epoch 3 of 10 Step 1031 ntokens 52843704 Example 32700 of 138376 loss = 3.4967 nll loss = 2.1268 accu = 0.3720

Training: Epoch 3 of 10 Step 1032 ntokens 52879104 Example 33000 of 138376 loss = 3.4961 nll loss = 2.1273 accu = 0.3718

Training: Epoch 3 of 10 Step 1033 ntokens 52914504 Example 33300 of 138376 loss = 3.4952 nll loss = 2.1278 accu = 0.3716

Training: Epoch 3 of 10 Step 1034 ntokens 52949904 Example 33600 of 138376 loss = 3.4955 nll loss = 2.1281 accu = 0.3715

Training: Epoch 3 of 10 Step 1035 ntokens 52985304 Example 33900 of 138376 loss = 3.4952 nll loss = 2.1280 accu = 0.3715

Training: Epoch 3 of 10 Step 1036 ntokens 53020704 Example 34200 of 138376 loss = 3.4948 nll loss = 2.1279 accu = 0.3716

Training: Epoch 3 of 10 Step 1037 ntokens 53056104 Example 34500 of 138376 loss = 3.4946 nll loss = 2.1276 accu = 0.3717

Training: Epoch 3 of 10 Step 1038 ntokens 53091504 Example 34800 of 138376 loss = 3.4949 nll loss = 2.1282 accu = 0.3715

Training: Epoch 3 of 10 Step 1039 ntokens 53126904 Example 35100 of 138376 loss = 3.4947 nll loss = 2.1281 accu = 0.3715

Training: Epoch 3 of 10 Step 1040 ntokens 53162304 Example 35400 of 138376 loss = 3.4943 nll loss = 2.1277 accu = 0.3717

Training: Epoch 3 of 10 Step 1041 ntokens 53197704 Example 35700 of 138376 loss = 3.4951 nll loss = 2.1280 accu = 0.3716

Training: Epoch 3 of 10 Step 1042 ntokens 53233104 Example 36000 of 138376 loss = 3.4949 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1043 ntokens 53268504 Example 36300 of 138376 loss = 3.4946 nll loss = 2.1284 accu = 0.3715

Training: Epoch 3 of 10 Step 1044 ntokens 53303904 Example 36600 of 138376 loss = 3.4942 nll loss = 2.1285 accu = 0.3715

Training: Epoch 3 of 10 Step 1045 ntokens 53339304 Example 36900 of 138376 loss = 3.4945 nll loss = 2.1284 accu = 0.3715

Training: Epoch 3 of 10 Step 1046 ntokens 53374704 Example 37200 of 138376 loss = 3.4948 nll loss = 2.1288 accu = 0.3714

Training: Epoch 3 of 10 Step 1047 ntokens 53410104 Example 37500 of 138376 loss = 3.4953 nll loss = 2.1280 accu = 0.3717

Training: Epoch 3 of 10 Step 1048 ntokens 53445504 Example 37800 of 138376 loss = 3.4940 nll loss = 2.1288 accu = 0.3713

Training: Epoch 3 of 10 Step 1049 ntokens 53480904 Example 38100 of 138376 loss = 3.4947 nll loss = 2.1290 accu = 0.3713

Training: Epoch 3 of 10 Step 1050 ntokens 53516304 Example 38400 of 138376 loss = 3.4948 nll loss = 2.1289 accu = 0.3713

Training: Epoch 3 of 10 Step 1051 ntokens 53551704 Example 38700 of 138376 loss = 3.4955 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1052 ntokens 53587104 Example 39000 of 138376 loss = 3.4954 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1053 ntokens 53622504 Example 39300 of 138376 loss = 3.4952 nll loss = 2.1279 accu = 0.3717

Training: Epoch 3 of 10 Step 1054 ntokens 53657904 Example 39600 of 138376 loss = 3.4961 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1055 ntokens 53693304 Example 39900 of 138376 loss = 3.4972 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1056 ntokens 53728704 Example 40200 of 138376 loss = 3.4967 nll loss = 2.1285 accu = 0.3715

Training: Epoch 3 of 10 Step 1057 ntokens 53764104 Example 40500 of 138376 loss = 3.4960 nll loss = 2.1281 accu = 0.3716

Training: Epoch 3 of 10 Step 1058 ntokens 53799504 Example 40800 of 138376 loss = 3.4957 nll loss = 2.1286 accu = 0.3714

Training: Epoch 3 of 10 Step 1059 ntokens 53834904 Example 41100 of 138376 loss = 3.4951 nll loss = 2.1294 accu = 0.3711

Training: Epoch 3 of 10 Step 1060 ntokens 53870304 Example 41400 of 138376 loss = 3.4958 nll loss = 2.1290 accu = 0.3713

Training: Epoch 3 of 10 Step 1061 ntokens 53905704 Example 41700 of 138376 loss = 3.4960 nll loss = 2.1294 accu = 0.3711

Training: Epoch 3 of 10 Step 1062 ntokens 53941104 Example 42000 of 138376 loss = 3.4956 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1063 ntokens 53976504 Example 42300 of 138376 loss = 3.4953 nll loss = 2.1297 accu = 0.3710

Training: Epoch 3 of 10 Step 1064 ntokens 54011904 Example 42600 of 138376 loss = 3.4947 nll loss = 2.1296 accu = 0.3711

Training: Epoch 3 of 10 Step 1065 ntokens 54047304 Example 42900 of 138376 loss = 3.4946 nll loss = 2.1297 accu = 0.3710

Training: Epoch 3 of 10 Step 1066 ntokens 54082704 Example 43200 of 138376 loss = 3.4952 nll loss = 2.1295 accu = 0.3711

Training: Epoch 3 of 10 Step 1067 ntokens 54118104 Example 43500 of 138376 loss = 3.4950 nll loss = 2.1289 accu = 0.3713

Training: Epoch 3 of 10 Step 1068 ntokens 54153504 Example 43800 of 138376 loss = 3.4946 nll loss = 2.1293 accu = 0.3712

Training: Epoch 3 of 10 Step 1069 ntokens 54188904 Example 44100 of 138376 loss = 3.4945 nll loss = 2.1293 accu = 0.3712

Training: Epoch 3 of 10 Step 1070 ntokens 54224304 Example 44400 of 138376 loss = 3.4943 nll loss = 2.1291 accu = 0.3712

Training: Epoch 3 of 10 Step 1071 ntokens 54259704 Example 44700 of 138376 loss = 3.4952 nll loss = 2.1286 accu = 0.3714

Training: Epoch 3 of 10 Step 1072 ntokens 54295104 Example 45000 of 138376 loss = 3.4950 nll loss = 2.1280 accu = 0.3716

Training: Epoch 3 of 10 Step 1073 ntokens 54330504 Example 45300 of 138376 loss = 3.4947 nll loss = 2.1279 accu = 0.3716

Training: Epoch 3 of 10 Step 1074 ntokens 54365904 Example 45600 of 138376 loss = 3.4944 nll loss = 2.1279 accu = 0.3716

Training: Epoch 3 of 10 Step 1075 ntokens 54401304 Example 45900 of 138376 loss = 3.4945 nll loss = 2.1279 accu = 0.3716

Training: Epoch 3 of 10 Step 1076 ntokens 54436704 Example 46200 of 138376 loss = 3.4942 nll loss = 2.1281 accu = 0.3715

Training: Epoch 3 of 10 Step 1077 ntokens 54472104 Example 46500 of 138376 loss = 3.4938 nll loss = 2.1280 accu = 0.3716

Training: Epoch 3 of 10 Step 1078 ntokens 54507504 Example 46800 of 138376 loss = 3.4931 nll loss = 2.1282 accu = 0.3715

Training: Epoch 3 of 10 Step 1079 ntokens 54542904 Example 47100 of 138376 loss = 3.4932 nll loss = 2.1285 accu = 0.3714

Training: Epoch 3 of 10 Step 1080 ntokens 54578304 Example 47400 of 138376 loss = 3.4934 nll loss = 2.1282 accu = 0.3715

Training: Epoch 3 of 10 Step 1081 ntokens 54613704 Example 47700 of 138376 loss = 3.4934 nll loss = 2.1279 accu = 0.3716

Training: Epoch 3 of 10 Step 1082 ntokens 54649104 Example 48000 of 138376 loss = 3.4934 nll loss = 2.1278 accu = 0.3716

Training: Epoch 3 of 10 Step 1083 ntokens 54684504 Example 48300 of 138376 loss = 3.4936 nll loss = 2.1279 accu = 0.3716

Training: Epoch 3 of 10 Step 1084 ntokens 54719904 Example 48600 of 138376 loss = 3.4932 nll loss = 2.1283 accu = 0.3714

Training: Epoch 3 of 10 Step 1085 ntokens 54755304 Example 48900 of 138376 loss = 3.4929 nll loss = 2.1287 accu = 0.3713

Training: Epoch 3 of 10 Step 1086 ntokens 54790704 Example 49200 of 138376 loss = 3.4933 nll loss = 2.1286 accu = 0.3713

Training: Epoch 3 of 10 Step 1087 ntokens 54826104 Example 49500 of 138376 loss = 3.4934 nll loss = 2.1283 accu = 0.3714

Training: Epoch 3 of 10 Step 1088 ntokens 54861504 Example 49800 of 138376 loss = 3.4938 nll loss = 2.1286 accu = 0.3713

Training: Epoch 3 of 10 Step 1089 ntokens 54896904 Example 50100 of 138376 loss = 3.4935 nll loss = 2.1289 accu = 0.3712

Training: Epoch 3 of 10 Step 1090 ntokens 54932304 Example 50400 of 138376 loss = 3.4936 nll loss = 2.1288 accu = 0.3713

Training: Epoch 3 of 10 Step 1091 ntokens 54967704 Example 50700 of 138376 loss = 3.4933 nll loss = 2.1289 accu = 0.3712

Training: Epoch 3 of 10 Step 1092 ntokens 55003104 Example 51000 of 138376 loss = 3.4929 nll loss = 2.1292 accu = 0.3711

Training: Epoch 3 of 10 Step 1093 ntokens 55038504 Example 51300 of 138376 loss = 3.4931 nll loss = 2.1298 accu = 0.3709

Training: Epoch 3 of 10 Step 1094 ntokens 55073904 Example 51600 of 138376 loss = 3.4939 nll loss = 2.1302 accu = 0.3708

Training: Epoch 3 of 10 Step 1095 ntokens 55109304 Example 51900 of 138376 loss = 3.4942 nll loss = 2.1300 accu = 0.3708

Training: Epoch 3 of 10 Step 1096 ntokens 55144704 Example 52200 of 138376 loss = 3.4940 nll loss = 2.1303 accu = 0.3707

Training: Epoch 3 of 10 Step 1097 ntokens 55180104 Example 52500 of 138376 loss = 3.4944 nll loss = 2.1309 accu = 0.3705

Training: Epoch 3 of 10 Step 1098 ntokens 55215504 Example 52800 of 138376 loss = 3.4945 nll loss = 2.1308 accu = 0.3705

Training: Epoch 3 of 10 Step 1099 ntokens 55250904 Example 53100 of 138376 loss = 3.4942 nll loss = 2.1307 accu = 0.3706

Training: Epoch 3 of 10 Step 1100 ntokens 55286304 Example 53400 of 138376 loss = 3.4943 nll loss = 2.1310 accu = 0.3705

Training: Epoch 3 of 10 Step 1101 ntokens 55321704 Example 53700 of 138376 loss = 3.4944 nll loss = 2.1308 accu = 0.3706

Training: Epoch 3 of 10 Step 1102 ntokens 55357104 Example 54000 of 138376 loss = 3.4945 nll loss = 2.1309 accu = 0.3706

Training: Epoch 3 of 10 Step 1103 ntokens 55392504 Example 54300 of 138376 loss = 3.4947 nll loss = 2.1308 accu = 0.3706

Training: Epoch 3 of 10 Step 1104 ntokens 55427904 Example 54600 of 138376 loss = 3.4949 nll loss = 2.1310 accu = 0.3706

Training: Epoch 3 of 10 Step 1105 ntokens 55463304 Example 54900 of 138376 loss = 3.4950 nll loss = 2.1306 accu = 0.3707

Training: Epoch 3 of 10 Step 1106 ntokens 55498704 Example 55200 of 138376 loss = 3.4951 nll loss = 2.1307 accu = 0.3706

Training: Epoch 3 of 10 Step 1107 ntokens 55534104 Example 55500 of 138376 loss = 3.4949 nll loss = 2.1303 accu = 0.3708

Training: Epoch 3 of 10 Step 1108 ntokens 55569504 Example 55800 of 138376 loss = 3.4951 nll loss = 2.1301 accu = 0.3709

Training: Epoch 3 of 10 Step 1109 ntokens 55604904 Example 56100 of 138376 loss = 3.4950 nll loss = 2.1297 accu = 0.3710

Training: Epoch 3 of 10 Step 1110 ntokens 55640304 Example 56400 of 138376 loss = 3.4951 nll loss = 2.1301 accu = 0.3709

Training: Epoch 3 of 10 Step 1111 ntokens 55675704 Example 56700 of 138376 loss = 3.4960 nll loss = 2.1303 accu = 0.3708

Training: Epoch 3 of 10 Step 1112 ntokens 55711104 Example 57000 of 138376 loss = 3.4967 nll loss = 2.1308 accu = 0.3707

Training: Epoch 3 of 10 Step 1113 ntokens 55746504 Example 57300 of 138376 loss = 3.4972 nll loss = 2.1312 accu = 0.3705

Training: Epoch 3 of 10 Step 1114 ntokens 55781904 Example 57600 of 138376 loss = 3.4969 nll loss = 2.1312 accu = 0.3705

Training: Epoch 3 of 10 Step 1115 ntokens 55817304 Example 57900 of 138376 loss = 3.4971 nll loss = 2.1314 accu = 0.3704

Training: Epoch 3 of 10 Step 1116 ntokens 55852704 Example 58200 of 138376 loss = 3.4973 nll loss = 2.1313 accu = 0.3704

Training: Epoch 3 of 10 Step 1117 ntokens 55888104 Example 58500 of 138376 loss = 3.4973 nll loss = 2.1311 accu = 0.3705

Training: Epoch 3 of 10 Step 1118 ntokens 55923504 Example 58800 of 138376 loss = 3.4976 nll loss = 2.1309 accu = 0.3706

Training: Epoch 3 of 10 Step 1119 ntokens 55958904 Example 59100 of 138376 loss = 3.4982 nll loss = 2.1309 accu = 0.3706

Training: Epoch 3 of 10 Step 1120 ntokens 55994304 Example 59400 of 138376 loss = 3.4980 nll loss = 2.1310 accu = 0.3705

Training: Epoch 3 of 10 Step 1121 ntokens 56029704 Example 59700 of 138376 loss = 3.4977 nll loss = 2.1310 accu = 0.3705

Training: Epoch 3 of 10 Step 1122 ntokens 56065104 Example 60000 of 138376 loss = 3.4976 nll loss = 2.1310 accu = 0.3705

Training: Epoch 3 of 10 Step 1123 ntokens 56100504 Example 60300 of 138376 loss = 3.4980 nll loss = 2.1310 accu = 0.3705

Training: Epoch 3 of 10 Step 1124 ntokens 56135904 Example 60600 of 138376 loss = 3.4984 nll loss = 2.1309 accu = 0.3706

Training: Epoch 3 of 10 Step 1125 ntokens 56171304 Example 60900 of 138376 loss = 3.4986 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1126 ntokens 56206704 Example 61200 of 138376 loss = 3.4983 nll loss = 2.1318 accu = 0.3703

Training: Epoch 3 of 10 Step 1127 ntokens 56242104 Example 61500 of 138376 loss = 3.4977 nll loss = 2.1317 accu = 0.3703

Training: Epoch 3 of 10 Step 1128 ntokens 56277504 Example 61800 of 138376 loss = 3.4978 nll loss = 2.1314 accu = 0.3704

Training: Epoch 3 of 10 Step 1129 ntokens 56312904 Example 62100 of 138376 loss = 3.4977 nll loss = 2.1318 accu = 0.3703

Training: Epoch 3 of 10 Step 1130 ntokens 56348304 Example 62400 of 138376 loss = 3.4979 nll loss = 2.1317 accu = 0.3703

Training: Epoch 3 of 10 Step 1131 ntokens 56383704 Example 62700 of 138376 loss = 3.4977 nll loss = 2.1319 accu = 0.3702

Training: Epoch 3 of 10 Step 1132 ntokens 56419104 Example 63000 of 138376 loss = 3.4973 nll loss = 2.1322 accu = 0.3702

Training: Epoch 3 of 10 Step 1133 ntokens 56454504 Example 63300 of 138376 loss = 3.4970 nll loss = 2.1326 accu = 0.3700

Training: Epoch 3 of 10 Step 1134 ntokens 56489904 Example 63600 of 138376 loss = 3.4972 nll loss = 2.1322 accu = 0.3701

Training: Epoch 3 of 10 Step 1135 ntokens 56525304 Example 63900 of 138376 loss = 3.4973 nll loss = 2.1324 accu = 0.3701

Training: Epoch 3 of 10 Step 1136 ntokens 56560704 Example 64200 of 138376 loss = 3.4966 nll loss = 2.1321 accu = 0.3701

Training: Epoch 3 of 10 Step 1137 ntokens 56596104 Example 64500 of 138376 loss = 3.4968 nll loss = 2.1320 accu = 0.3702

Training: Epoch 3 of 10 Step 1138 ntokens 56631504 Example 64800 of 138376 loss = 3.4965 nll loss = 2.1321 accu = 0.3701

Training: Epoch 3 of 10 Step 1139 ntokens 56666904 Example 65100 of 138376 loss = 3.4966 nll loss = 2.1323 accu = 0.3701

Training: Epoch 3 of 10 Step 1140 ntokens 56702304 Example 65400 of 138376 loss = 3.4964 nll loss = 2.1325 accu = 0.3700

Training: Epoch 3 of 10 Step 1141 ntokens 56737704 Example 65700 of 138376 loss = 3.4965 nll loss = 2.1325 accu = 0.3700

Training: Epoch 3 of 10 Step 1142 ntokens 56773104 Example 66000 of 138376 loss = 3.4967 nll loss = 2.1327 accu = 0.3699

Training: Epoch 3 of 10 Step 1143 ntokens 56808504 Example 66300 of 138376 loss = 3.4966 nll loss = 2.1326 accu = 0.3699

Training: Epoch 3 of 10 Step 1144 ntokens 56843904 Example 66600 of 138376 loss = 3.4967 nll loss = 2.1328 accu = 0.3698

Training: Epoch 3 of 10 Step 1145 ntokens 56879304 Example 66900 of 138376 loss = 3.4964 nll loss = 2.1325 accu = 0.3700

Training: Epoch 3 of 10 Step 1146 ntokens 56914704 Example 67200 of 138376 loss = 3.4967 nll loss = 2.1329 accu = 0.3698

Training: Epoch 3 of 10 Step 1147 ntokens 56950104 Example 67500 of 138376 loss = 3.4963 nll loss = 2.1327 accu = 0.3699

Training: Epoch 3 of 10 Step 1148 ntokens 56985504 Example 67800 of 138376 loss = 3.4964 nll loss = 2.1330 accu = 0.3698

Training: Epoch 3 of 10 Step 1149 ntokens 57020904 Example 68100 of 138376 loss = 3.4963 nll loss = 2.1330 accu = 0.3698

Training: Epoch 3 of 10 Step 1150 ntokens 57056304 Example 68400 of 138376 loss = 3.4964 nll loss = 2.1331 accu = 0.3698

Training: Epoch 3 of 10 Step 1151 ntokens 57091704 Example 68700 of 138376 loss = 3.4964 nll loss = 2.1332 accu = 0.3697

Training: Epoch 3 of 10 Step 1152 ntokens 57127104 Example 69000 of 138376 loss = 3.4968 nll loss = 2.1334 accu = 0.3696

Training: Epoch 3 of 10 Step 1153 ntokens 57162504 Example 69300 of 138376 loss = 3.4969 nll loss = 2.1333 accu = 0.3696

Training: Epoch 3 of 10 Step 1154 ntokens 57197904 Example 69600 of 138376 loss = 3.4972 nll loss = 2.1333 accu = 0.3697

Training: Epoch 3 of 10 Step 1155 ntokens 57233304 Example 69900 of 138376 loss = 3.4972 nll loss = 2.1332 accu = 0.3697

Training: Epoch 3 of 10 Step 1156 ntokens 57268704 Example 70200 of 138376 loss = 3.4971 nll loss = 2.1330 accu = 0.3697

Training: Epoch 3 of 10 Step 1157 ntokens 57304104 Example 70500 of 138376 loss = 3.4968 nll loss = 2.1329 accu = 0.3698

Training: Epoch 3 of 10 Step 1158 ntokens 57339504 Example 70800 of 138376 loss = 3.4968 nll loss = 2.1333 accu = 0.3696

Training: Epoch 3 of 10 Step 1159 ntokens 57374904 Example 71100 of 138376 loss = 3.4966 nll loss = 2.1334 accu = 0.3696

Training: Epoch 3 of 10 Step 1160 ntokens 57410304 Example 71400 of 138376 loss = 3.4967 nll loss = 2.1330 accu = 0.3697

Training: Epoch 3 of 10 Step 1161 ntokens 57445704 Example 71700 of 138376 loss = 3.4966 nll loss = 2.1329 accu = 0.3698

Training: Epoch 3 of 10 Step 1162 ntokens 57481104 Example 72000 of 138376 loss = 3.4966 nll loss = 2.1330 accu = 0.3697

Training: Epoch 3 of 10 Step 1163 ntokens 57516504 Example 72300 of 138376 loss = 3.4960 nll loss = 2.1330 accu = 0.3697

Training: Epoch 3 of 10 Step 1164 ntokens 57551904 Example 72600 of 138376 loss = 3.4960 nll loss = 2.1331 accu = 0.3697

Training: Epoch 3 of 10 Step 1165 ntokens 57587304 Example 72900 of 138376 loss = 3.4965 nll loss = 2.1333 accu = 0.3697

Training: Epoch 3 of 10 Step 1166 ntokens 57622704 Example 73200 of 138376 loss = 3.4963 nll loss = 2.1334 accu = 0.3696

Training: Epoch 3 of 10 Step 1167 ntokens 57658104 Example 73500 of 138376 loss = 3.4965 nll loss = 2.1332 accu = 0.3697

Training: Epoch 3 of 10 Step 1168 ntokens 57693504 Example 73800 of 138376 loss = 3.4965 nll loss = 2.1333 accu = 0.3696

Training: Epoch 3 of 10 Step 1169 ntokens 57728904 Example 74100 of 138376 loss = 3.4967 nll loss = 2.1333 accu = 0.3696

Training: Epoch 3 of 10 Step 1170 ntokens 57764304 Example 74400 of 138376 loss = 3.4963 nll loss = 2.1331 accu = 0.3697

Training: Epoch 3 of 10 Step 1171 ntokens 57799704 Example 74700 of 138376 loss = 3.4960 nll loss = 2.1329 accu = 0.3698

Training: Epoch 3 of 10 Step 1172 ntokens 57835104 Example 75000 of 138376 loss = 3.4958 nll loss = 2.1326 accu = 0.3698

Training: Epoch 3 of 10 Step 1173 ntokens 57870504 Example 75300 of 138376 loss = 3.4961 nll loss = 2.1325 accu = 0.3699

Training: Epoch 3 of 10 Step 1174 ntokens 57905904 Example 75600 of 138376 loss = 3.4961 nll loss = 2.1323 accu = 0.3700

Training: Epoch 3 of 10 Step 1175 ntokens 57941304 Example 75900 of 138376 loss = 3.4965 nll loss = 2.1321 accu = 0.3700

Training: Epoch 3 of 10 Step 1176 ntokens 57976704 Example 76200 of 138376 loss = 3.4966 nll loss = 2.1326 accu = 0.3699

Training: Epoch 3 of 10 Step 1177 ntokens 58012104 Example 76500 of 138376 loss = 3.4964 nll loss = 2.1327 accu = 0.3698

Training: Epoch 3 of 10 Step 1178 ntokens 58047504 Example 76800 of 138376 loss = 3.4965 nll loss = 2.1326 accu = 0.3699

Training: Epoch 3 of 10 Step 1179 ntokens 58082904 Example 77100 of 138376 loss = 3.4967 nll loss = 2.1326 accu = 0.3699

Training: Epoch 3 of 10 Step 1180 ntokens 58118304 Example 77400 of 138376 loss = 3.4968 nll loss = 2.1326 accu = 0.3699

Training: Epoch 3 of 10 Step 1181 ntokens 58153704 Example 77700 of 138376 loss = 3.4969 nll loss = 2.1325 accu = 0.3699

Training: Epoch 3 of 10 Step 1182 ntokens 58189104 Example 78000 of 138376 loss = 3.4971 nll loss = 2.1326 accu = 0.3699

Training: Epoch 3 of 10 Step 1183 ntokens 58224504 Example 78300 of 138376 loss = 3.4968 nll loss = 2.1323 accu = 0.3700

Training: Epoch 3 of 10 Step 1184 ntokens 58259904 Example 78600 of 138376 loss = 3.4966 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1185 ntokens 58295304 Example 78900 of 138376 loss = 3.4965 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1186 ntokens 58330704 Example 79200 of 138376 loss = 3.4968 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1187 ntokens 58366104 Example 79500 of 138376 loss = 3.4968 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1188 ntokens 58401504 Example 79800 of 138376 loss = 3.4969 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1189 ntokens 58436904 Example 80100 of 138376 loss = 3.4967 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1190 ntokens 58472304 Example 80400 of 138376 loss = 3.4969 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1191 ntokens 58507704 Example 80700 of 138376 loss = 3.4970 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1192 ntokens 58543104 Example 81000 of 138376 loss = 3.4971 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1193 ntokens 58578504 Example 81300 of 138376 loss = 3.4970 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1194 ntokens 58613904 Example 81600 of 138376 loss = 3.4971 nll loss = 2.1316 accu = 0.3702

Training: Epoch 3 of 10 Step 1195 ntokens 58649304 Example 81900 of 138376 loss = 3.4973 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1196 ntokens 58684704 Example 82200 of 138376 loss = 3.4976 nll loss = 2.1318 accu = 0.3701

Training: Epoch 3 of 10 Step 1197 ntokens 58720104 Example 82500 of 138376 loss = 3.4973 nll loss = 2.1318 accu = 0.3701

Training: Epoch 3 of 10 Step 1198 ntokens 58755504 Example 82800 of 138376 loss = 3.4972 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1199 ntokens 58790904 Example 83100 of 138376 loss = 3.4976 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1200 ntokens 58826304 Example 83400 of 138376 loss = 3.4975 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1201 ntokens 58861704 Example 83700 of 138376 loss = 3.4975 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1202 ntokens 58897104 Example 84000 of 138376 loss = 3.4976 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1203 ntokens 58932504 Example 84300 of 138376 loss = 3.4979 nll loss = 2.1320 accu = 0.3701

Training: Epoch 3 of 10 Step 1204 ntokens 58967904 Example 84600 of 138376 loss = 3.4981 nll loss = 2.1318 accu = 0.3701

Training: Epoch 3 of 10 Step 1205 ntokens 59003304 Example 84900 of 138376 loss = 3.4982 nll loss = 2.1321 accu = 0.3700

Training: Epoch 3 of 10 Step 1206 ntokens 59038704 Example 85200 of 138376 loss = 3.4984 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1207 ntokens 59074104 Example 85500 of 138376 loss = 3.4984 nll loss = 2.1322 accu = 0.3700

Training: Epoch 3 of 10 Step 1208 ntokens 59109504 Example 85800 of 138376 loss = 3.4984 nll loss = 2.1321 accu = 0.3700

Training: Epoch 3 of 10 Step 1209 ntokens 59144904 Example 86100 of 138376 loss = 3.4979 nll loss = 2.1323 accu = 0.3700

Training: Epoch 3 of 10 Step 1210 ntokens 59180304 Example 86400 of 138376 loss = 3.4977 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1211 ntokens 59215704 Example 86700 of 138376 loss = 3.4982 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1212 ntokens 59251104 Example 87000 of 138376 loss = 3.4979 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1213 ntokens 59286504 Example 87300 of 138376 loss = 3.4978 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1214 ntokens 59321904 Example 87600 of 138376 loss = 3.4980 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1215 ntokens 59357304 Example 87900 of 138376 loss = 3.4978 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1216 ntokens 59392704 Example 88200 of 138376 loss = 3.4977 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1217 ntokens 59428104 Example 88500 of 138376 loss = 3.4973 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1218 ntokens 59463504 Example 88800 of 138376 loss = 3.4971 nll loss = 2.1315 accu = 0.3702

Training: Epoch 3 of 10 Step 1219 ntokens 59498904 Example 89100 of 138376 loss = 3.4973 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1220 ntokens 59534304 Example 89400 of 138376 loss = 3.4977 nll loss = 2.1318 accu = 0.3701

Training: Epoch 3 of 10 Step 1221 ntokens 59569704 Example 89700 of 138376 loss = 3.4977 nll loss = 2.1318 accu = 0.3701

Training: Epoch 3 of 10 Step 1222 ntokens 59605104 Example 90000 of 138376 loss = 3.4979 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1223 ntokens 59640504 Example 90300 of 138376 loss = 3.4978 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1224 ntokens 59675904 Example 90600 of 138376 loss = 3.4977 nll loss = 2.1321 accu = 0.3700

Training: Epoch 3 of 10 Step 1225 ntokens 59711304 Example 90900 of 138376 loss = 3.4978 nll loss = 2.1320 accu = 0.3701

Training: Epoch 3 of 10 Step 1226 ntokens 59746704 Example 91200 of 138376 loss = 3.4981 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1227 ntokens 59782104 Example 91500 of 138376 loss = 3.4983 nll loss = 2.1320 accu = 0.3701

Training: Epoch 3 of 10 Step 1228 ntokens 59817504 Example 91800 of 138376 loss = 3.4985 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1229 ntokens 59852904 Example 92100 of 138376 loss = 3.4986 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1230 ntokens 59888304 Example 92400 of 138376 loss = 3.4986 nll loss = 2.1321 accu = 0.3701

Training: Epoch 3 of 10 Step 1231 ntokens 59923704 Example 92700 of 138376 loss = 3.4983 nll loss = 2.1320 accu = 0.3701

Training: Epoch 3 of 10 Step 1232 ntokens 59959104 Example 93000 of 138376 loss = 3.4984 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1233 ntokens 59994504 Example 93300 of 138376 loss = 3.4985 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1234 ntokens 60029904 Example 93600 of 138376 loss = 3.4985 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1235 ntokens 60065304 Example 93900 of 138376 loss = 3.4984 nll loss = 2.1318 accu = 0.3702

Training: Epoch 3 of 10 Step 1236 ntokens 60100704 Example 94200 of 138376 loss = 3.4984 nll loss = 2.1318 accu = 0.3702

Training: Epoch 3 of 10 Step 1237 ntokens 60136104 Example 94500 of 138376 loss = 3.4985 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1238 ntokens 60171504 Example 94800 of 138376 loss = 3.4987 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1239 ntokens 60206904 Example 95100 of 138376 loss = 3.4989 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1240 ntokens 60242304 Example 95400 of 138376 loss = 3.4987 nll loss = 2.1320 accu = 0.3701

Training: Epoch 3 of 10 Step 1241 ntokens 60277704 Example 95700 of 138376 loss = 3.4985 nll loss = 2.1321 accu = 0.3701

Training: Epoch 3 of 10 Step 1242 ntokens 60313104 Example 96000 of 138376 loss = 3.4985 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1243 ntokens 60348504 Example 96300 of 138376 loss = 3.4990 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1244 ntokens 60383904 Example 96600 of 138376 loss = 3.4991 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1245 ntokens 60419304 Example 96900 of 138376 loss = 3.4991 nll loss = 2.1318 accu = 0.3702

Training: Epoch 3 of 10 Step 1246 ntokens 60454704 Example 97200 of 138376 loss = 3.4990 nll loss = 2.1318 accu = 0.3702

Training: Epoch 3 of 10 Step 1247 ntokens 60490104 Example 97500 of 138376 loss = 3.4987 nll loss = 2.1319 accu = 0.3701

Training: Epoch 3 of 10 Step 1248 ntokens 60525504 Example 97800 of 138376 loss = 3.4988 nll loss = 2.1316 accu = 0.3703

Training: Epoch 3 of 10 Step 1249 ntokens 60560904 Example 98100 of 138376 loss = 3.4988 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1250 ntokens 60596304 Example 98400 of 138376 loss = 3.4992 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1251 ntokens 60631704 Example 98700 of 138376 loss = 3.4993 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1252 ntokens 60667104 Example 99000 of 138376 loss = 3.4993 nll loss = 2.1316 accu = 0.3702

Training: Epoch 3 of 10 Step 1253 ntokens 60702504 Example 99300 of 138376 loss = 3.4993 nll loss = 2.1316 accu = 0.3703

Training: Epoch 3 of 10 Step 1254 ntokens 60737904 Example 99600 of 138376 loss = 3.4993 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1255 ntokens 60773304 Example 99900 of 138376 loss = 3.4996 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1256 ntokens 60808704 Example 100200 of 138376 loss = 3.4992 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1257 ntokens 60844104 Example 100500 of 138376 loss = 3.4990 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1258 ntokens 60879504 Example 100800 of 138376 loss = 3.4989 nll loss = 2.1313 accu = 0.3704

Training: Epoch 3 of 10 Step 1259 ntokens 60914904 Example 101100 of 138376 loss = 3.4990 nll loss = 2.1313 accu = 0.3704

Training: Epoch 3 of 10 Step 1260 ntokens 60950304 Example 101400 of 138376 loss = 3.4989 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1261 ntokens 60985704 Example 101700 of 138376 loss = 3.4990 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1262 ntokens 61021104 Example 102000 of 138376 loss = 3.4992 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1263 ntokens 61056504 Example 102300 of 138376 loss = 3.4992 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1264 ntokens 61091904 Example 102600 of 138376 loss = 3.4992 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1265 ntokens 61127304 Example 102900 of 138376 loss = 3.4988 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1266 ntokens 61162704 Example 103200 of 138376 loss = 3.4990 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1267 ntokens 61198104 Example 103500 of 138376 loss = 3.4989 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1268 ntokens 61233504 Example 103800 of 138376 loss = 3.4990 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1269 ntokens 61268904 Example 104100 of 138376 loss = 3.4988 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1270 ntokens 61304304 Example 104400 of 138376 loss = 3.4991 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1271 ntokens 61339704 Example 104700 of 138376 loss = 3.4992 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1272 ntokens 61375104 Example 105000 of 138376 loss = 3.4991 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1273 ntokens 61410504 Example 105300 of 138376 loss = 3.4991 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1274 ntokens 61445904 Example 105600 of 138376 loss = 3.4991 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1275 ntokens 61481304 Example 105900 of 138376 loss = 3.4992 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1276 ntokens 61516704 Example 106200 of 138376 loss = 3.4991 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1277 ntokens 61552104 Example 106500 of 138376 loss = 3.4990 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1278 ntokens 61587504 Example 106800 of 138376 loss = 3.4992 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1279 ntokens 61622904 Example 107100 of 138376 loss = 3.4991 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1280 ntokens 61658304 Example 107400 of 138376 loss = 3.4991 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1281 ntokens 61693704 Example 107700 of 138376 loss = 3.4993 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1282 ntokens 61729104 Example 108000 of 138376 loss = 3.4993 nll loss = 2.1312 accu = 0.3704

Training: Epoch 3 of 10 Step 1283 ntokens 61764504 Example 108300 of 138376 loss = 3.4991 nll loss = 2.1313 accu = 0.3704

Training: Epoch 3 of 10 Step 1284 ntokens 61799904 Example 108600 of 138376 loss = 3.4992 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1285 ntokens 61835304 Example 108900 of 138376 loss = 3.4991 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1286 ntokens 61870704 Example 109200 of 138376 loss = 3.4992 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1287 ntokens 61906104 Example 109500 of 138376 loss = 3.4993 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1288 ntokens 61941504 Example 109800 of 138376 loss = 3.4995 nll loss = 2.1313 accu = 0.3704

Training: Epoch 3 of 10 Step 1289 ntokens 61976904 Example 110100 of 138376 loss = 3.4994 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1290 ntokens 62012304 Example 110400 of 138376 loss = 3.4995 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1291 ntokens 62047704 Example 110700 of 138376 loss = 3.4994 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1292 ntokens 62083104 Example 111000 of 138376 loss = 3.4996 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1293 ntokens 62118504 Example 111300 of 138376 loss = 3.4998 nll loss = 2.1316 accu = 0.3702

Training: Epoch 3 of 10 Step 1294 ntokens 62153904 Example 111600 of 138376 loss = 3.4996 nll loss = 2.1316 accu = 0.3702

Training: Epoch 3 of 10 Step 1295 ntokens 62189304 Example 111900 of 138376 loss = 3.4996 nll loss = 2.1315 accu = 0.3702

Training: Epoch 3 of 10 Step 1296 ntokens 62224704 Example 112200 of 138376 loss = 3.4996 nll loss = 2.1316 accu = 0.3702

Training: Epoch 3 of 10 Step 1297 ntokens 62260104 Example 112500 of 138376 loss = 3.4997 nll loss = 2.1315 accu = 0.3702

Training: Epoch 3 of 10 Step 1298 ntokens 62295504 Example 112800 of 138376 loss = 3.4997 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1299 ntokens 62330904 Example 113100 of 138376 loss = 3.4998 nll loss = 2.1316 accu = 0.3702

Training: Epoch 3 of 10 Step 1300 ntokens 62366304 Example 113400 of 138376 loss = 3.4998 nll loss = 2.1315 accu = 0.3702

Training: Epoch 3 of 10 Step 1301 ntokens 62401704 Example 113700 of 138376 loss = 3.4999 nll loss = 2.1318 accu = 0.3702

Training: Epoch 3 of 10 Step 1302 ntokens 62437104 Example 114000 of 138376 loss = 3.5000 nll loss = 2.1317 accu = 0.3702

Training: Epoch 3 of 10 Step 1303 ntokens 62472504 Example 114300 of 138376 loss = 3.4999 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1304 ntokens 62507904 Example 114600 of 138376 loss = 3.4996 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1305 ntokens 62543304 Example 114900 of 138376 loss = 3.4999 nll loss = 2.1312 accu = 0.3703

Training: Epoch 3 of 10 Step 1306 ntokens 62578704 Example 115200 of 138376 loss = 3.5001 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1307 ntokens 62614104 Example 115500 of 138376 loss = 3.4998 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1308 ntokens 62649504 Example 115800 of 138376 loss = 3.5000 nll loss = 2.1310 accu = 0.3704

Training: Epoch 3 of 10 Step 1309 ntokens 62684904 Example 116100 of 138376 loss = 3.5000 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1310 ntokens 62720304 Example 116400 of 138376 loss = 3.4999 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1311 ntokens 62755704 Example 116700 of 138376 loss = 3.4999 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1312 ntokens 62791104 Example 117000 of 138376 loss = 3.4997 nll loss = 2.1314 accu = 0.3703

Training: Epoch 3 of 10 Step 1313 ntokens 62826504 Example 117300 of 138376 loss = 3.4995 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1314 ntokens 62861904 Example 117600 of 138376 loss = 3.4994 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1315 ntokens 62897304 Example 117900 of 138376 loss = 3.4993 nll loss = 2.1315 accu = 0.3703

Training: Epoch 3 of 10 Step 1316 ntokens 62932704 Example 118200 of 138376 loss = 3.4995 nll loss = 2.1313 accu = 0.3703

Training: Epoch 3 of 10 Step 1317 ntokens 62968104 Example 118500 of 138376 loss = 3.4996 nll loss = 2.1311 accu = 0.3704

Training: Epoch 3 of 10 Step 1318 ntokens 63003504 Example 118800 of 138376 loss = 3.4995 nll loss = 2.1309 accu = 0.3705

Training: Epoch 3 of 10 Step 1319 ntokens 63038904 Example 119100 of 138376 loss = 3.4991 nll loss = 2.1307 accu = 0.3705

Training: Epoch 3 of 10 Step 1320 ntokens 63074304 Example 119400 of 138376 loss = 3.4991 nll loss = 2.1308 accu = 0.3705

Training: Epoch 3 of 10 Step 1321 ntokens 63109704 Example 119700 of 138376 loss = 3.4992 nll loss = 2.1308 accu = 0.3705

Training: Epoch 3 of 10 Step 1322 ntokens 63145104 Example 120000 of 138376 loss = 3.4994 nll loss = 2.1306 accu = 0.3706

Training: Epoch 3 of 10 Step 1323 ntokens 63180504 Example 120300 of 138376 loss = 3.4994 nll loss = 2.1306 accu = 0.3706

Training: Epoch 3 of 10 Step 1324 ntokens 63215904 Example 120600 of 138376 loss = 3.4994 nll loss = 2.1303 accu = 0.3707

Training: Epoch 3 of 10 Step 1325 ntokens 63251304 Example 120900 of 138376 loss = 3.4995 nll loss = 2.1305 accu = 0.3706

Training: Epoch 3 of 10 Step 1326 ntokens 63286704 Example 121200 of 138376 loss = 3.4996 nll loss = 2.1305 accu = 0.3706

Training: Epoch 3 of 10 Step 1327 ntokens 63322104 Example 121500 of 138376 loss = 3.4995 nll loss = 2.1304 accu = 0.3706

Training: Epoch 3 of 10 Step 1328 ntokens 63357504 Example 121800 of 138376 loss = 3.4996 nll loss = 2.1304 accu = 0.3706

Training: Epoch 3 of 10 Step 1329 ntokens 63392904 Example 122100 of 138376 loss = 3.4997 nll loss = 2.1303 accu = 0.3706

Training: Epoch 3 of 10 Step 1330 ntokens 63428304 Example 122400 of 138376 loss = 3.4997 nll loss = 2.1305 accu = 0.3706

Training: Epoch 3 of 10 Step 1331 ntokens 63463704 Example 122700 of 138376 loss = 3.4999 nll loss = 2.1304 accu = 0.3706

Training: Epoch 3 of 10 Step 1332 ntokens 63499104 Example 123000 of 138376 loss = 3.5001 nll loss = 2.1306 accu = 0.3706

Training: Epoch 3 of 10 Step 1333 ntokens 63534504 Example 123300 of 138376 loss = 3.5002 nll loss = 2.1305 accu = 0.3706

Training: Epoch 3 of 10 Step 1334 ntokens 63569904 Example 123600 of 138376 loss = 3.5004 nll loss = 2.1305 accu = 0.3706

Training: Epoch 3 of 10 Step 1335 ntokens 63605304 Example 123900 of 138376 loss = 3.5005 nll loss = 2.1304 accu = 0.3706

Training: Epoch 3 of 10 Step 1336 ntokens 63640704 Example 124200 of 138376 loss = 3.5004 nll loss = 2.1304 accu = 0.3706

Training: Epoch 3 of 10 Step 1337 ntokens 63676104 Example 124500 of 138376 loss = 3.5003 nll loss = 2.1304 accu = 0.3706

Training: Epoch 3 of 10 Step 1338 ntokens 63711504 Example 124800 of 138376 loss = 3.5003 nll loss = 2.1303 accu = 0.3707

Training: Epoch 3 of 10 Step 1339 ntokens 63746904 Example 125100 of 138376 loss = 3.5002 nll loss = 2.1303 accu = 0.3707

Training: Epoch 3 of 10 Step 1340 ntokens 63782304 Example 125400 of 138376 loss = 3.5001 nll loss = 2.1303 accu = 0.3707

Training: Epoch 3 of 10 Step 1341 ntokens 63817704 Example 125700 of 138376 loss = 3.5002 nll loss = 2.1301 accu = 0.3707

Training: Epoch 3 of 10 Step 1342 ntokens 63853104 Example 126000 of 138376 loss = 3.4999 nll loss = 2.1301 accu = 0.3708

Training: Epoch 3 of 10 Step 1343 ntokens 63888504 Example 126300 of 138376 loss = 3.5000 nll loss = 2.1302 accu = 0.3707

Training: Epoch 3 of 10 Step 1344 ntokens 63923904 Example 126600 of 138376 loss = 3.5002 nll loss = 2.1301 accu = 0.3708

Training: Epoch 3 of 10 Step 1345 ntokens 63959304 Example 126900 of 138376 loss = 3.5003 nll loss = 2.1298 accu = 0.3708

Training: Epoch 3 of 10 Step 1346 ntokens 63994704 Example 127200 of 138376 loss = 3.5001 nll loss = 2.1299 accu = 0.3708

Training: Epoch 3 of 10 Step 1347 ntokens 64030104 Example 127500 of 138376 loss = 3.5001 nll loss = 2.1300 accu = 0.3708

Training: Epoch 3 of 10 Step 1348 ntokens 64065504 Example 127800 of 138376 loss = 3.5000 nll loss = 2.1299 accu = 0.3708

Training: Epoch 3 of 10 Step 1349 ntokens 64100904 Example 128100 of 138376 loss = 3.5000 nll loss = 2.1299 accu = 0.3708

Training: Epoch 3 of 10 Step 1350 ntokens 64136304 Example 128400 of 138376 loss = 3.5000 nll loss = 2.1297 accu = 0.3709

Training: Epoch 3 of 10 Step 1351 ntokens 64171704 Example 128700 of 138376 loss = 3.5000 nll loss = 2.1296 accu = 0.3709

Training: Epoch 3 of 10 Step 1352 ntokens 64207104 Example 129000 of 138376 loss = 3.4999 nll loss = 2.1296 accu = 0.3709

Training: Epoch 3 of 10 Step 1353 ntokens 64242504 Example 129300 of 138376 loss = 3.4997 nll loss = 2.1298 accu = 0.3709

Training: Epoch 3 of 10 Step 1354 ntokens 64277904 Example 129600 of 138376 loss = 3.5000 nll loss = 2.1296 accu = 0.3709

Training: Epoch 3 of 10 Step 1355 ntokens 64313304 Example 129900 of 138376 loss = 3.5000 nll loss = 2.1297 accu = 0.3709

Training: Epoch 3 of 10 Step 1356 ntokens 64348704 Example 130200 of 138376 loss = 3.5003 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1357 ntokens 64384104 Example 130500 of 138376 loss = 3.5004 nll loss = 2.1296 accu = 0.3709

Training: Epoch 3 of 10 Step 1358 ntokens 64419504 Example 130800 of 138376 loss = 3.5003 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1359 ntokens 64454904 Example 131100 of 138376 loss = 3.5004 nll loss = 2.1295 accu = 0.3710

Training: Epoch 3 of 10 Step 1360 ntokens 64490304 Example 131400 of 138376 loss = 3.5004 nll loss = 2.1293 accu = 0.3711

Training: Epoch 3 of 10 Step 1361 ntokens 64525704 Example 131700 of 138376 loss = 3.5004 nll loss = 2.1293 accu = 0.3711

Training: Epoch 3 of 10 Step 1362 ntokens 64561104 Example 132000 of 138376 loss = 3.5003 nll loss = 2.1294 accu = 0.3710

Training: Epoch 3 of 10 Step 1363 ntokens 64596504 Example 132300 of 138376 loss = 3.5006 nll loss = 2.1296 accu = 0.3709

Training: Epoch 3 of 10 Step 1364 ntokens 64631904 Example 132600 of 138376 loss = 3.5008 nll loss = 2.1296 accu = 0.3709

Training: Epoch 3 of 10 Step 1365 ntokens 64667304 Example 132900 of 138376 loss = 3.5005 nll loss = 2.1298 accu = 0.3709

Training: Epoch 3 of 10 Step 1366 ntokens 64702704 Example 133200 of 138376 loss = 3.5003 nll loss = 2.1299 accu = 0.3709

Training: Epoch 3 of 10 Step 1367 ntokens 64738104 Example 133500 of 138376 loss = 3.5002 nll loss = 2.1298 accu = 0.3709

Training: Epoch 3 of 10 Step 1368 ntokens 64773504 Example 133800 of 138376 loss = 3.5005 nll loss = 2.1298 accu = 0.3709

Training: Epoch 3 of 10 Step 1369 ntokens 64808904 Example 134100 of 138376 loss = 3.5004 nll loss = 2.1297 accu = 0.3709

Training: Epoch 3 of 10 Step 1370 ntokens 64844304 Example 134400 of 138376 loss = 3.5001 nll loss = 2.1297 accu = 0.3709

Training: Epoch 3 of 10 Step 1371 ntokens 64879704 Example 134700 of 138376 loss = 3.5001 nll loss = 2.1299 accu = 0.3709

Training: Epoch 3 of 10 Step 1372 ntokens 64915104 Example 135000 of 138376 loss = 3.5001 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1373 ntokens 64950504 Example 135300 of 138376 loss = 3.5000 nll loss = 2.1295 accu = 0.3710

Training: Epoch 3 of 10 Step 1374 ntokens 64985904 Example 135600 of 138376 loss = 3.5000 nll loss = 2.1295 accu = 0.3710

Training: Epoch 3 of 10 Step 1375 ntokens 65021304 Example 135900 of 138376 loss = 3.4999 nll loss = 2.1294 accu = 0.3710

Training: Epoch 3 of 10 Step 1376 ntokens 65056704 Example 136200 of 138376 loss = 3.4998 nll loss = 2.1294 accu = 0.3710

Training: Epoch 3 of 10 Step 1377 ntokens 65092104 Example 136500 of 138376 loss = 3.4997 nll loss = 2.1295 accu = 0.3710

Training: Epoch 3 of 10 Step 1378 ntokens 65127504 Example 136800 of 138376 loss = 3.4995 nll loss = 2.1297 accu = 0.3709

Training: Epoch 3 of 10 Step 1379 ntokens 65162904 Example 137100 of 138376 loss = 3.4995 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1380 ntokens 65198304 Example 137400 of 138376 loss = 3.4996 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1381 ntokens 65233704 Example 137700 of 138376 loss = 3.4996 nll loss = 2.1294 accu = 0.3710

Training: Epoch 3 of 10 Step 1382 ntokens 65269104 Example 138000 of 138376 loss = 3.4994 nll loss = 2.1296 accu = 0.3710

Training: Epoch 3 of 10 Step 1383 ntokens 65304504 Example 138300 of 138376 loss = 3.4994 nll loss = 2.1297 accu = 0.3709

Training: Epoch 3 of 10 Step 1384 ntokens 65313472 Example 138376 of 138376 loss = 3.4995 nll loss = 2.1297 accu = 0.3710

Writing to checkpoint at 2024-05-28 16:55:32.611475
Validating: Epoch 3 of 10 Step 0 ntokens 65313472 Example 300 of 34323 loss = 3.5001 nll loss = 2.0673 accu = 0.3912

Validating: Epoch 3 of 10 Step 1 ntokens 65313472 Example 600 of 34323 loss = 3.4710 nll loss = 2.0892 accu = 0.3854

Validating: Epoch 3 of 10 Step 2 ntokens 65313472 Example 900 of 34323 loss = 3.4841 nll loss = 2.1080 accu = 0.3780

Validating: Epoch 3 of 10 Step 3 ntokens 65313472 Example 1200 of 34323 loss = 3.4746 nll loss = 2.1261 accu = 0.3715

Validating: Epoch 3 of 10 Step 4 ntokens 65313472 Example 1500 of 34323 loss = 3.4918 nll loss = 2.1272 accu = 0.3706

Validating: Epoch 3 of 10 Step 5 ntokens 65313472 Example 1800 of 34323 loss = 3.4849 nll loss = 2.1268 accu = 0.3713

Validating: Epoch 3 of 10 Step 6 ntokens 65313472 Example 2100 of 34323 loss = 3.4892 nll loss = 2.1291 accu = 0.3707

Validating: Epoch 3 of 10 Step 7 ntokens 65313472 Example 2400 of 34323 loss = 3.4917 nll loss = 2.1395 accu = 0.3669

Validating: Epoch 3 of 10 Step 8 ntokens 65313472 Example 2700 of 34323 loss = 3.4960 nll loss = 2.1346 accu = 0.3682

Validating: Epoch 3 of 10 Step 9 ntokens 65313472 Example 3000 of 34323 loss = 3.4919 nll loss = 2.1309 accu = 0.3698

Validating: Epoch 3 of 10 Step 10 ntokens 65313472 Example 3300 of 34323 loss = 3.4866 nll loss = 2.1290 accu = 0.3707

Validating: Epoch 3 of 10 Step 11 ntokens 65313472 Example 3600 of 34323 loss = 3.4791 nll loss = 2.1373 accu = 0.3677

Validating: Epoch 3 of 10 Step 12 ntokens 65313472 Example 3900 of 34323 loss = 3.4768 nll loss = 2.1345 accu = 0.3686

Validating: Epoch 3 of 10 Step 13 ntokens 65313472 Example 4200 of 34323 loss = 3.4755 nll loss = 2.1381 accu = 0.3675

Validating: Epoch 3 of 10 Step 14 ntokens 65313472 Example 4500 of 34323 loss = 3.4814 nll loss = 2.1388 accu = 0.3672

Validating: Epoch 3 of 10 Step 15 ntokens 65313472 Example 4800 of 34323 loss = 3.4820 nll loss = 2.1362 accu = 0.3682

Validating: Epoch 3 of 10 Step 16 ntokens 65313472 Example 5100 of 34323 loss = 3.4775 nll loss = 2.1332 accu = 0.3692

Validating: Epoch 3 of 10 Step 17 ntokens 65313472 Example 5400 of 34323 loss = 3.4684 nll loss = 2.1338 accu = 0.3691

Validating: Epoch 3 of 10 Step 18 ntokens 65313472 Example 5700 of 34323 loss = 3.4737 nll loss = 2.1359 accu = 0.3684

Validating: Epoch 3 of 10 Step 19 ntokens 65313472 Example 6000 of 34323 loss = 3.4789 nll loss = 2.1371 accu = 0.3680

Validating: Epoch 3 of 10 Step 20 ntokens 65313472 Example 6300 of 34323 loss = 3.4817 nll loss = 2.1352 accu = 0.3687

Validating: Epoch 3 of 10 Step 21 ntokens 65313472 Example 6600 of 34323 loss = 3.4827 nll loss = 2.1375 accu = 0.3678

Validating: Epoch 3 of 10 Step 22 ntokens 65313472 Example 6900 of 34323 loss = 3.4860 nll loss = 2.1387 accu = 0.3674

Validating: Epoch 3 of 10 Step 23 ntokens 65313472 Example 7200 of 34323 loss = 3.4842 nll loss = 2.1405 accu = 0.3668

Validating: Epoch 3 of 10 Step 24 ntokens 65313472 Example 7500 of 34323 loss = 3.4840 nll loss = 2.1411 accu = 0.3665

Validating: Epoch 3 of 10 Step 25 ntokens 65313472 Example 7800 of 34323 loss = 3.4843 nll loss = 2.1427 accu = 0.3661

Validating: Epoch 3 of 10 Step 26 ntokens 65313472 Example 8100 of 34323 loss = 3.4857 nll loss = 2.1424 accu = 0.3663

Validating: Epoch 3 of 10 Step 27 ntokens 65313472 Example 8400 of 34323 loss = 3.4891 nll loss = 2.1427 accu = 0.3661

Validating: Epoch 3 of 10 Step 28 ntokens 65313472 Example 8700 of 34323 loss = 3.4869 nll loss = 2.1424 accu = 0.3662

Validating: Epoch 3 of 10 Step 29 ntokens 65313472 Example 9000 of 34323 loss = 3.4859 nll loss = 2.1434 accu = 0.3660

Validating: Epoch 3 of 10 Step 30 ntokens 65313472 Example 9300 of 34323 loss = 3.4869 nll loss = 2.1439 accu = 0.3658

Validating: Epoch 3 of 10 Step 31 ntokens 65313472 Example 9600 of 34323 loss = 3.4898 nll loss = 2.1442 accu = 0.3657

Validating: Epoch 3 of 10 Step 32 ntokens 65313472 Example 9900 of 34323 loss = 3.4881 nll loss = 2.1398 accu = 0.3672

Validating: Epoch 3 of 10 Step 33 ntokens 65313472 Example 10200 of 34323 loss = 3.4884 nll loss = 2.1397 accu = 0.3671

Validating: Epoch 3 of 10 Step 34 ntokens 65313472 Example 10500 of 34323 loss = 3.4918 nll loss = 2.1389 accu = 0.3673

Validating: Epoch 3 of 10 Step 35 ntokens 65313472 Example 10800 of 34323 loss = 3.4920 nll loss = 2.1394 accu = 0.3671

Validating: Epoch 3 of 10 Step 36 ntokens 65313472 Example 11100 of 34323 loss = 3.4909 nll loss = 2.1391 accu = 0.3673

Validating: Epoch 3 of 10 Step 37 ntokens 65313472 Example 11400 of 34323 loss = 3.4905 nll loss = 2.1412 accu = 0.3666

Validating: Epoch 3 of 10 Step 38 ntokens 65313472 Example 11700 of 34323 loss = 3.4912 nll loss = 2.1403 accu = 0.3669

Validating: Epoch 3 of 10 Step 39 ntokens 65313472 Example 12000 of 34323 loss = 3.4898 nll loss = 2.1414 accu = 0.3666

Validating: Epoch 3 of 10 Step 40 ntokens 65313472 Example 12300 of 34323 loss = 3.4903 nll loss = 2.1413 accu = 0.3666

Validating: Epoch 3 of 10 Step 41 ntokens 65313472 Example 12600 of 34323 loss = 3.4892 nll loss = 2.1399 accu = 0.3671

Validating: Epoch 3 of 10 Step 42 ntokens 65313472 Example 12900 of 34323 loss = 3.4920 nll loss = 2.1396 accu = 0.3674

Validating: Epoch 3 of 10 Step 43 ntokens 65313472 Example 13200 of 34323 loss = 3.4906 nll loss = 2.1392 accu = 0.3675

Validating: Epoch 3 of 10 Step 44 ntokens 65313472 Example 13500 of 34323 loss = 3.4891 nll loss = 2.1368 accu = 0.3683

Validating: Epoch 3 of 10 Step 45 ntokens 65313472 Example 13800 of 34323 loss = 3.4854 nll loss = 2.1348 accu = 0.3690

Validating: Epoch 3 of 10 Step 46 ntokens 65313472 Example 14100 of 34323 loss = 3.4866 nll loss = 2.1349 accu = 0.3690

Validating: Epoch 3 of 10 Step 47 ntokens 65313472 Example 14400 of 34323 loss = 3.4873 nll loss = 2.1345 accu = 0.3691

Validating: Epoch 3 of 10 Step 48 ntokens 65313472 Example 14700 of 34323 loss = 3.4893 nll loss = 2.1333 accu = 0.3695

Validating: Epoch 3 of 10 Step 49 ntokens 65313472 Example 15000 of 34323 loss = 3.4918 nll loss = 2.1322 accu = 0.3698

Validating: Epoch 3 of 10 Step 50 ntokens 65313472 Example 15300 of 34323 loss = 3.4936 nll loss = 2.1331 accu = 0.3695

Validating: Epoch 3 of 10 Step 51 ntokens 65313472 Example 15600 of 34323 loss = 3.4928 nll loss = 2.1332 accu = 0.3695

Validating: Epoch 3 of 10 Step 52 ntokens 65313472 Example 15900 of 34323 loss = 3.4927 nll loss = 2.1324 accu = 0.3698

Validating: Epoch 3 of 10 Step 53 ntokens 65313472 Example 16200 of 34323 loss = 3.4916 nll loss = 2.1318 accu = 0.3700

Validating: Epoch 3 of 10 Step 54 ntokens 65313472 Example 16500 of 34323 loss = 3.4924 nll loss = 2.1323 accu = 0.3697

Validating: Epoch 3 of 10 Step 55 ntokens 65313472 Example 16800 of 34323 loss = 3.4937 nll loss = 2.1324 accu = 0.3697

Validating: Epoch 3 of 10 Step 56 ntokens 65313472 Example 17100 of 34323 loss = 3.4936 nll loss = 2.1325 accu = 0.3697

Validating: Epoch 3 of 10 Step 57 ntokens 65313472 Example 17400 of 34323 loss = 3.4950 nll loss = 2.1347 accu = 0.3689

Validating: Epoch 3 of 10 Step 58 ntokens 65313472 Example 17700 of 34323 loss = 3.4966 nll loss = 2.1330 accu = 0.3695

Validating: Epoch 3 of 10 Step 59 ntokens 65313472 Example 18000 of 34323 loss = 3.4956 nll loss = 2.1337 accu = 0.3692

Validating: Epoch 3 of 10 Step 60 ntokens 65313472 Example 18300 of 34323 loss = 3.4961 nll loss = 2.1345 accu = 0.3690

Validating: Epoch 3 of 10 Step 61 ntokens 65313472 Example 18600 of 34323 loss = 3.4962 nll loss = 2.1337 accu = 0.3694

Validating: Epoch 3 of 10 Step 62 ntokens 65313472 Example 18900 of 34323 loss = 3.4969 nll loss = 2.1324 accu = 0.3698

Validating: Epoch 3 of 10 Step 63 ntokens 65313472 Example 19200 of 34323 loss = 3.4962 nll loss = 2.1322 accu = 0.3699

Validating: Epoch 3 of 10 Step 64 ntokens 65313472 Example 19500 of 34323 loss = 3.4951 nll loss = 2.1327 accu = 0.3697

Validating: Epoch 3 of 10 Step 65 ntokens 65313472 Example 19800 of 34323 loss = 3.4935 nll loss = 2.1327 accu = 0.3696

Validating: Epoch 3 of 10 Step 66 ntokens 65313472 Example 20100 of 34323 loss = 3.4928 nll loss = 2.1326 accu = 0.3697

Validating: Epoch 3 of 10 Step 67 ntokens 65313472 Example 20400 of 34323 loss = 3.4920 nll loss = 2.1328 accu = 0.3696

Validating: Epoch 3 of 10 Step 68 ntokens 65313472 Example 20700 of 34323 loss = 3.4913 nll loss = 2.1316 accu = 0.3699

Validating: Epoch 3 of 10 Step 69 ntokens 65313472 Example 21000 of 34323 loss = 3.4920 nll loss = 2.1329 accu = 0.3695

Validating: Epoch 3 of 10 Step 70 ntokens 65313472 Example 21300 of 34323 loss = 3.4924 nll loss = 2.1324 accu = 0.3697

Validating: Epoch 3 of 10 Step 71 ntokens 65313472 Example 21600 of 34323 loss = 3.4935 nll loss = 2.1332 accu = 0.3694

Validating: Epoch 3 of 10 Step 72 ntokens 65313472 Example 21900 of 34323 loss = 3.4927 nll loss = 2.1333 accu = 0.3694

Validating: Epoch 3 of 10 Step 73 ntokens 65313472 Example 22200 of 34323 loss = 3.4933 nll loss = 2.1334 accu = 0.3693

Validating: Epoch 3 of 10 Step 74 ntokens 65313472 Example 22500 of 34323 loss = 3.4932 nll loss = 2.1344 accu = 0.3690

Validating: Epoch 3 of 10 Step 75 ntokens 65313472 Example 22800 of 34323 loss = 3.4945 nll loss = 2.1335 accu = 0.3692

Validating: Epoch 3 of 10 Step 76 ntokens 65313472 Example 23100 of 34323 loss = 3.4955 nll loss = 2.1340 accu = 0.3691

Validating: Epoch 3 of 10 Step 77 ntokens 65313472 Example 23400 of 34323 loss = 3.4959 nll loss = 2.1338 accu = 0.3691

Validating: Epoch 3 of 10 Step 78 ntokens 65313472 Example 23700 of 34323 loss = 3.4964 nll loss = 2.1341 accu = 0.3690

Validating: Epoch 3 of 10 Step 79 ntokens 65313472 Example 24000 of 34323 loss = 3.4968 nll loss = 2.1341 accu = 0.3690

Validating: Epoch 3 of 10 Step 80 ntokens 65313472 Example 24300 of 34323 loss = 3.4969 nll loss = 2.1348 accu = 0.3688

Validating: Epoch 3 of 10 Step 81 ntokens 65313472 Example 24600 of 34323 loss = 3.4984 nll loss = 2.1352 accu = 0.3687

Validating: Epoch 3 of 10 Step 82 ntokens 65313472 Example 24900 of 34323 loss = 3.4975 nll loss = 2.1357 accu = 0.3684

Validating: Epoch 3 of 10 Step 83 ntokens 65313472 Example 25200 of 34323 loss = 3.4976 nll loss = 2.1359 accu = 0.3684

Validating: Epoch 3 of 10 Step 84 ntokens 65313472 Example 25500 of 34323 loss = 3.4981 nll loss = 2.1358 accu = 0.3684

Validating: Epoch 3 of 10 Step 85 ntokens 65313472 Example 25800 of 34323 loss = 3.4990 nll loss = 2.1351 accu = 0.3687

Validating: Epoch 3 of 10 Step 86 ntokens 65313472 Example 26100 of 34323 loss = 3.5002 nll loss = 2.1355 accu = 0.3685

Validating: Epoch 3 of 10 Step 87 ntokens 65313472 Example 26400 of 34323 loss = 3.5000 nll loss = 2.1349 accu = 0.3687

Validating: Epoch 3 of 10 Step 88 ntokens 65313472 Example 26700 of 34323 loss = 3.5005 nll loss = 2.1341 accu = 0.3690

Validating: Epoch 3 of 10 Step 89 ntokens 65313472 Example 27000 of 34323 loss = 3.5015 nll loss = 2.1345 accu = 0.3688

Validating: Epoch 3 of 10 Step 90 ntokens 65313472 Example 27300 of 34323 loss = 3.5023 nll loss = 2.1338 accu = 0.3691

Validating: Epoch 3 of 10 Step 91 ntokens 65313472 Example 27600 of 34323 loss = 3.5020 nll loss = 2.1339 accu = 0.3690

Validating: Epoch 3 of 10 Step 92 ntokens 65313472 Example 27900 of 34323 loss = 3.5017 nll loss = 2.1344 accu = 0.3688

Validating: Epoch 3 of 10 Step 93 ntokens 65313472 Example 28200 of 34323 loss = 3.5015 nll loss = 2.1345 accu = 0.3687

Validating: Epoch 3 of 10 Step 94 ntokens 65313472 Example 28500 of 34323 loss = 3.5018 nll loss = 2.1349 accu = 0.3686

Validating: Epoch 3 of 10 Step 95 ntokens 65313472 Example 28800 of 34323 loss = 3.5013 nll loss = 2.1351 accu = 0.3685

Validating: Epoch 3 of 10 Step 96 ntokens 65313472 Example 29100 of 34323 loss = 3.5025 nll loss = 2.1350 accu = 0.3686

Validating: Epoch 3 of 10 Step 97 ntokens 65313472 Example 29400 of 34323 loss = 3.5029 nll loss = 2.1337 accu = 0.3690

Validating: Epoch 3 of 10 Step 98 ntokens 65313472 Example 29700 of 34323 loss = 3.5021 nll loss = 2.1330 accu = 0.3693

Validating: Epoch 3 of 10 Step 99 ntokens 65313472 Example 30000 of 34323 loss = 3.5016 nll loss = 2.1326 accu = 0.3694

Validating: Epoch 3 of 10 Step 100 ntokens 65313472 Example 30300 of 34323 loss = 3.5012 nll loss = 2.1311 accu = 0.3700

Validating: Epoch 3 of 10 Step 101 ntokens 65313472 Example 30600 of 34323 loss = 3.5022 nll loss = 2.1312 accu = 0.3700

Validating: Epoch 3 of 10 Step 102 ntokens 65313472 Example 30900 of 34323 loss = 3.5027 nll loss = 2.1318 accu = 0.3698

Validating: Epoch 3 of 10 Step 103 ntokens 65313472 Example 31200 of 34323 loss = 3.5031 nll loss = 2.1307 accu = 0.3702

Validating: Epoch 3 of 10 Step 104 ntokens 65313472 Example 31500 of 34323 loss = 3.5039 nll loss = 2.1303 accu = 0.3703

Validating: Epoch 3 of 10 Step 105 ntokens 65313472 Example 31800 of 34323 loss = 3.5044 nll loss = 2.1299 accu = 0.3704

Validating: Epoch 3 of 10 Step 106 ntokens 65313472 Example 32100 of 34323 loss = 3.5039 nll loss = 2.1299 accu = 0.3704

Validating: Epoch 3 of 10 Step 107 ntokens 65313472 Example 32400 of 34323 loss = 3.5051 nll loss = 2.1309 accu = 0.3701

Validating: Epoch 3 of 10 Step 108 ntokens 65313472 Example 32700 of 34323 loss = 3.5049 nll loss = 2.1306 accu = 0.3701

Validating: Epoch 3 of 10 Step 109 ntokens 65313472 Example 33000 of 34323 loss = 3.5041 nll loss = 2.1308 accu = 0.3701

Validating: Epoch 3 of 10 Step 110 ntokens 65313472 Example 33300 of 34323 loss = 3.5045 nll loss = 2.1316 accu = 0.3698

Validating: Epoch 3 of 10 Step 111 ntokens 65313472 Example 33600 of 34323 loss = 3.5048 nll loss = 2.1320 accu = 0.3696

Validating: Epoch 3 of 10 Step 112 ntokens 65313472 Example 33900 of 34323 loss = 3.5044 nll loss = 2.1314 accu = 0.3699

Validating: Epoch 3 of 10 Step 113 ntokens 65313472 Example 34200 of 34323 loss = 3.5039 nll loss = 2.1317 accu = 0.3697

Validating: Epoch 3 of 10 Step 114 ntokens 65313472 Example 34323 of 34323 loss = 3.5034 nll loss = 2.1318 accu = 0.3697

Validation complete in 0:00:15.051865
Epoch complete in 0:02:30.280985
Training: Epoch 4 of 10 Step 1384 ntokens 114333976 Example 300 of 138376 loss = 3.5173 nll loss = 2.1263 accu = 0.3698

Training: Epoch 4 of 10 Step 1385 ntokens 114369376 Example 600 of 138376 loss = 3.5265 nll loss = 2.1514 accu = 0.3625

Training: Epoch 4 of 10 Step 1386 ntokens 114404776 Example 900 of 138376 loss = 3.5474 nll loss = 2.1421 accu = 0.3663

Training: Epoch 4 of 10 Step 1387 ntokens 114440176 Example 1200 of 138376 loss = 3.5573 nll loss = 2.1354 accu = 0.3692

Training: Epoch 4 of 10 Step 1388 ntokens 114475576 Example 1500 of 138376 loss = 3.5487 nll loss = 2.1307 accu = 0.3705

Training: Epoch 4 of 10 Step 1389 ntokens 114510976 Example 1800 of 138376 loss = 3.5356 nll loss = 2.1268 accu = 0.3728

Training: Epoch 4 of 10 Step 1390 ntokens 114546376 Example 2100 of 138376 loss = 3.5388 nll loss = 2.1225 accu = 0.3741

Training: Epoch 4 of 10 Step 1391 ntokens 114581776 Example 2400 of 138376 loss = 3.5384 nll loss = 2.1223 accu = 0.3740

Training: Epoch 4 of 10 Step 1392 ntokens 114617176 Example 2700 of 138376 loss = 3.5320 nll loss = 2.1246 accu = 0.3730

Training: Epoch 4 of 10 Step 1393 ntokens 114652576 Example 3000 of 138376 loss = 3.5376 nll loss = 2.1263 accu = 0.3724

Training: Epoch 4 of 10 Step 1394 ntokens 114687976 Example 3300 of 138376 loss = 3.5395 nll loss = 2.1273 accu = 0.3724

Training: Epoch 4 of 10 Step 1395 ntokens 114723376 Example 3600 of 138376 loss = 3.5325 nll loss = 2.1255 accu = 0.3729

Training: Epoch 4 of 10 Step 1396 ntokens 114758776 Example 3900 of 138376 loss = 3.5305 nll loss = 2.1210 accu = 0.3747

Training: Epoch 4 of 10 Step 1397 ntokens 114794176 Example 4200 of 138376 loss = 3.5251 nll loss = 2.1194 accu = 0.3751

Training: Epoch 4 of 10 Step 1398 ntokens 114829576 Example 4500 of 138376 loss = 3.5159 nll loss = 2.1242 accu = 0.3736

Training: Epoch 4 of 10 Step 1399 ntokens 114864976 Example 4800 of 138376 loss = 3.5133 nll loss = 2.1254 accu = 0.3733

Training: Epoch 4 of 10 Step 1400 ntokens 114900376 Example 5100 of 138376 loss = 3.5142 nll loss = 2.1232 accu = 0.3741

Training: Epoch 4 of 10 Step 1401 ntokens 114935776 Example 5400 of 138376 loss = 3.5140 nll loss = 2.1217 accu = 0.3744

Training: Epoch 4 of 10 Step 1402 ntokens 114971176 Example 5700 of 138376 loss = 3.5101 nll loss = 2.1237 accu = 0.3739

Training: Epoch 4 of 10 Step 1403 ntokens 115006576 Example 6000 of 138376 loss = 3.5099 nll loss = 2.1256 accu = 0.3733

Training: Epoch 4 of 10 Step 1404 ntokens 115041976 Example 6300 of 138376 loss = 3.5146 nll loss = 2.1249 accu = 0.3735

Training: Epoch 4 of 10 Step 1405 ntokens 115077376 Example 6600 of 138376 loss = 3.5154 nll loss = 2.1245 accu = 0.3737

Training: Epoch 4 of 10 Step 1406 ntokens 115112776 Example 6900 of 138376 loss = 3.5192 nll loss = 2.1225 accu = 0.3744

Training: Epoch 4 of 10 Step 1407 ntokens 115148176 Example 7200 of 138376 loss = 3.5160 nll loss = 2.1256 accu = 0.3733

Training: Epoch 4 of 10 Step 1408 ntokens 115183576 Example 7500 of 138376 loss = 3.5168 nll loss = 2.1223 accu = 0.3746

Training: Epoch 4 of 10 Step 1409 ntokens 115218976 Example 7800 of 138376 loss = 3.5185 nll loss = 2.1229 accu = 0.3743

Training: Epoch 4 of 10 Step 1410 ntokens 115254376 Example 8100 of 138376 loss = 3.5163 nll loss = 2.1201 accu = 0.3752

Training: Epoch 4 of 10 Step 1411 ntokens 115289776 Example 8400 of 138376 loss = 3.5170 nll loss = 2.1219 accu = 0.3745

Training: Epoch 4 of 10 Step 1412 ntokens 115325176 Example 8700 of 138376 loss = 3.5212 nll loss = 2.1215 accu = 0.3747

Training: Epoch 4 of 10 Step 1413 ntokens 115360576 Example 9000 of 138376 loss = 3.5212 nll loss = 2.1184 accu = 0.3758

Training: Epoch 4 of 10 Step 1414 ntokens 115395976 Example 9300 of 138376 loss = 3.5197 nll loss = 2.1229 accu = 0.3742

Training: Epoch 4 of 10 Step 1415 ntokens 115431376 Example 9600 of 138376 loss = 3.5197 nll loss = 2.1228 accu = 0.3742

Training: Epoch 4 of 10 Step 1416 ntokens 115466776 Example 9900 of 138376 loss = 3.5185 nll loss = 2.1205 accu = 0.3750

Training: Epoch 4 of 10 Step 1417 ntokens 115502176 Example 10200 of 138376 loss = 3.5204 nll loss = 2.1212 accu = 0.3748

Training: Epoch 4 of 10 Step 1418 ntokens 115537576 Example 10500 of 138376 loss = 3.5205 nll loss = 2.1227 accu = 0.3742

Training: Epoch 4 of 10 Step 1419 ntokens 115572976 Example 10800 of 138376 loss = 3.5198 nll loss = 2.1238 accu = 0.3737

Training: Epoch 4 of 10 Step 1420 ntokens 115608376 Example 11100 of 138376 loss = 3.5217 nll loss = 2.1256 accu = 0.3731

Training: Epoch 4 of 10 Step 1421 ntokens 115643776 Example 11400 of 138376 loss = 3.5219 nll loss = 2.1244 accu = 0.3736

Training: Epoch 4 of 10 Step 1422 ntokens 115679176 Example 11700 of 138376 loss = 3.5246 nll loss = 2.1270 accu = 0.3726

Training: Epoch 4 of 10 Step 1423 ntokens 115714576 Example 12000 of 138376 loss = 3.5217 nll loss = 2.1292 accu = 0.3718

Training: Epoch 4 of 10 Step 1424 ntokens 115749976 Example 12300 of 138376 loss = 3.5207 nll loss = 2.1285 accu = 0.3720

Training: Epoch 4 of 10 Step 1425 ntokens 115785376 Example 12600 of 138376 loss = 3.5201 nll loss = 2.1291 accu = 0.3718

Training: Epoch 4 of 10 Step 1426 ntokens 115820776 Example 12900 of 138376 loss = 3.5148 nll loss = 2.1274 accu = 0.3723

Training: Epoch 4 of 10 Step 1427 ntokens 115856176 Example 13200 of 138376 loss = 3.5169 nll loss = 2.1275 accu = 0.3723

Training: Epoch 4 of 10 Step 1428 ntokens 115891576 Example 13500 of 138376 loss = 3.5195 nll loss = 2.1266 accu = 0.3726

Training: Epoch 4 of 10 Step 1429 ntokens 115926976 Example 13800 of 138376 loss = 3.5190 nll loss = 2.1260 accu = 0.3728

Training: Epoch 4 of 10 Step 1430 ntokens 115962376 Example 14100 of 138376 loss = 3.5188 nll loss = 2.1284 accu = 0.3719

Training: Epoch 4 of 10 Step 1431 ntokens 115997776 Example 14400 of 138376 loss = 3.5177 nll loss = 2.1307 accu = 0.3711

Training: Epoch 4 of 10 Step 1432 ntokens 116033176 Example 14700 of 138376 loss = 3.5165 nll loss = 2.1320 accu = 0.3705

Training: Epoch 4 of 10 Step 1433 ntokens 116068576 Example 15000 of 138376 loss = 3.5143 nll loss = 2.1318 accu = 0.3705

Training: Epoch 4 of 10 Step 1434 ntokens 116103976 Example 15300 of 138376 loss = 3.5129 nll loss = 2.1319 accu = 0.3705

Training: Epoch 4 of 10 Step 1435 ntokens 116139376 Example 15600 of 138376 loss = 3.5140 nll loss = 2.1317 accu = 0.3706

Training: Epoch 4 of 10 Step 1436 ntokens 116174776 Example 15900 of 138376 loss = 3.5148 nll loss = 2.1317 accu = 0.3706

Training: Epoch 4 of 10 Step 1437 ntokens 116210176 Example 16200 of 138376 loss = 3.5134 nll loss = 2.1329 accu = 0.3701

Training: Epoch 4 of 10 Step 1438 ntokens 116245576 Example 16500 of 138376 loss = 3.5141 nll loss = 2.1322 accu = 0.3703

Training: Epoch 4 of 10 Step 1439 ntokens 116280976 Example 16800 of 138376 loss = 3.5128 nll loss = 2.1325 accu = 0.3702

Training: Epoch 4 of 10 Step 1440 ntokens 116316376 Example 17100 of 138376 loss = 3.5120 nll loss = 2.1308 accu = 0.3708

Training: Epoch 4 of 10 Step 1441 ntokens 116351776 Example 17400 of 138376 loss = 3.5116 nll loss = 2.1305 accu = 0.3709

Training: Epoch 4 of 10 Step 1442 ntokens 116387176 Example 17700 of 138376 loss = 3.5095 nll loss = 2.1309 accu = 0.3707

Training: Epoch 4 of 10 Step 1443 ntokens 116422576 Example 18000 of 138376 loss = 3.5091 nll loss = 2.1306 accu = 0.3709

Training: Epoch 4 of 10 Step 1444 ntokens 116457976 Example 18300 of 138376 loss = 3.5099 nll loss = 2.1303 accu = 0.3710

Training: Epoch 4 of 10 Step 1445 ntokens 116493376 Example 18600 of 138376 loss = 3.5102 nll loss = 2.1297 accu = 0.3711

Training: Epoch 4 of 10 Step 1446 ntokens 116528776 Example 18900 of 138376 loss = 3.5102 nll loss = 2.1308 accu = 0.3707

Training: Epoch 4 of 10 Step 1447 ntokens 116564176 Example 19200 of 138376 loss = 3.5097 nll loss = 2.1305 accu = 0.3708

Training: Epoch 4 of 10 Step 1448 ntokens 116599576 Example 19500 of 138376 loss = 3.5084 nll loss = 2.1307 accu = 0.3708

Training: Epoch 4 of 10 Step 1449 ntokens 116634976 Example 19800 of 138376 loss = 3.5078 nll loss = 2.1298 accu = 0.3711

Training: Epoch 4 of 10 Step 1450 ntokens 116670376 Example 20100 of 138376 loss = 3.5073 nll loss = 2.1300 accu = 0.3710

Training: Epoch 4 of 10 Step 1451 ntokens 116705776 Example 20400 of 138376 loss = 3.5071 nll loss = 2.1301 accu = 0.3710

Training: Epoch 4 of 10 Step 1452 ntokens 116741176 Example 20700 of 138376 loss = 3.5063 nll loss = 2.1304 accu = 0.3709

Training: Epoch 4 of 10 Step 1453 ntokens 116776576 Example 21000 of 138376 loss = 3.5059 nll loss = 2.1290 accu = 0.3714

Training: Epoch 4 of 10 Step 1454 ntokens 116811976 Example 21300 of 138376 loss = 3.5069 nll loss = 2.1284 accu = 0.3716

Training: Epoch 4 of 10 Step 1455 ntokens 116847376 Example 21600 of 138376 loss = 3.5083 nll loss = 2.1287 accu = 0.3715

Training: Epoch 4 of 10 Step 1456 ntokens 116882776 Example 21900 of 138376 loss = 3.5095 nll loss = 2.1290 accu = 0.3714

Training: Epoch 4 of 10 Step 1457 ntokens 116918176 Example 22200 of 138376 loss = 3.5087 nll loss = 2.1280 accu = 0.3717

Training: Epoch 4 of 10 Step 1458 ntokens 116953576 Example 22500 of 138376 loss = 3.5084 nll loss = 2.1283 accu = 0.3717

Training: Epoch 4 of 10 Step 1459 ntokens 116988976 Example 22800 of 138376 loss = 3.5097 nll loss = 2.1290 accu = 0.3714

Training: Epoch 4 of 10 Step 1460 ntokens 117024376 Example 23100 of 138376 loss = 3.5100 nll loss = 2.1297 accu = 0.3711

Training: Epoch 4 of 10 Step 1461 ntokens 117059776 Example 23400 of 138376 loss = 3.5098 nll loss = 2.1285 accu = 0.3716

Training: Epoch 4 of 10 Step 1462 ntokens 117095176 Example 23700 of 138376 loss = 3.5102 nll loss = 2.1289 accu = 0.3714

Training: Epoch 4 of 10 Step 1463 ntokens 117130576 Example 24000 of 138376 loss = 3.5097 nll loss = 2.1289 accu = 0.3714

Training: Epoch 4 of 10 Step 1464 ntokens 117165976 Example 24300 of 138376 loss = 3.5095 nll loss = 2.1289 accu = 0.3715

Training: Epoch 4 of 10 Step 1465 ntokens 117201376 Example 24600 of 138376 loss = 3.5097 nll loss = 2.1286 accu = 0.3716

Training: Epoch 4 of 10 Step 1466 ntokens 117236776 Example 24900 of 138376 loss = 3.5099 nll loss = 2.1282 accu = 0.3717

Training: Epoch 4 of 10 Step 1467 ntokens 117272176 Example 25200 of 138376 loss = 3.5096 nll loss = 2.1282 accu = 0.3717

Training: Epoch 4 of 10 Step 1468 ntokens 117307576 Example 25500 of 138376 loss = 3.5108 nll loss = 2.1275 accu = 0.3720

Training: Epoch 4 of 10 Step 1469 ntokens 117342976 Example 25800 of 138376 loss = 3.5100 nll loss = 2.1276 accu = 0.3719

Training: Epoch 4 of 10 Step 1470 ntokens 117378376 Example 26100 of 138376 loss = 3.5087 nll loss = 2.1276 accu = 0.3719

Training: Epoch 4 of 10 Step 1471 ntokens 117413776 Example 26400 of 138376 loss = 3.5079 nll loss = 2.1275 accu = 0.3719

Training: Epoch 4 of 10 Step 1472 ntokens 117449176 Example 26700 of 138376 loss = 3.5089 nll loss = 2.1271 accu = 0.3720

Training: Epoch 4 of 10 Step 1473 ntokens 117484576 Example 27000 of 138376 loss = 3.5085 nll loss = 2.1272 accu = 0.3721

Training: Epoch 4 of 10 Step 1474 ntokens 117519976 Example 27300 of 138376 loss = 3.5079 nll loss = 2.1279 accu = 0.3718

Training: Epoch 4 of 10 Step 1475 ntokens 117555376 Example 27600 of 138376 loss = 3.5075 nll loss = 2.1277 accu = 0.3718

Training: Epoch 4 of 10 Step 1476 ntokens 117590776 Example 27900 of 138376 loss = 3.5072 nll loss = 2.1268 accu = 0.3721

Training: Epoch 4 of 10 Step 1477 ntokens 117626176 Example 28200 of 138376 loss = 3.5076 nll loss = 2.1277 accu = 0.3718

Training: Epoch 4 of 10 Step 1478 ntokens 117661576 Example 28500 of 138376 loss = 3.5068 nll loss = 2.1284 accu = 0.3716

Training: Epoch 4 of 10 Step 1479 ntokens 117696976 Example 28800 of 138376 loss = 3.5080 nll loss = 2.1288 accu = 0.3714

Training: Epoch 4 of 10 Step 1480 ntokens 117732376 Example 29100 of 138376 loss = 3.5074 nll loss = 2.1291 accu = 0.3713

Training: Epoch 4 of 10 Step 1481 ntokens 117767776 Example 29400 of 138376 loss = 3.5087 nll loss = 2.1288 accu = 0.3714

Training: Epoch 4 of 10 Step 1482 ntokens 117803176 Example 29700 of 138376 loss = 3.5083 nll loss = 2.1283 accu = 0.3716

Training: Epoch 4 of 10 Step 1483 ntokens 117838576 Example 30000 of 138376 loss = 3.5081 nll loss = 2.1286 accu = 0.3715

Training: Epoch 4 of 10 Step 1484 ntokens 117873976 Example 30300 of 138376 loss = 3.5083 nll loss = 2.1280 accu = 0.3717

Training: Epoch 4 of 10 Step 1485 ntokens 117909376 Example 30600 of 138376 loss = 3.5068 nll loss = 2.1283 accu = 0.3715

Training: Epoch 4 of 10 Step 1486 ntokens 117944776 Example 30900 of 138376 loss = 3.5063 nll loss = 2.1284 accu = 0.3715

Training: Epoch 4 of 10 Step 1487 ntokens 117980176 Example 31200 of 138376 loss = 3.5054 nll loss = 2.1286 accu = 0.3715

Training: Epoch 4 of 10 Step 1488 ntokens 118015576 Example 31500 of 138376 loss = 3.5059 nll loss = 2.1287 accu = 0.3715

Training: Epoch 4 of 10 Step 1489 ntokens 118050976 Example 31800 of 138376 loss = 3.5052 nll loss = 2.1291 accu = 0.3714

Training: Epoch 4 of 10 Step 1490 ntokens 118086376 Example 32100 of 138376 loss = 3.5051 nll loss = 2.1287 accu = 0.3715

Training: Epoch 4 of 10 Step 1491 ntokens 118121776 Example 32400 of 138376 loss = 3.5053 nll loss = 2.1283 accu = 0.3717

Training: Epoch 4 of 10 Step 1492 ntokens 118157176 Example 32700 of 138376 loss = 3.5051 nll loss = 2.1281 accu = 0.3717

Training: Epoch 4 of 10 Step 1493 ntokens 118192576 Example 33000 of 138376 loss = 3.5048 nll loss = 2.1282 accu = 0.3717

Training: Epoch 4 of 10 Step 1494 ntokens 118227976 Example 33300 of 138376 loss = 3.5040 nll loss = 2.1285 accu = 0.3715

Training: Epoch 4 of 10 Step 1495 ntokens 118263376 Example 33600 of 138376 loss = 3.5037 nll loss = 2.1287 accu = 0.3715

Training: Epoch 4 of 10 Step 1496 ntokens 118298776 Example 33900 of 138376 loss = 3.5040 nll loss = 2.1286 accu = 0.3715

Training: Epoch 4 of 10 Step 1497 ntokens 118334176 Example 34200 of 138376 loss = 3.5047 nll loss = 2.1283 accu = 0.3716

Training: Epoch 4 of 10 Step 1498 ntokens 118369576 Example 34500 of 138376 loss = 3.5053 nll loss = 2.1282 accu = 0.3716

Training: Epoch 4 of 10 Step 1499 ntokens 118404976 Example 34800 of 138376 loss = 3.5065 nll loss = 2.1282 accu = 0.3716

Training: Epoch 4 of 10 Step 1500 ntokens 118440376 Example 35100 of 138376 loss = 3.5062 nll loss = 2.1279 accu = 0.3718

Training: Epoch 4 of 10 Step 1501 ntokens 118475776 Example 35400 of 138376 loss = 3.5067 nll loss = 2.1277 accu = 0.3718

Training: Epoch 4 of 10 Step 1502 ntokens 118511176 Example 35700 of 138376 loss = 3.5067 nll loss = 2.1275 accu = 0.3719

Training: Epoch 4 of 10 Step 1503 ntokens 118546576 Example 36000 of 138376 loss = 3.5064 nll loss = 2.1279 accu = 0.3717

Training: Epoch 4 of 10 Step 1504 ntokens 118581976 Example 36300 of 138376 loss = 3.5073 nll loss = 2.1274 accu = 0.3719

Training: Epoch 4 of 10 Step 1505 ntokens 118617376 Example 36600 of 138376 loss = 3.5075 nll loss = 2.1269 accu = 0.3721

Training: Epoch 4 of 10 Step 1506 ntokens 118652776 Example 36900 of 138376 loss = 3.5078 nll loss = 2.1272 accu = 0.3720

Training: Epoch 4 of 10 Step 1507 ntokens 118688176 Example 37200 of 138376 loss = 3.5079 nll loss = 2.1271 accu = 0.3720

Training: Epoch 4 of 10 Step 1508 ntokens 118723576 Example 37500 of 138376 loss = 3.5088 nll loss = 2.1275 accu = 0.3719

Training: Epoch 4 of 10 Step 1509 ntokens 118758976 Example 37800 of 138376 loss = 3.5088 nll loss = 2.1275 accu = 0.3719

Training: Epoch 4 of 10 Step 1510 ntokens 118794376 Example 38100 of 138376 loss = 3.5093 nll loss = 2.1271 accu = 0.3720

Training: Epoch 4 of 10 Step 1511 ntokens 118829776 Example 38400 of 138376 loss = 3.5087 nll loss = 2.1274 accu = 0.3719

Training: Epoch 4 of 10 Step 1512 ntokens 118865176 Example 38700 of 138376 loss = 3.5086 nll loss = 2.1272 accu = 0.3720

Training: Epoch 4 of 10 Step 1513 ntokens 118900576 Example 39000 of 138376 loss = 3.5088 nll loss = 2.1275 accu = 0.3719

Training: Epoch 4 of 10 Step 1514 ntokens 118935976 Example 39300 of 138376 loss = 3.5094 nll loss = 2.1271 accu = 0.3720

Training: Epoch 4 of 10 Step 1515 ntokens 118971376 Example 39600 of 138376 loss = 3.5091 nll loss = 2.1276 accu = 0.3718

Training: Epoch 4 of 10 Step 1516 ntokens 119006776 Example 39900 of 138376 loss = 3.5090 nll loss = 2.1281 accu = 0.3716

Training: Epoch 4 of 10 Step 1517 ntokens 119042176 Example 40200 of 138376 loss = 3.5086 nll loss = 2.1279 accu = 0.3717

Training: Epoch 4 of 10 Step 1518 ntokens 119077576 Example 40500 of 138376 loss = 3.5086 nll loss = 2.1280 accu = 0.3716

Training: Epoch 4 of 10 Step 1519 ntokens 119112976 Example 40800 of 138376 loss = 3.5081 nll loss = 2.1289 accu = 0.3713

Training: Epoch 4 of 10 Step 1520 ntokens 119148376 Example 41100 of 138376 loss = 3.5086 nll loss = 2.1288 accu = 0.3713

Training: Epoch 4 of 10 Step 1521 ntokens 119183776 Example 41400 of 138376 loss = 3.5086 nll loss = 2.1291 accu = 0.3712

Training: Epoch 4 of 10 Step 1522 ntokens 119219176 Example 41700 of 138376 loss = 3.5088 nll loss = 2.1287 accu = 0.3713

Training: Epoch 4 of 10 Step 1523 ntokens 119254576 Example 42000 of 138376 loss = 3.5088 nll loss = 2.1294 accu = 0.3711

Training: Epoch 4 of 10 Step 1524 ntokens 119289976 Example 42300 of 138376 loss = 3.5096 nll loss = 2.1289 accu = 0.3712

Training: Epoch 4 of 10 Step 1525 ntokens 119325376 Example 42600 of 138376 loss = 3.5094 nll loss = 2.1285 accu = 0.3714

Training: Epoch 4 of 10 Step 1526 ntokens 119360776 Example 42900 of 138376 loss = 3.5097 nll loss = 2.1283 accu = 0.3715

Training: Epoch 4 of 10 Step 1527 ntokens 119396176 Example 43200 of 138376 loss = 3.5094 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1528 ntokens 119431576 Example 43500 of 138376 loss = 3.5092 nll loss = 2.1282 accu = 0.3715

Training: Epoch 4 of 10 Step 1529 ntokens 119466976 Example 43800 of 138376 loss = 3.5097 nll loss = 2.1276 accu = 0.3717

Training: Epoch 4 of 10 Step 1530 ntokens 119502376 Example 44100 of 138376 loss = 3.5098 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1531 ntokens 119537776 Example 44400 of 138376 loss = 3.5099 nll loss = 2.1276 accu = 0.3717

Training: Epoch 4 of 10 Step 1532 ntokens 119573176 Example 44700 of 138376 loss = 3.5100 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1533 ntokens 119608576 Example 45000 of 138376 loss = 3.5097 nll loss = 2.1269 accu = 0.3719

Training: Epoch 4 of 10 Step 1534 ntokens 119643976 Example 45300 of 138376 loss = 3.5097 nll loss = 2.1273 accu = 0.3717

Training: Epoch 4 of 10 Step 1535 ntokens 119679376 Example 45600 of 138376 loss = 3.5094 nll loss = 2.1272 accu = 0.3717

Training: Epoch 4 of 10 Step 1536 ntokens 119714776 Example 45900 of 138376 loss = 3.5092 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1537 ntokens 119750176 Example 46200 of 138376 loss = 3.5093 nll loss = 2.1280 accu = 0.3715

Training: Epoch 4 of 10 Step 1538 ntokens 119785576 Example 46500 of 138376 loss = 3.5096 nll loss = 2.1278 accu = 0.3715

Training: Epoch 4 of 10 Step 1539 ntokens 119820976 Example 46800 of 138376 loss = 3.5104 nll loss = 2.1275 accu = 0.3716

Training: Epoch 4 of 10 Step 1540 ntokens 119856376 Example 47100 of 138376 loss = 3.5098 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1541 ntokens 119891776 Example 47400 of 138376 loss = 3.5102 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1542 ntokens 119927176 Example 47700 of 138376 loss = 3.5095 nll loss = 2.1273 accu = 0.3717

Training: Epoch 4 of 10 Step 1543 ntokens 119962576 Example 48000 of 138376 loss = 3.5095 nll loss = 2.1273 accu = 0.3717

Training: Epoch 4 of 10 Step 1544 ntokens 119997976 Example 48300 of 138376 loss = 3.5104 nll loss = 2.1272 accu = 0.3717

Training: Epoch 4 of 10 Step 1545 ntokens 120033376 Example 48600 of 138376 loss = 3.5101 nll loss = 2.1281 accu = 0.3714

Training: Epoch 4 of 10 Step 1546 ntokens 120068776 Example 48900 of 138376 loss = 3.5095 nll loss = 2.1285 accu = 0.3713

Training: Epoch 4 of 10 Step 1547 ntokens 120104176 Example 49200 of 138376 loss = 3.5092 nll loss = 2.1285 accu = 0.3713

Training: Epoch 4 of 10 Step 1548 ntokens 120139576 Example 49500 of 138376 loss = 3.5087 nll loss = 2.1285 accu = 0.3713

Training: Epoch 4 of 10 Step 1549 ntokens 120174976 Example 49800 of 138376 loss = 3.5084 nll loss = 2.1283 accu = 0.3714

Training: Epoch 4 of 10 Step 1550 ntokens 120210376 Example 50100 of 138376 loss = 3.5086 nll loss = 2.1286 accu = 0.3712

Training: Epoch 4 of 10 Step 1551 ntokens 120245776 Example 50400 of 138376 loss = 3.5086 nll loss = 2.1283 accu = 0.3713

Training: Epoch 4 of 10 Step 1552 ntokens 120281176 Example 50700 of 138376 loss = 3.5088 nll loss = 2.1288 accu = 0.3712

Training: Epoch 4 of 10 Step 1553 ntokens 120316576 Example 51000 of 138376 loss = 3.5089 nll loss = 2.1289 accu = 0.3711

Training: Epoch 4 of 10 Step 1554 ntokens 120351976 Example 51300 of 138376 loss = 3.5091 nll loss = 2.1289 accu = 0.3711

Training: Epoch 4 of 10 Step 1555 ntokens 120387376 Example 51600 of 138376 loss = 3.5087 nll loss = 2.1287 accu = 0.3712

Training: Epoch 4 of 10 Step 1556 ntokens 120422776 Example 51900 of 138376 loss = 3.5085 nll loss = 2.1283 accu = 0.3714

Training: Epoch 4 of 10 Step 1557 ntokens 120458176 Example 52200 of 138376 loss = 3.5091 nll loss = 2.1287 accu = 0.3712

Training: Epoch 4 of 10 Step 1558 ntokens 120493576 Example 52500 of 138376 loss = 3.5087 nll loss = 2.1289 accu = 0.3711

Training: Epoch 4 of 10 Step 1559 ntokens 120528976 Example 52800 of 138376 loss = 3.5086 nll loss = 2.1290 accu = 0.3711

Training: Epoch 4 of 10 Step 1560 ntokens 120564376 Example 53100 of 138376 loss = 3.5082 nll loss = 2.1292 accu = 0.3710

Training: Epoch 4 of 10 Step 1561 ntokens 120599776 Example 53400 of 138376 loss = 3.5085 nll loss = 2.1294 accu = 0.3709

Training: Epoch 4 of 10 Step 1562 ntokens 120635176 Example 53700 of 138376 loss = 3.5085 nll loss = 2.1297 accu = 0.3709

Training: Epoch 4 of 10 Step 1563 ntokens 120670576 Example 54000 of 138376 loss = 3.5087 nll loss = 2.1294 accu = 0.3710

Training: Epoch 4 of 10 Step 1564 ntokens 120705976 Example 54300 of 138376 loss = 3.5082 nll loss = 2.1292 accu = 0.3710

Training: Epoch 4 of 10 Step 1565 ntokens 120741376 Example 54600 of 138376 loss = 3.5087 nll loss = 2.1294 accu = 0.3710

Training: Epoch 4 of 10 Step 1566 ntokens 120776776 Example 54900 of 138376 loss = 3.5086 nll loss = 2.1296 accu = 0.3709

Training: Epoch 4 of 10 Step 1567 ntokens 120812176 Example 55200 of 138376 loss = 3.5087 nll loss = 2.1298 accu = 0.3708

Training: Epoch 4 of 10 Step 1568 ntokens 120847576 Example 55500 of 138376 loss = 3.5092 nll loss = 2.1298 accu = 0.3708

Training: Epoch 4 of 10 Step 1569 ntokens 120882976 Example 55800 of 138376 loss = 3.5095 nll loss = 2.1296 accu = 0.3709

Training: Epoch 4 of 10 Step 1570 ntokens 120918376 Example 56100 of 138376 loss = 3.5096 nll loss = 2.1293 accu = 0.3710

Training: Epoch 4 of 10 Step 1571 ntokens 120953776 Example 56400 of 138376 loss = 3.5094 nll loss = 2.1294 accu = 0.3710

Training: Epoch 4 of 10 Step 1572 ntokens 120989176 Example 56700 of 138376 loss = 3.5094 nll loss = 2.1295 accu = 0.3709

Training: Epoch 4 of 10 Step 1573 ntokens 121024576 Example 57000 of 138376 loss = 3.5092 nll loss = 2.1297 accu = 0.3709

Training: Epoch 4 of 10 Step 1574 ntokens 121059976 Example 57300 of 138376 loss = 3.5088 nll loss = 2.1296 accu = 0.3709

Training: Epoch 4 of 10 Step 1575 ntokens 121095376 Example 57600 of 138376 loss = 3.5089 nll loss = 2.1293 accu = 0.3710

Training: Epoch 4 of 10 Step 1576 ntokens 121130776 Example 57900 of 138376 loss = 3.5091 nll loss = 2.1293 accu = 0.3710

Training: Epoch 4 of 10 Step 1577 ntokens 121166176 Example 58200 of 138376 loss = 3.5090 nll loss = 2.1292 accu = 0.3711

Training: Epoch 4 of 10 Step 1578 ntokens 121201576 Example 58500 of 138376 loss = 3.5086 nll loss = 2.1290 accu = 0.3711

Training: Epoch 4 of 10 Step 1579 ntokens 121236976 Example 58800 of 138376 loss = 3.5091 nll loss = 2.1292 accu = 0.3711

Training: Epoch 4 of 10 Step 1580 ntokens 121272376 Example 59100 of 138376 loss = 3.5093 nll loss = 2.1294 accu = 0.3710

Training: Epoch 4 of 10 Step 1581 ntokens 121307776 Example 59400 of 138376 loss = 3.5092 nll loss = 2.1293 accu = 0.3711

Training: Epoch 4 of 10 Step 1582 ntokens 121343176 Example 59700 of 138376 loss = 3.5087 nll loss = 2.1291 accu = 0.3711

Training: Epoch 4 of 10 Step 1583 ntokens 121378576 Example 60000 of 138376 loss = 3.5081 nll loss = 2.1289 accu = 0.3712

Training: Epoch 4 of 10 Step 1584 ntokens 121413976 Example 60300 of 138376 loss = 3.5084 nll loss = 2.1286 accu = 0.3713

Training: Epoch 4 of 10 Step 1585 ntokens 121449376 Example 60600 of 138376 loss = 3.5081 nll loss = 2.1290 accu = 0.3712

Training: Epoch 4 of 10 Step 1586 ntokens 121484776 Example 60900 of 138376 loss = 3.5080 nll loss = 2.1291 accu = 0.3712

Training: Epoch 4 of 10 Step 1587 ntokens 121520176 Example 61200 of 138376 loss = 3.5079 nll loss = 2.1293 accu = 0.3711

Training: Epoch 4 of 10 Step 1588 ntokens 121555576 Example 61500 of 138376 loss = 3.5077 nll loss = 2.1294 accu = 0.3711

Training: Epoch 4 of 10 Step 1589 ntokens 121590976 Example 61800 of 138376 loss = 3.5074 nll loss = 2.1294 accu = 0.3711

Training: Epoch 4 of 10 Step 1590 ntokens 121626376 Example 62100 of 138376 loss = 3.5071 nll loss = 2.1293 accu = 0.3711

Training: Epoch 4 of 10 Step 1591 ntokens 121661776 Example 62400 of 138376 loss = 3.5073 nll loss = 2.1294 accu = 0.3711

Training: Epoch 4 of 10 Step 1592 ntokens 121697176 Example 62700 of 138376 loss = 3.5073 nll loss = 2.1297 accu = 0.3709

Training: Epoch 4 of 10 Step 1593 ntokens 121732576 Example 63000 of 138376 loss = 3.5073 nll loss = 2.1296 accu = 0.3710

Training: Epoch 4 of 10 Step 1594 ntokens 121767976 Example 63300 of 138376 loss = 3.5073 nll loss = 2.1293 accu = 0.3711

Training: Epoch 4 of 10 Step 1595 ntokens 121803376 Example 63600 of 138376 loss = 3.5074 nll loss = 2.1292 accu = 0.3711

Training: Epoch 4 of 10 Step 1596 ntokens 121838776 Example 63900 of 138376 loss = 3.5073 nll loss = 2.1290 accu = 0.3712

Training: Epoch 4 of 10 Step 1597 ntokens 121874176 Example 64200 of 138376 loss = 3.5073 nll loss = 2.1291 accu = 0.3711

Training: Epoch 4 of 10 Step 1598 ntokens 121909576 Example 64500 of 138376 loss = 3.5075 nll loss = 2.1289 accu = 0.3712

Training: Epoch 4 of 10 Step 1599 ntokens 121944976 Example 64800 of 138376 loss = 3.5077 nll loss = 2.1289 accu = 0.3712

Training: Epoch 4 of 10 Step 1600 ntokens 121980376 Example 65100 of 138376 loss = 3.5076 nll loss = 2.1288 accu = 0.3713

Training: Epoch 4 of 10 Step 1601 ntokens 122015776 Example 65400 of 138376 loss = 3.5071 nll loss = 2.1286 accu = 0.3713

Training: Epoch 4 of 10 Step 1602 ntokens 122051176 Example 65700 of 138376 loss = 3.5075 nll loss = 2.1287 accu = 0.3713

Training: Epoch 4 of 10 Step 1603 ntokens 122086576 Example 66000 of 138376 loss = 3.5066 nll loss = 2.1291 accu = 0.3711

Training: Epoch 4 of 10 Step 1604 ntokens 122121976 Example 66300 of 138376 loss = 3.5065 nll loss = 2.1293 accu = 0.3711

Training: Epoch 4 of 10 Step 1605 ntokens 122157376 Example 66600 of 138376 loss = 3.5072 nll loss = 2.1292 accu = 0.3711

Training: Epoch 4 of 10 Step 1606 ntokens 122192776 Example 66900 of 138376 loss = 3.5072 nll loss = 2.1291 accu = 0.3711

Training: Epoch 4 of 10 Step 1607 ntokens 122228176 Example 67200 of 138376 loss = 3.5068 nll loss = 2.1290 accu = 0.3712

Training: Epoch 4 of 10 Step 1608 ntokens 122263576 Example 67500 of 138376 loss = 3.5069 nll loss = 2.1290 accu = 0.3712

Training: Epoch 4 of 10 Step 1609 ntokens 122298976 Example 67800 of 138376 loss = 3.5071 nll loss = 2.1287 accu = 0.3713

Training: Epoch 4 of 10 Step 1610 ntokens 122334376 Example 68100 of 138376 loss = 3.5071 nll loss = 2.1289 accu = 0.3712

Training: Epoch 4 of 10 Step 1611 ntokens 122369776 Example 68400 of 138376 loss = 3.5073 nll loss = 2.1290 accu = 0.3711

Training: Epoch 4 of 10 Step 1612 ntokens 122405176 Example 68700 of 138376 loss = 3.5072 nll loss = 2.1286 accu = 0.3713

Training: Epoch 4 of 10 Step 1613 ntokens 122440576 Example 69000 of 138376 loss = 3.5072 nll loss = 2.1285 accu = 0.3713

Training: Epoch 4 of 10 Step 1614 ntokens 122475976 Example 69300 of 138376 loss = 3.5070 nll loss = 2.1280 accu = 0.3715

Training: Epoch 4 of 10 Step 1615 ntokens 122511376 Example 69600 of 138376 loss = 3.5071 nll loss = 2.1279 accu = 0.3716

Training: Epoch 4 of 10 Step 1616 ntokens 122546776 Example 69900 of 138376 loss = 3.5073 nll loss = 2.1279 accu = 0.3715

Training: Epoch 4 of 10 Step 1617 ntokens 122582176 Example 70200 of 138376 loss = 3.5071 nll loss = 2.1279 accu = 0.3716

Training: Epoch 4 of 10 Step 1618 ntokens 122617576 Example 70500 of 138376 loss = 3.5072 nll loss = 2.1283 accu = 0.3714

Training: Epoch 4 of 10 Step 1619 ntokens 122652976 Example 70800 of 138376 loss = 3.5067 nll loss = 2.1283 accu = 0.3715

Training: Epoch 4 of 10 Step 1620 ntokens 122688376 Example 71100 of 138376 loss = 3.5069 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1621 ntokens 122723776 Example 71400 of 138376 loss = 3.5068 nll loss = 2.1280 accu = 0.3715

Training: Epoch 4 of 10 Step 1622 ntokens 122759176 Example 71700 of 138376 loss = 3.5071 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1623 ntokens 122794576 Example 72000 of 138376 loss = 3.5071 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1624 ntokens 122829976 Example 72300 of 138376 loss = 3.5069 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1625 ntokens 122865376 Example 72600 of 138376 loss = 3.5071 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1626 ntokens 122900776 Example 72900 of 138376 loss = 3.5071 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1627 ntokens 122936176 Example 73200 of 138376 loss = 3.5071 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1628 ntokens 122971576 Example 73500 of 138376 loss = 3.5073 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1629 ntokens 123006976 Example 73800 of 138376 loss = 3.5076 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1630 ntokens 123042376 Example 74100 of 138376 loss = 3.5079 nll loss = 2.1281 accu = 0.3715

Training: Epoch 4 of 10 Step 1631 ntokens 123077776 Example 74400 of 138376 loss = 3.5079 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1632 ntokens 123113176 Example 74700 of 138376 loss = 3.5083 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1633 ntokens 123148576 Example 75000 of 138376 loss = 3.5087 nll loss = 2.1278 accu = 0.3716

Training: Epoch 4 of 10 Step 1634 ntokens 123183976 Example 75300 of 138376 loss = 3.5086 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1635 ntokens 123219376 Example 75600 of 138376 loss = 3.5087 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1636 ntokens 123254776 Example 75900 of 138376 loss = 3.5085 nll loss = 2.1275 accu = 0.3717

Training: Epoch 4 of 10 Step 1637 ntokens 123290176 Example 76200 of 138376 loss = 3.5083 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1638 ntokens 123325576 Example 76500 of 138376 loss = 3.5083 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1639 ntokens 123360976 Example 76800 of 138376 loss = 3.5080 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1640 ntokens 123396376 Example 77100 of 138376 loss = 3.5079 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1641 ntokens 123431776 Example 77400 of 138376 loss = 3.5076 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1642 ntokens 123467176 Example 77700 of 138376 loss = 3.5073 nll loss = 2.1273 accu = 0.3718

Training: Epoch 4 of 10 Step 1643 ntokens 123502576 Example 78000 of 138376 loss = 3.5073 nll loss = 2.1268 accu = 0.3719

Training: Epoch 4 of 10 Step 1644 ntokens 123537976 Example 78300 of 138376 loss = 3.5074 nll loss = 2.1269 accu = 0.3719

Training: Epoch 4 of 10 Step 1645 ntokens 123573376 Example 78600 of 138376 loss = 3.5076 nll loss = 2.1269 accu = 0.3719

Training: Epoch 4 of 10 Step 1646 ntokens 123608776 Example 78900 of 138376 loss = 3.5077 nll loss = 2.1269 accu = 0.3719

Training: Epoch 4 of 10 Step 1647 ntokens 123644176 Example 79200 of 138376 loss = 3.5077 nll loss = 2.1266 accu = 0.3720

Training: Epoch 4 of 10 Step 1648 ntokens 123679576 Example 79500 of 138376 loss = 3.5076 nll loss = 2.1267 accu = 0.3720

Training: Epoch 4 of 10 Step 1649 ntokens 123714976 Example 79800 of 138376 loss = 3.5073 nll loss = 2.1265 accu = 0.3720

Training: Epoch 4 of 10 Step 1650 ntokens 123750376 Example 80100 of 138376 loss = 3.5072 nll loss = 2.1266 accu = 0.3720

Training: Epoch 4 of 10 Step 1651 ntokens 123785776 Example 80400 of 138376 loss = 3.5073 nll loss = 2.1272 accu = 0.3718

Training: Epoch 4 of 10 Step 1652 ntokens 123821176 Example 80700 of 138376 loss = 3.5076 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1653 ntokens 123856576 Example 81000 of 138376 loss = 3.5076 nll loss = 2.1270 accu = 0.3719

Training: Epoch 4 of 10 Step 1654 ntokens 123891976 Example 81300 of 138376 loss = 3.5075 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1655 ntokens 123927376 Example 81600 of 138376 loss = 3.5078 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1656 ntokens 123962776 Example 81900 of 138376 loss = 3.5077 nll loss = 2.1272 accu = 0.3718

Training: Epoch 4 of 10 Step 1657 ntokens 123998176 Example 82200 of 138376 loss = 3.5084 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1658 ntokens 124033576 Example 82500 of 138376 loss = 3.5084 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1659 ntokens 124068976 Example 82800 of 138376 loss = 3.5084 nll loss = 2.1270 accu = 0.3719

Training: Epoch 4 of 10 Step 1660 ntokens 124104376 Example 83100 of 138376 loss = 3.5083 nll loss = 2.1273 accu = 0.3717

Training: Epoch 4 of 10 Step 1661 ntokens 124139776 Example 83400 of 138376 loss = 3.5082 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1662 ntokens 124175176 Example 83700 of 138376 loss = 3.5085 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1663 ntokens 124210576 Example 84000 of 138376 loss = 3.5083 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1664 ntokens 124245976 Example 84300 of 138376 loss = 3.5081 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1665 ntokens 124281376 Example 84600 of 138376 loss = 3.5086 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1666 ntokens 124316776 Example 84900 of 138376 loss = 3.5083 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1667 ntokens 124352176 Example 85200 of 138376 loss = 3.5082 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1668 ntokens 124387576 Example 85500 of 138376 loss = 3.5084 nll loss = 2.1272 accu = 0.3718

Training: Epoch 4 of 10 Step 1669 ntokens 124422976 Example 85800 of 138376 loss = 3.5087 nll loss = 2.1272 accu = 0.3718

Training: Epoch 4 of 10 Step 1670 ntokens 124458376 Example 86100 of 138376 loss = 3.5091 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1671 ntokens 124493776 Example 86400 of 138376 loss = 3.5090 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1672 ntokens 124529176 Example 86700 of 138376 loss = 3.5093 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1673 ntokens 124564576 Example 87000 of 138376 loss = 3.5094 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1674 ntokens 124599976 Example 87300 of 138376 loss = 3.5096 nll loss = 2.1275 accu = 0.3716

Training: Epoch 4 of 10 Step 1675 ntokens 124635376 Example 87600 of 138376 loss = 3.5092 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1676 ntokens 124670776 Example 87900 of 138376 loss = 3.5088 nll loss = 2.1277 accu = 0.3716

Training: Epoch 4 of 10 Step 1677 ntokens 124706176 Example 88200 of 138376 loss = 3.5092 nll loss = 2.1275 accu = 0.3716

Training: Epoch 4 of 10 Step 1678 ntokens 124741576 Example 88500 of 138376 loss = 3.5090 nll loss = 2.1272 accu = 0.3718

Training: Epoch 4 of 10 Step 1679 ntokens 124776976 Example 88800 of 138376 loss = 3.5089 nll loss = 2.1275 accu = 0.3716

Training: Epoch 4 of 10 Step 1680 ntokens 124812376 Example 89100 of 138376 loss = 3.5090 nll loss = 2.1275 accu = 0.3716

Training: Epoch 4 of 10 Step 1681 ntokens 124847776 Example 89400 of 138376 loss = 3.5086 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1682 ntokens 124883176 Example 89700 of 138376 loss = 3.5088 nll loss = 2.1275 accu = 0.3717

Training: Epoch 4 of 10 Step 1683 ntokens 124918576 Example 90000 of 138376 loss = 3.5093 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1684 ntokens 124953976 Example 90300 of 138376 loss = 3.5092 nll loss = 2.1276 accu = 0.3716

Training: Epoch 4 of 10 Step 1685 ntokens 124989376 Example 90600 of 138376 loss = 3.5094 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1686 ntokens 125024776 Example 90900 of 138376 loss = 3.5089 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1687 ntokens 125060176 Example 91200 of 138376 loss = 3.5087 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1688 ntokens 125095576 Example 91500 of 138376 loss = 3.5090 nll loss = 2.1274 accu = 0.3717

Training: Epoch 4 of 10 Step 1689 ntokens 125130976 Example 91800 of 138376 loss = 3.5091 nll loss = 2.1275 accu = 0.3717

Training: Epoch 4 of 10 Step 1690 ntokens 125166376 Example 92100 of 138376 loss = 3.5092 nll loss = 2.1275 accu = 0.3717

Training: Epoch 4 of 10 Step 1691 ntokens 125201776 Example 92400 of 138376 loss = 3.5090 nll loss = 2.1272 accu = 0.3718

Training: Epoch 4 of 10 Step 1692 ntokens 125237176 Example 92700 of 138376 loss = 3.5090 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1693 ntokens 125272576 Example 93000 of 138376 loss = 3.5085 nll loss = 2.1271 accu = 0.3718

Training: Epoch 4 of 10 Step 1694 ntokens 125307976 Example 93300 of 138376 loss = 3.5080 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1695 ntokens 125343376 Example 93600 of 138376 loss = 3.5082 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1696 ntokens 125378776 Example 93900 of 138376 loss = 3.5085 nll loss = 2.1269 accu = 0.3718

Training: Epoch 4 of 10 Step 1697 ntokens 125414176 Example 94200 of 138376 loss = 3.5085 nll loss = 2.1269 accu = 0.3718

Training: Epoch 4 of 10 Step 1698 ntokens 125449576 Example 94500 of 138376 loss = 3.5081 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1699 ntokens 125484976 Example 94800 of 138376 loss = 3.5079 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1700 ntokens 125520376 Example 95100 of 138376 loss = 3.5079 nll loss = 2.1270 accu = 0.3718

Training: Epoch 4 of 10 Step 1701 ntokens 125555776 Example 95400 of 138376 loss = 3.5078 nll loss = 2.1268 accu = 0.3719

Training: Epoch 4 of 10 Step 1702 ntokens 125591176 Example 95700 of 138376 loss = 3.5078 nll loss = 2.1268 accu = 0.3718

Training: Epoch 4 of 10 Step 1703 ntokens 125626576 Example 96000 of 138376 loss = 3.5075 nll loss = 2.1266 accu = 0.3719

Training: Epoch 4 of 10 Step 1704 ntokens 125661976 Example 96300 of 138376 loss = 3.5073 nll loss = 2.1263 accu = 0.3720

Training: Epoch 4 of 10 Step 1705 ntokens 125697376 Example 96600 of 138376 loss = 3.5076 nll loss = 2.1262 accu = 0.3721

Training: Epoch 4 of 10 Step 1706 ntokens 125732776 Example 96900 of 138376 loss = 3.5076 nll loss = 2.1262 accu = 0.3721

Training: Epoch 4 of 10 Step 1707 ntokens 125768176 Example 97200 of 138376 loss = 3.5076 nll loss = 2.1265 accu = 0.3720

Training: Epoch 4 of 10 Step 1708 ntokens 125803576 Example 97500 of 138376 loss = 3.5076 nll loss = 2.1266 accu = 0.3720

Training: Epoch 4 of 10 Step 1709 ntokens 125838976 Example 97800 of 138376 loss = 3.5073 nll loss = 2.1268 accu = 0.3719

Training: Epoch 4 of 10 Step 1710 ntokens 125874376 Example 98100 of 138376 loss = 3.5072 nll loss = 2.1268 accu = 0.3719

Training: Epoch 4 of 10 Step 1711 ntokens 125909776 Example 98400 of 138376 loss = 3.5074 nll loss = 2.1266 accu = 0.3720

Training: Epoch 4 of 10 Step 1712 ntokens 125945176 Example 98700 of 138376 loss = 3.5075 nll loss = 2.1262 accu = 0.3721

Training: Epoch 4 of 10 Step 1713 ntokens 125980576 Example 99000 of 138376 loss = 3.5075 nll loss = 2.1263 accu = 0.3721

Training: Epoch 4 of 10 Step 1714 ntokens 126015976 Example 99300 of 138376 loss = 3.5073 nll loss = 2.1261 accu = 0.3721

Training: Epoch 4 of 10 Step 1715 ntokens 126051376 Example 99600 of 138376 loss = 3.5073 nll loss = 2.1259 accu = 0.3722

Training: Epoch 4 of 10 Step 1716 ntokens 126086776 Example 99900 of 138376 loss = 3.5072 nll loss = 2.1259 accu = 0.3722

Training: Epoch 4 of 10 Step 1717 ntokens 126122176 Example 100200 of 138376 loss = 3.5073 nll loss = 2.1258 accu = 0.3722

Training: Epoch 4 of 10 Step 1718 ntokens 126157576 Example 100500 of 138376 loss = 3.5074 nll loss = 2.1259 accu = 0.3722

Training: Epoch 4 of 10 Step 1719 ntokens 126192976 Example 100800 of 138376 loss = 3.5072 nll loss = 2.1259 accu = 0.3722

Training: Epoch 4 of 10 Step 1720 ntokens 126228376 Example 101100 of 138376 loss = 3.5072 nll loss = 2.1261 accu = 0.3721

Training: Epoch 4 of 10 Step 1721 ntokens 126263776 Example 101400 of 138376 loss = 3.5071 nll loss = 2.1260 accu = 0.3721

Training: Epoch 4 of 10 Step 1722 ntokens 126299176 Example 101700 of 138376 loss = 3.5073 nll loss = 2.1263 accu = 0.3720

Training: Epoch 4 of 10 Step 1723 ntokens 126334576 Example 102000 of 138376 loss = 3.5072 nll loss = 2.1264 accu = 0.3720

Training: Epoch 4 of 10 Step 1724 ntokens 126369976 Example 102300 of 138376 loss = 3.5070 nll loss = 2.1264 accu = 0.3720

Training: Epoch 4 of 10 Step 1725 ntokens 126405376 Example 102600 of 138376 loss = 3.5072 nll loss = 2.1261 accu = 0.3721

Training: Epoch 4 of 10 Step 1726 ntokens 126440776 Example 102900 of 138376 loss = 3.5070 nll loss = 2.1261 accu = 0.3721

Training: Epoch 4 of 10 Step 1727 ntokens 126476176 Example 103200 of 138376 loss = 3.5069 nll loss = 2.1263 accu = 0.3720

Training: Epoch 4 of 10 Step 1728 ntokens 126511576 Example 103500 of 138376 loss = 3.5069 nll loss = 2.1261 accu = 0.3721

Training: Epoch 4 of 10 Step 1729 ntokens 126546976 Example 103800 of 138376 loss = 3.5070 nll loss = 2.1262 accu = 0.3721

Training: Epoch 4 of 10 Step 1730 ntokens 126582376 Example 104100 of 138376 loss = 3.5070 nll loss = 2.1263 accu = 0.3720

Training: Epoch 4 of 10 Step 1731 ntokens 126617776 Example 104400 of 138376 loss = 3.5069 nll loss = 2.1262 accu = 0.3721

Training: Epoch 4 of 10 Step 1732 ntokens 126653176 Example 104700 of 138376 loss = 3.5070 nll loss = 2.1262 accu = 0.3721

Training: Epoch 4 of 10 Step 1733 ntokens 126688576 Example 105000 of 138376 loss = 3.5069 nll loss = 2.1259 accu = 0.3722

Training: Epoch 4 of 10 Step 1734 ntokens 126723976 Example 105300 of 138376 loss = 3.5070 nll loss = 2.1258 accu = 0.3722

Training: Epoch 4 of 10 Step 1735 ntokens 126759376 Example 105600 of 138376 loss = 3.5070 nll loss = 2.1256 accu = 0.3723

Training: Epoch 4 of 10 Step 1736 ntokens 126794776 Example 105900 of 138376 loss = 3.5068 nll loss = 2.1255 accu = 0.3723

Training: Epoch 4 of 10 Step 1737 ntokens 126830176 Example 106200 of 138376 loss = 3.5067 nll loss = 2.1252 accu = 0.3724

Training: Epoch 4 of 10 Step 1738 ntokens 126865576 Example 106500 of 138376 loss = 3.5070 nll loss = 2.1254 accu = 0.3723

Training: Epoch 4 of 10 Step 1739 ntokens 126900976 Example 106800 of 138376 loss = 3.5073 nll loss = 2.1254 accu = 0.3723

Training: Epoch 4 of 10 Step 1740 ntokens 126936376 Example 107100 of 138376 loss = 3.5072 nll loss = 2.1255 accu = 0.3723

Training: Epoch 4 of 10 Step 1741 ntokens 126971776 Example 107400 of 138376 loss = 3.5072 nll loss = 2.1255 accu = 0.3723

Training: Epoch 4 of 10 Step 1742 ntokens 127007176 Example 107700 of 138376 loss = 3.5069 nll loss = 2.1254 accu = 0.3723

Training: Epoch 4 of 10 Step 1743 ntokens 127042576 Example 108000 of 138376 loss = 3.5068 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1744 ntokens 127077976 Example 108300 of 138376 loss = 3.5069 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1745 ntokens 127113376 Example 108600 of 138376 loss = 3.5071 nll loss = 2.1252 accu = 0.3724

Training: Epoch 4 of 10 Step 1746 ntokens 127148776 Example 108900 of 138376 loss = 3.5070 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1747 ntokens 127184176 Example 109200 of 138376 loss = 3.5069 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1748 ntokens 127219576 Example 109500 of 138376 loss = 3.5075 nll loss = 2.1252 accu = 0.3724

Training: Epoch 4 of 10 Step 1749 ntokens 127254976 Example 109800 of 138376 loss = 3.5075 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1750 ntokens 127290376 Example 110100 of 138376 loss = 3.5077 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1751 ntokens 127325776 Example 110400 of 138376 loss = 3.5075 nll loss = 2.1252 accu = 0.3724

Training: Epoch 4 of 10 Step 1752 ntokens 127361176 Example 110700 of 138376 loss = 3.5076 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1753 ntokens 127396576 Example 111000 of 138376 loss = 3.5076 nll loss = 2.1252 accu = 0.3724

Training: Epoch 4 of 10 Step 1754 ntokens 127431976 Example 111300 of 138376 loss = 3.5077 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1755 ntokens 127467376 Example 111600 of 138376 loss = 3.5078 nll loss = 2.1249 accu = 0.3725

Training: Epoch 4 of 10 Step 1756 ntokens 127502776 Example 111900 of 138376 loss = 3.5077 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1757 ntokens 127538176 Example 112200 of 138376 loss = 3.5075 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1758 ntokens 127573576 Example 112500 of 138376 loss = 3.5074 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1759 ntokens 127608976 Example 112800 of 138376 loss = 3.5076 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1760 ntokens 127644376 Example 113100 of 138376 loss = 3.5078 nll loss = 2.1248 accu = 0.3726

Training: Epoch 4 of 10 Step 1761 ntokens 127679776 Example 113400 of 138376 loss = 3.5074 nll loss = 2.1249 accu = 0.3725

Training: Epoch 4 of 10 Step 1762 ntokens 127715176 Example 113700 of 138376 loss = 3.5075 nll loss = 2.1249 accu = 0.3726

Training: Epoch 4 of 10 Step 1763 ntokens 127750576 Example 114000 of 138376 loss = 3.5076 nll loss = 2.1248 accu = 0.3726

Training: Epoch 4 of 10 Step 1764 ntokens 127785976 Example 114300 of 138376 loss = 3.5075 nll loss = 2.1247 accu = 0.3726

Training: Epoch 4 of 10 Step 1765 ntokens 127821376 Example 114600 of 138376 loss = 3.5076 nll loss = 2.1246 accu = 0.3727

Training: Epoch 4 of 10 Step 1766 ntokens 127856776 Example 114900 of 138376 loss = 3.5075 nll loss = 2.1246 accu = 0.3727

Training: Epoch 4 of 10 Step 1767 ntokens 127892176 Example 115200 of 138376 loss = 3.5076 nll loss = 2.1247 accu = 0.3726

Training: Epoch 4 of 10 Step 1768 ntokens 127927576 Example 115500 of 138376 loss = 3.5075 nll loss = 2.1249 accu = 0.3725

Training: Epoch 4 of 10 Step 1769 ntokens 127962976 Example 115800 of 138376 loss = 3.5073 nll loss = 2.1249 accu = 0.3726

Training: Epoch 4 of 10 Step 1770 ntokens 127998376 Example 116100 of 138376 loss = 3.5075 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1771 ntokens 128033776 Example 116400 of 138376 loss = 3.5073 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1772 ntokens 128069176 Example 116700 of 138376 loss = 3.5070 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1773 ntokens 128104576 Example 117000 of 138376 loss = 3.5068 nll loss = 2.1250 accu = 0.3725

Training: Epoch 4 of 10 Step 1774 ntokens 128139976 Example 117300 of 138376 loss = 3.5069 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1775 ntokens 128175376 Example 117600 of 138376 loss = 3.5068 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1776 ntokens 128210776 Example 117900 of 138376 loss = 3.5066 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1777 ntokens 128246176 Example 118200 of 138376 loss = 3.5066 nll loss = 2.1252 accu = 0.3724

Training: Epoch 4 of 10 Step 1778 ntokens 128281576 Example 118500 of 138376 loss = 3.5063 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1779 ntokens 128316976 Example 118800 of 138376 loss = 3.5064 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1780 ntokens 128352376 Example 119100 of 138376 loss = 3.5065 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1781 ntokens 128387776 Example 119400 of 138376 loss = 3.5064 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1782 ntokens 128423176 Example 119700 of 138376 loss = 3.5066 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1783 ntokens 128458576 Example 120000 of 138376 loss = 3.5065 nll loss = 2.1253 accu = 0.3724

Training: Epoch 4 of 10 Step 1784 ntokens 128493976 Example 120300 of 138376 loss = 3.5067 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1785 ntokens 128529376 Example 120600 of 138376 loss = 3.5065 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1786 ntokens 128564776 Example 120900 of 138376 loss = 3.5062 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1787 ntokens 128600176 Example 121200 of 138376 loss = 3.5065 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1788 ntokens 128635576 Example 121500 of 138376 loss = 3.5064 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1789 ntokens 128670976 Example 121800 of 138376 loss = 3.5066 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1790 ntokens 128706376 Example 122100 of 138376 loss = 3.5066 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1791 ntokens 128741776 Example 122400 of 138376 loss = 3.5067 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1792 ntokens 128777176 Example 122700 of 138376 loss = 3.5068 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1793 ntokens 128812576 Example 123000 of 138376 loss = 3.5067 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1794 ntokens 128847976 Example 123300 of 138376 loss = 3.5065 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1795 ntokens 128883376 Example 123600 of 138376 loss = 3.5064 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1796 ntokens 128918776 Example 123900 of 138376 loss = 3.5064 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1797 ntokens 128954176 Example 124200 of 138376 loss = 3.5062 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1798 ntokens 128989576 Example 124500 of 138376 loss = 3.5061 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1799 ntokens 129024976 Example 124800 of 138376 loss = 3.5062 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1800 ntokens 129060376 Example 125100 of 138376 loss = 3.5060 nll loss = 2.1256 accu = 0.3723

Training: Epoch 4 of 10 Step 1801 ntokens 129095776 Example 125400 of 138376 loss = 3.5056 nll loss = 2.1256 accu = 0.3724

Training: Epoch 4 of 10 Step 1802 ntokens 129131176 Example 125700 of 138376 loss = 3.5059 nll loss = 2.1257 accu = 0.3723

Training: Epoch 4 of 10 Step 1803 ntokens 129166576 Example 126000 of 138376 loss = 3.5060 nll loss = 2.1257 accu = 0.3723

Training: Epoch 4 of 10 Step 1804 ntokens 129201976 Example 126300 of 138376 loss = 3.5059 nll loss = 2.1259 accu = 0.3723

Training: Epoch 4 of 10 Step 1805 ntokens 129237376 Example 126600 of 138376 loss = 3.5061 nll loss = 2.1257 accu = 0.3723

Training: Epoch 4 of 10 Step 1806 ntokens 129272776 Example 126900 of 138376 loss = 3.5064 nll loss = 2.1259 accu = 0.3723

Training: Epoch 4 of 10 Step 1807 ntokens 129308176 Example 127200 of 138376 loss = 3.5062 nll loss = 2.1257 accu = 0.3723

Training: Epoch 4 of 10 Step 1808 ntokens 129343576 Example 127500 of 138376 loss = 3.5062 nll loss = 2.1256 accu = 0.3724

Training: Epoch 4 of 10 Step 1809 ntokens 129378976 Example 127800 of 138376 loss = 3.5062 nll loss = 2.1256 accu = 0.3724

Training: Epoch 4 of 10 Step 1810 ntokens 129414376 Example 128100 of 138376 loss = 3.5061 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1811 ntokens 129449776 Example 128400 of 138376 loss = 3.5065 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1812 ntokens 129485176 Example 128700 of 138376 loss = 3.5065 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1813 ntokens 129520576 Example 129000 of 138376 loss = 3.5065 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1814 ntokens 129555976 Example 129300 of 138376 loss = 3.5064 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1815 ntokens 129591376 Example 129600 of 138376 loss = 3.5061 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1816 ntokens 129626776 Example 129900 of 138376 loss = 3.5062 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1817 ntokens 129662176 Example 130200 of 138376 loss = 3.5060 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1818 ntokens 129697576 Example 130500 of 138376 loss = 3.5062 nll loss = 2.1252 accu = 0.3725

Training: Epoch 4 of 10 Step 1819 ntokens 129732976 Example 130800 of 138376 loss = 3.5062 nll loss = 2.1251 accu = 0.3725

Training: Epoch 4 of 10 Step 1820 ntokens 129768376 Example 131100 of 138376 loss = 3.5058 nll loss = 2.1253 accu = 0.3725

Training: Epoch 4 of 10 Step 1821 ntokens 129803776 Example 131400 of 138376 loss = 3.5058 nll loss = 2.1253 accu = 0.3725

Training: Epoch 4 of 10 Step 1822 ntokens 129839176 Example 131700 of 138376 loss = 3.5056 nll loss = 2.1253 accu = 0.3725

Training: Epoch 4 of 10 Step 1823 ntokens 129874576 Example 132000 of 138376 loss = 3.5056 nll loss = 2.1254 accu = 0.3724

Training: Epoch 4 of 10 Step 1824 ntokens 129909976 Example 132300 of 138376 loss = 3.5057 nll loss = 2.1256 accu = 0.3724

Training: Epoch 4 of 10 Step 1825 ntokens 129945376 Example 132600 of 138376 loss = 3.5057 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1826 ntokens 129980776 Example 132900 of 138376 loss = 3.5056 nll loss = 2.1257 accu = 0.3723

Training: Epoch 4 of 10 Step 1827 ntokens 130016176 Example 133200 of 138376 loss = 3.5055 nll loss = 2.1256 accu = 0.3724

Training: Epoch 4 of 10 Step 1828 ntokens 130051576 Example 133500 of 138376 loss = 3.5055 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1829 ntokens 130086976 Example 133800 of 138376 loss = 3.5053 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1830 ntokens 130122376 Example 134100 of 138376 loss = 3.5052 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1831 ntokens 130157776 Example 134400 of 138376 loss = 3.5052 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1832 ntokens 130193176 Example 134700 of 138376 loss = 3.5050 nll loss = 2.1255 accu = 0.3724

Training: Epoch 4 of 10 Step 1833 ntokens 130228576 Example 135000 of 138376 loss = 3.5050 nll loss = 2.1256 accu = 0.3724

Training: Epoch 4 of 10 Step 1834 ntokens 130263976 Example 135300 of 138376 loss = 3.5049 nll loss = 2.1258 accu = 0.3723

Training: Epoch 4 of 10 Step 1835 ntokens 130299376 Example 135600 of 138376 loss = 3.5047 nll loss = 2.1260 accu = 0.3723

Training: Epoch 4 of 10 Step 1836 ntokens 130334776 Example 135900 of 138376 loss = 3.5047 nll loss = 2.1260 accu = 0.3723

Training: Epoch 4 of 10 Step 1837 ntokens 130370176 Example 136200 of 138376 loss = 3.5049 nll loss = 2.1262 accu = 0.3722

Training: Epoch 4 of 10 Step 1838 ntokens 130405576 Example 136500 of 138376 loss = 3.5050 nll loss = 2.1261 accu = 0.3722

Training: Epoch 4 of 10 Step 1839 ntokens 130440976 Example 136800 of 138376 loss = 3.5049 nll loss = 2.1259 accu = 0.3723

Training: Epoch 4 of 10 Step 1840 ntokens 130476376 Example 137100 of 138376 loss = 3.5049 nll loss = 2.1261 accu = 0.3722

Training: Epoch 4 of 10 Step 1841 ntokens 130511776 Example 137400 of 138376 loss = 3.5050 nll loss = 2.1261 accu = 0.3722

Training: Epoch 4 of 10 Step 1842 ntokens 130547176 Example 137700 of 138376 loss = 3.5048 nll loss = 2.1259 accu = 0.3723

Training: Epoch 4 of 10 Step 1843 ntokens 130582576 Example 138000 of 138376 loss = 3.5050 nll loss = 2.1259 accu = 0.3723

Training: Epoch 4 of 10 Step 1844 ntokens 130617976 Example 138300 of 138376 loss = 3.5049 nll loss = 2.1259 accu = 0.3723

Training: Epoch 4 of 10 Step 1845 ntokens 130626944 Example 138376 of 138376 loss = 3.5049 nll loss = 2.1259 accu = 0.3723

Writing to checkpoint at 2024-05-28 16:58:02.892796
Validating: Epoch 4 of 10 Step 0 ntokens 130626944 Example 300 of 34323 loss = 3.6457 nll loss = 2.0882 accu = 0.3851

Validating: Epoch 4 of 10 Step 1 ntokens 130626944 Example 600 of 34323 loss = 3.5422 nll loss = 2.0903 accu = 0.3859

Validating: Epoch 4 of 10 Step 2 ntokens 130626944 Example 900 of 34323 loss = 3.5367 nll loss = 2.0719 accu = 0.3914

Validating: Epoch 4 of 10 Step 3 ntokens 130626944 Example 1200 of 34323 loss = 3.5245 nll loss = 2.0729 accu = 0.3904

Validating: Epoch 4 of 10 Step 4 ntokens 130626944 Example 1500 of 34323 loss = 3.5075 nll loss = 2.0786 accu = 0.3882

Validating: Epoch 4 of 10 Step 5 ntokens 130626944 Example 1800 of 34323 loss = 3.5105 nll loss = 2.0884 accu = 0.3844

Validating: Epoch 4 of 10 Step 6 ntokens 130626944 Example 2100 of 34323 loss = 3.4977 nll loss = 2.0869 accu = 0.3849

Validating: Epoch 4 of 10 Step 7 ntokens 130626944 Example 2400 of 34323 loss = 3.5061 nll loss = 2.0872 accu = 0.3846

Validating: Epoch 4 of 10 Step 8 ntokens 130626944 Example 2700 of 34323 loss = 3.5071 nll loss = 2.0855 accu = 0.3851

Validating: Epoch 4 of 10 Step 9 ntokens 130626944 Example 3000 of 34323 loss = 3.5117 nll loss = 2.0872 accu = 0.3846

Validating: Epoch 4 of 10 Step 10 ntokens 130626944 Example 3300 of 34323 loss = 3.5062 nll loss = 2.0850 accu = 0.3857

Validating: Epoch 4 of 10 Step 11 ntokens 130626944 Example 3600 of 34323 loss = 3.5091 nll loss = 2.0934 accu = 0.3830

Validating: Epoch 4 of 10 Step 12 ntokens 130626944 Example 3900 of 34323 loss = 3.5058 nll loss = 2.0986 accu = 0.3813

Validating: Epoch 4 of 10 Step 13 ntokens 130626944 Example 4200 of 34323 loss = 3.5049 nll loss = 2.0982 accu = 0.3815

Validating: Epoch 4 of 10 Step 14 ntokens 130626944 Example 4500 of 34323 loss = 3.5046 nll loss = 2.1014 accu = 0.3802

Validating: Epoch 4 of 10 Step 15 ntokens 130626944 Example 4800 of 34323 loss = 3.5061 nll loss = 2.1041 accu = 0.3792

Validating: Epoch 4 of 10 Step 16 ntokens 130626944 Example 5100 of 34323 loss = 3.5090 nll loss = 2.1070 accu = 0.3783

Validating: Epoch 4 of 10 Step 17 ntokens 130626944 Example 5400 of 34323 loss = 3.5143 nll loss = 2.1072 accu = 0.3784

Validating: Epoch 4 of 10 Step 18 ntokens 130626944 Example 5700 of 34323 loss = 3.5055 nll loss = 2.1105 accu = 0.3772

Validating: Epoch 4 of 10 Step 19 ntokens 130626944 Example 6000 of 34323 loss = 3.5060 nll loss = 2.1052 accu = 0.3790

Validating: Epoch 4 of 10 Step 20 ntokens 130626944 Example 6300 of 34323 loss = 3.5107 nll loss = 2.1045 accu = 0.3792

Validating: Epoch 4 of 10 Step 21 ntokens 130626944 Example 6600 of 34323 loss = 3.5156 nll loss = 2.1070 accu = 0.3786

Validating: Epoch 4 of 10 Step 22 ntokens 130626944 Example 6900 of 34323 loss = 3.5180 nll loss = 2.1090 accu = 0.3781

Validating: Epoch 4 of 10 Step 23 ntokens 130626944 Example 7200 of 34323 loss = 3.5172 nll loss = 2.1082 accu = 0.3784

Validating: Epoch 4 of 10 Step 24 ntokens 130626944 Example 7500 of 34323 loss = 3.5242 nll loss = 2.1081 accu = 0.3784

Validating: Epoch 4 of 10 Step 25 ntokens 130626944 Example 7800 of 34323 loss = 3.5204 nll loss = 2.1099 accu = 0.3777

Validating: Epoch 4 of 10 Step 26 ntokens 130626944 Example 8100 of 34323 loss = 3.5200 nll loss = 2.1109 accu = 0.3775

Validating: Epoch 4 of 10 Step 27 ntokens 130626944 Example 8400 of 34323 loss = 3.5138 nll loss = 2.1130 accu = 0.3767

Validating: Epoch 4 of 10 Step 28 ntokens 130626944 Example 8700 of 34323 loss = 3.5112 nll loss = 2.1161 accu = 0.3755

Validating: Epoch 4 of 10 Step 29 ntokens 130626944 Example 9000 of 34323 loss = 3.5071 nll loss = 2.1151 accu = 0.3759

Validating: Epoch 4 of 10 Step 30 ntokens 130626944 Example 9300 of 34323 loss = 3.5064 nll loss = 2.1155 accu = 0.3757

Validating: Epoch 4 of 10 Step 31 ntokens 130626944 Example 9600 of 34323 loss = 3.5065 nll loss = 2.1161 accu = 0.3755

Validating: Epoch 4 of 10 Step 32 ntokens 130626944 Example 9900 of 34323 loss = 3.5047 nll loss = 2.1172 accu = 0.3751

Validating: Epoch 4 of 10 Step 33 ntokens 130626944 Example 10200 of 34323 loss = 3.5051 nll loss = 2.1166 accu = 0.3754

Validating: Epoch 4 of 10 Step 34 ntokens 130626944 Example 10500 of 34323 loss = 3.5021 nll loss = 2.1142 accu = 0.3762

Validating: Epoch 4 of 10 Step 35 ntokens 130626944 Example 10800 of 34323 loss = 3.5052 nll loss = 2.1149 accu = 0.3759

Validating: Epoch 4 of 10 Step 36 ntokens 130626944 Example 11100 of 34323 loss = 3.5018 nll loss = 2.1170 accu = 0.3751

Validating: Epoch 4 of 10 Step 37 ntokens 130626944 Example 11400 of 34323 loss = 3.5024 nll loss = 2.1202 accu = 0.3739

Validating: Epoch 4 of 10 Step 38 ntokens 130626944 Example 11700 of 34323 loss = 3.5005 nll loss = 2.1207 accu = 0.3738

Validating: Epoch 4 of 10 Step 39 ntokens 130626944 Example 12000 of 34323 loss = 3.4987 nll loss = 2.1203 accu = 0.3740

Validating: Epoch 4 of 10 Step 40 ntokens 130626944 Example 12300 of 34323 loss = 3.5000 nll loss = 2.1187 accu = 0.3746

Validating: Epoch 4 of 10 Step 41 ntokens 130626944 Example 12600 of 34323 loss = 3.5000 nll loss = 2.1168 accu = 0.3752

Validating: Epoch 4 of 10 Step 42 ntokens 130626944 Example 12900 of 34323 loss = 3.5008 nll loss = 2.1182 accu = 0.3749

Validating: Epoch 4 of 10 Step 43 ntokens 130626944 Example 13200 of 34323 loss = 3.4994 nll loss = 2.1198 accu = 0.3743

Validating: Epoch 4 of 10 Step 44 ntokens 130626944 Example 13500 of 34323 loss = 3.4982 nll loss = 2.1192 accu = 0.3745

Validating: Epoch 4 of 10 Step 45 ntokens 130626944 Example 13800 of 34323 loss = 3.4962 nll loss = 2.1196 accu = 0.3743

Validating: Epoch 4 of 10 Step 46 ntokens 130626944 Example 14100 of 34323 loss = 3.4963 nll loss = 2.1207 accu = 0.3739

Validating: Epoch 4 of 10 Step 47 ntokens 130626944 Example 14400 of 34323 loss = 3.4958 nll loss = 2.1213 accu = 0.3735

Validating: Epoch 4 of 10 Step 48 ntokens 130626944 Example 14700 of 34323 loss = 3.4947 nll loss = 2.1222 accu = 0.3731

Validating: Epoch 4 of 10 Step 49 ntokens 130626944 Example 15000 of 34323 loss = 3.4951 nll loss = 2.1234 accu = 0.3727

Validating: Epoch 4 of 10 Step 50 ntokens 130626944 Example 15300 of 34323 loss = 3.4952 nll loss = 2.1240 accu = 0.3725

Validating: Epoch 4 of 10 Step 51 ntokens 130626944 Example 15600 of 34323 loss = 3.4939 nll loss = 2.1249 accu = 0.3722

Validating: Epoch 4 of 10 Step 52 ntokens 130626944 Example 15900 of 34323 loss = 3.4945 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 4 of 10 Step 53 ntokens 130626944 Example 16200 of 34323 loss = 3.4948 nll loss = 2.1254 accu = 0.3720

Validating: Epoch 4 of 10 Step 54 ntokens 130626944 Example 16500 of 34323 loss = 3.4963 nll loss = 2.1233 accu = 0.3728

Validating: Epoch 4 of 10 Step 55 ntokens 130626944 Example 16800 of 34323 loss = 3.4961 nll loss = 2.1218 accu = 0.3733

Validating: Epoch 4 of 10 Step 56 ntokens 130626944 Example 17100 of 34323 loss = 3.4967 nll loss = 2.1222 accu = 0.3731

Validating: Epoch 4 of 10 Step 57 ntokens 130626944 Example 17400 of 34323 loss = 3.4984 nll loss = 2.1233 accu = 0.3727

Validating: Epoch 4 of 10 Step 58 ntokens 130626944 Example 17700 of 34323 loss = 3.4980 nll loss = 2.1245 accu = 0.3723

Validating: Epoch 4 of 10 Step 59 ntokens 130626944 Example 18000 of 34323 loss = 3.4976 nll loss = 2.1241 accu = 0.3725

Validating: Epoch 4 of 10 Step 60 ntokens 130626944 Example 18300 of 34323 loss = 3.4958 nll loss = 2.1246 accu = 0.3723

Validating: Epoch 4 of 10 Step 61 ntokens 130626944 Example 18600 of 34323 loss = 3.4936 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 4 of 10 Step 62 ntokens 130626944 Example 18900 of 34323 loss = 3.4932 nll loss = 2.1251 accu = 0.3722

Validating: Epoch 4 of 10 Step 63 ntokens 130626944 Example 19200 of 34323 loss = 3.4934 nll loss = 2.1262 accu = 0.3718

Validating: Epoch 4 of 10 Step 64 ntokens 130626944 Example 19500 of 34323 loss = 3.4926 nll loss = 2.1248 accu = 0.3723

Validating: Epoch 4 of 10 Step 65 ntokens 130626944 Example 19800 of 34323 loss = 3.4925 nll loss = 2.1250 accu = 0.3722

Validating: Epoch 4 of 10 Step 66 ntokens 130626944 Example 20100 of 34323 loss = 3.4934 nll loss = 2.1255 accu = 0.3720

Validating: Epoch 4 of 10 Step 67 ntokens 130626944 Example 20400 of 34323 loss = 3.4929 nll loss = 2.1258 accu = 0.3718

Validating: Epoch 4 of 10 Step 68 ntokens 130626944 Example 20700 of 34323 loss = 3.4928 nll loss = 2.1256 accu = 0.3719

Validating: Epoch 4 of 10 Step 69 ntokens 130626944 Example 21000 of 34323 loss = 3.4925 nll loss = 2.1259 accu = 0.3718

Validating: Epoch 4 of 10 Step 70 ntokens 130626944 Example 21300 of 34323 loss = 3.4914 nll loss = 2.1267 accu = 0.3715

Validating: Epoch 4 of 10 Step 71 ntokens 130626944 Example 21600 of 34323 loss = 3.4909 nll loss = 2.1270 accu = 0.3714

Validating: Epoch 4 of 10 Step 72 ntokens 130626944 Example 21900 of 34323 loss = 3.4900 nll loss = 2.1268 accu = 0.3715

Validating: Epoch 4 of 10 Step 73 ntokens 130626944 Example 22200 of 34323 loss = 3.4898 nll loss = 2.1257 accu = 0.3718

Validating: Epoch 4 of 10 Step 74 ntokens 130626944 Example 22500 of 34323 loss = 3.4908 nll loss = 2.1266 accu = 0.3715

Validating: Epoch 4 of 10 Step 75 ntokens 130626944 Example 22800 of 34323 loss = 3.4903 nll loss = 2.1259 accu = 0.3717

Validating: Epoch 4 of 10 Step 76 ntokens 130626944 Example 23100 of 34323 loss = 3.4913 nll loss = 2.1261 accu = 0.3717

Validating: Epoch 4 of 10 Step 77 ntokens 130626944 Example 23400 of 34323 loss = 3.4913 nll loss = 2.1264 accu = 0.3716

Validating: Epoch 4 of 10 Step 78 ntokens 130626944 Example 23700 of 34323 loss = 3.4916 nll loss = 2.1267 accu = 0.3715

Validating: Epoch 4 of 10 Step 79 ntokens 130626944 Example 24000 of 34323 loss = 3.4917 nll loss = 2.1260 accu = 0.3718

Validating: Epoch 4 of 10 Step 80 ntokens 130626944 Example 24300 of 34323 loss = 3.4919 nll loss = 2.1262 accu = 0.3717

Validating: Epoch 4 of 10 Step 81 ntokens 130626944 Example 24600 of 34323 loss = 3.4916 nll loss = 2.1255 accu = 0.3719

Validating: Epoch 4 of 10 Step 82 ntokens 130626944 Example 24900 of 34323 loss = 3.4900 nll loss = 2.1258 accu = 0.3718

Validating: Epoch 4 of 10 Step 83 ntokens 130626944 Example 25200 of 34323 loss = 3.4897 nll loss = 2.1252 accu = 0.3720

Validating: Epoch 4 of 10 Step 84 ntokens 130626944 Example 25500 of 34323 loss = 3.4903 nll loss = 2.1260 accu = 0.3717

Validating: Epoch 4 of 10 Step 85 ntokens 130626944 Example 25800 of 34323 loss = 3.4911 nll loss = 2.1263 accu = 0.3716

Validating: Epoch 4 of 10 Step 86 ntokens 130626944 Example 26100 of 34323 loss = 3.4918 nll loss = 2.1264 accu = 0.3716

Validating: Epoch 4 of 10 Step 87 ntokens 130626944 Example 26400 of 34323 loss = 3.4918 nll loss = 2.1263 accu = 0.3717

Validating: Epoch 4 of 10 Step 88 ntokens 130626944 Example 26700 of 34323 loss = 3.4909 nll loss = 2.1265 accu = 0.3716

Validating: Epoch 4 of 10 Step 89 ntokens 130626944 Example 27000 of 34323 loss = 3.4917 nll loss = 2.1261 accu = 0.3717

Validating: Epoch 4 of 10 Step 90 ntokens 130626944 Example 27300 of 34323 loss = 3.4911 nll loss = 2.1262 accu = 0.3717

Validating: Epoch 4 of 10 Step 91 ntokens 130626944 Example 27600 of 34323 loss = 3.4922 nll loss = 2.1258 accu = 0.3719

Validating: Epoch 4 of 10 Step 92 ntokens 130626944 Example 27900 of 34323 loss = 3.4928 nll loss = 2.1252 accu = 0.3721

Validating: Epoch 4 of 10 Step 93 ntokens 130626944 Example 28200 of 34323 loss = 3.4914 nll loss = 2.1264 accu = 0.3717

Validating: Epoch 4 of 10 Step 94 ntokens 130626944 Example 28500 of 34323 loss = 3.4916 nll loss = 2.1267 accu = 0.3716

Validating: Epoch 4 of 10 Step 95 ntokens 130626944 Example 28800 of 34323 loss = 3.4916 nll loss = 2.1260 accu = 0.3719

Validating: Epoch 4 of 10 Step 96 ntokens 130626944 Example 29100 of 34323 loss = 3.4910 nll loss = 2.1261 accu = 0.3718

Validating: Epoch 4 of 10 Step 97 ntokens 130626944 Example 29400 of 34323 loss = 3.4900 nll loss = 2.1264 accu = 0.3717

Validating: Epoch 4 of 10 Step 98 ntokens 130626944 Example 29700 of 34323 loss = 3.4902 nll loss = 2.1270 accu = 0.3715

Validating: Epoch 4 of 10 Step 99 ntokens 130626944 Example 30000 of 34323 loss = 3.4914 nll loss = 2.1271 accu = 0.3715

Validating: Epoch 4 of 10 Step 100 ntokens 130626944 Example 30300 of 34323 loss = 3.4908 nll loss = 2.1272 accu = 0.3715

Validating: Epoch 4 of 10 Step 101 ntokens 130626944 Example 30600 of 34323 loss = 3.4898 nll loss = 2.1275 accu = 0.3714

Validating: Epoch 4 of 10 Step 102 ntokens 130626944 Example 30900 of 34323 loss = 3.4893 nll loss = 2.1269 accu = 0.3716

Validating: Epoch 4 of 10 Step 103 ntokens 130626944 Example 31200 of 34323 loss = 3.4896 nll loss = 2.1270 accu = 0.3715

Validating: Epoch 4 of 10 Step 104 ntokens 130626944 Example 31500 of 34323 loss = 3.4893 nll loss = 2.1273 accu = 0.3714

Validating: Epoch 4 of 10 Step 105 ntokens 130626944 Example 31800 of 34323 loss = 3.4903 nll loss = 2.1276 accu = 0.3713

Validating: Epoch 4 of 10 Step 106 ntokens 130626944 Example 32100 of 34323 loss = 3.4910 nll loss = 2.1281 accu = 0.3711

Validating: Epoch 4 of 10 Step 107 ntokens 130626944 Example 32400 of 34323 loss = 3.4907 nll loss = 2.1284 accu = 0.3710

Validating: Epoch 4 of 10 Step 108 ntokens 130626944 Example 32700 of 34323 loss = 3.4903 nll loss = 2.1283 accu = 0.3711

Validating: Epoch 4 of 10 Step 109 ntokens 130626944 Example 33000 of 34323 loss = 3.4907 nll loss = 2.1288 accu = 0.3708

Validating: Epoch 4 of 10 Step 110 ntokens 130626944 Example 33300 of 34323 loss = 3.4914 nll loss = 2.1289 accu = 0.3708

Validating: Epoch 4 of 10 Step 111 ntokens 130626944 Example 33600 of 34323 loss = 3.4920 nll loss = 2.1288 accu = 0.3709

Validating: Epoch 4 of 10 Step 112 ntokens 130626944 Example 33900 of 34323 loss = 3.4914 nll loss = 2.1292 accu = 0.3708

Validating: Epoch 4 of 10 Step 113 ntokens 130626944 Example 34200 of 34323 loss = 3.4905 nll loss = 2.1292 accu = 0.3707

Validating: Epoch 4 of 10 Step 114 ntokens 130626944 Example 34323 of 34323 loss = 3.4902 nll loss = 2.1294 accu = 0.3707

Validation complete in 0:00:15.038437
Epoch complete in 0:02:30.153603
Training: Epoch 5 of 10 Step 1845 ntokens 244960920 Example 300 of 138376 loss = 3.5873 nll loss = 2.0991 accu = 0.3812

Training: Epoch 5 of 10 Step 1846 ntokens 244996320 Example 600 of 138376 loss = 3.5014 nll loss = 2.1300 accu = 0.3681

Training: Epoch 5 of 10 Step 1847 ntokens 245031720 Example 900 of 138376 loss = 3.5011 nll loss = 2.1123 accu = 0.3744

Training: Epoch 5 of 10 Step 1848 ntokens 245067120 Example 1200 of 138376 loss = 3.4796 nll loss = 2.1061 accu = 0.3773

Training: Epoch 5 of 10 Step 1849 ntokens 245102520 Example 1500 of 138376 loss = 3.4922 nll loss = 2.1169 accu = 0.3738

Training: Epoch 5 of 10 Step 1850 ntokens 245137920 Example 1800 of 138376 loss = 3.5205 nll loss = 2.1151 accu = 0.3745

Training: Epoch 5 of 10 Step 1851 ntokens 245173320 Example 2100 of 138376 loss = 3.5242 nll loss = 2.1104 accu = 0.3761

Training: Epoch 5 of 10 Step 1852 ntokens 245208720 Example 2400 of 138376 loss = 3.5171 nll loss = 2.1097 accu = 0.3765

Training: Epoch 5 of 10 Step 1853 ntokens 245244120 Example 2700 of 138376 loss = 3.5164 nll loss = 2.1149 accu = 0.3747

Training: Epoch 5 of 10 Step 1854 ntokens 245279520 Example 3000 of 138376 loss = 3.5140 nll loss = 2.1157 accu = 0.3746

Training: Epoch 5 of 10 Step 1855 ntokens 245314920 Example 3300 of 138376 loss = 3.5134 nll loss = 2.1145 accu = 0.3752

Training: Epoch 5 of 10 Step 1856 ntokens 245350320 Example 3600 of 138376 loss = 3.5106 nll loss = 2.1087 accu = 0.3774

Training: Epoch 5 of 10 Step 1857 ntokens 245385720 Example 3900 of 138376 loss = 3.5128 nll loss = 2.1148 accu = 0.3750

Training: Epoch 5 of 10 Step 1858 ntokens 245421120 Example 4200 of 138376 loss = 3.5197 nll loss = 2.1203 accu = 0.3730

Training: Epoch 5 of 10 Step 1859 ntokens 245456520 Example 4500 of 138376 loss = 3.5135 nll loss = 2.1197 accu = 0.3733

Training: Epoch 5 of 10 Step 1860 ntokens 245491920 Example 4800 of 138376 loss = 3.5120 nll loss = 2.1193 accu = 0.3734

Training: Epoch 5 of 10 Step 1861 ntokens 245527320 Example 5100 of 138376 loss = 3.5146 nll loss = 2.1195 accu = 0.3736

Training: Epoch 5 of 10 Step 1862 ntokens 245562720 Example 5400 of 138376 loss = 3.5135 nll loss = 2.1200 accu = 0.3735

Training: Epoch 5 of 10 Step 1863 ntokens 245598120 Example 5700 of 138376 loss = 3.5134 nll loss = 2.1229 accu = 0.3728

Training: Epoch 5 of 10 Step 1864 ntokens 245633520 Example 6000 of 138376 loss = 3.5074 nll loss = 2.1263 accu = 0.3718

Training: Epoch 5 of 10 Step 1865 ntokens 245668920 Example 6300 of 138376 loss = 3.5068 nll loss = 2.1301 accu = 0.3705

Training: Epoch 5 of 10 Step 1866 ntokens 245704320 Example 6600 of 138376 loss = 3.5032 nll loss = 2.1290 accu = 0.3707

Training: Epoch 5 of 10 Step 1867 ntokens 245739720 Example 6900 of 138376 loss = 3.4961 nll loss = 2.1276 accu = 0.3712

Training: Epoch 5 of 10 Step 1868 ntokens 245775120 Example 7200 of 138376 loss = 3.4975 nll loss = 2.1261 accu = 0.3718

Training: Epoch 5 of 10 Step 1869 ntokens 245810520 Example 7500 of 138376 loss = 3.5004 nll loss = 2.1266 accu = 0.3716

Training: Epoch 5 of 10 Step 1870 ntokens 245845920 Example 7800 of 138376 loss = 3.4992 nll loss = 2.1269 accu = 0.3716

Training: Epoch 5 of 10 Step 1871 ntokens 245881320 Example 8100 of 138376 loss = 3.5006 nll loss = 2.1272 accu = 0.3715

Training: Epoch 5 of 10 Step 1872 ntokens 245916720 Example 8400 of 138376 loss = 3.5044 nll loss = 2.1272 accu = 0.3715

Training: Epoch 5 of 10 Step 1873 ntokens 245952120 Example 8700 of 138376 loss = 3.5038 nll loss = 2.1279 accu = 0.3712

Training: Epoch 5 of 10 Step 1874 ntokens 245987520 Example 9000 of 138376 loss = 3.5019 nll loss = 2.1306 accu = 0.3703

Training: Epoch 5 of 10 Step 1875 ntokens 246022920 Example 9300 of 138376 loss = 3.5042 nll loss = 2.1311 accu = 0.3700

Training: Epoch 5 of 10 Step 1876 ntokens 246058320 Example 9600 of 138376 loss = 3.5027 nll loss = 2.1314 accu = 0.3699

Training: Epoch 5 of 10 Step 1877 ntokens 246093720 Example 9900 of 138376 loss = 3.5046 nll loss = 2.1319 accu = 0.3698

Training: Epoch 5 of 10 Step 1878 ntokens 246129120 Example 10200 of 138376 loss = 3.5062 nll loss = 2.1303 accu = 0.3703

Training: Epoch 5 of 10 Step 1879 ntokens 246164520 Example 10500 of 138376 loss = 3.5044 nll loss = 2.1292 accu = 0.3707

Training: Epoch 5 of 10 Step 1880 ntokens 246199920 Example 10800 of 138376 loss = 3.5039 nll loss = 2.1304 accu = 0.3703

Training: Epoch 5 of 10 Step 1881 ntokens 246235320 Example 11100 of 138376 loss = 3.4994 nll loss = 2.1288 accu = 0.3709

Training: Epoch 5 of 10 Step 1882 ntokens 246270720 Example 11400 of 138376 loss = 3.5011 nll loss = 2.1280 accu = 0.3713

Training: Epoch 5 of 10 Step 1883 ntokens 246306120 Example 11700 of 138376 loss = 3.5012 nll loss = 2.1277 accu = 0.3714

Training: Epoch 5 of 10 Step 1884 ntokens 246341520 Example 12000 of 138376 loss = 3.4999 nll loss = 2.1265 accu = 0.3719

Training: Epoch 5 of 10 Step 1885 ntokens 246376920 Example 12300 of 138376 loss = 3.4985 nll loss = 2.1263 accu = 0.3719

Training: Epoch 5 of 10 Step 1886 ntokens 246412320 Example 12600 of 138376 loss = 3.5002 nll loss = 2.1248 accu = 0.3724

Training: Epoch 5 of 10 Step 1887 ntokens 246447720 Example 12900 of 138376 loss = 3.4999 nll loss = 2.1225 accu = 0.3732

Training: Epoch 5 of 10 Step 1888 ntokens 246483120 Example 13200 of 138376 loss = 3.5016 nll loss = 2.1242 accu = 0.3726

Training: Epoch 5 of 10 Step 1889 ntokens 246518520 Example 13500 of 138376 loss = 3.4994 nll loss = 2.1233 accu = 0.3729

Training: Epoch 5 of 10 Step 1890 ntokens 246553920 Example 13800 of 138376 loss = 3.4978 nll loss = 2.1228 accu = 0.3730

Training: Epoch 5 of 10 Step 1891 ntokens 246589320 Example 14100 of 138376 loss = 3.4994 nll loss = 2.1224 accu = 0.3731

Training: Epoch 5 of 10 Step 1892 ntokens 246624720 Example 14400 of 138376 loss = 3.4976 nll loss = 2.1238 accu = 0.3726

Training: Epoch 5 of 10 Step 1893 ntokens 246660120 Example 14700 of 138376 loss = 3.4967 nll loss = 2.1230 accu = 0.3729

Training: Epoch 5 of 10 Step 1894 ntokens 246695520 Example 15000 of 138376 loss = 3.4988 nll loss = 2.1241 accu = 0.3725

Training: Epoch 5 of 10 Step 1895 ntokens 246730920 Example 15300 of 138376 loss = 3.4973 nll loss = 2.1234 accu = 0.3727

Training: Epoch 5 of 10 Step 1896 ntokens 246766320 Example 15600 of 138376 loss = 3.4985 nll loss = 2.1227 accu = 0.3730

Training: Epoch 5 of 10 Step 1897 ntokens 246801720 Example 15900 of 138376 loss = 3.4975 nll loss = 2.1222 accu = 0.3732

Training: Epoch 5 of 10 Step 1898 ntokens 246837120 Example 16200 of 138376 loss = 3.4978 nll loss = 2.1244 accu = 0.3725

Training: Epoch 5 of 10 Step 1899 ntokens 246872520 Example 16500 of 138376 loss = 3.5006 nll loss = 2.1237 accu = 0.3728

Training: Epoch 5 of 10 Step 1900 ntokens 246907920 Example 16800 of 138376 loss = 3.5020 nll loss = 2.1239 accu = 0.3728

Training: Epoch 5 of 10 Step 1901 ntokens 246943320 Example 17100 of 138376 loss = 3.5030 nll loss = 2.1247 accu = 0.3726

Training: Epoch 5 of 10 Step 1902 ntokens 246978720 Example 17400 of 138376 loss = 3.5024 nll loss = 2.1249 accu = 0.3725

Training: Epoch 5 of 10 Step 1903 ntokens 247014120 Example 17700 of 138376 loss = 3.5011 nll loss = 2.1247 accu = 0.3726

Training: Epoch 5 of 10 Step 1904 ntokens 247049520 Example 18000 of 138376 loss = 3.5015 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 1905 ntokens 247084920 Example 18300 of 138376 loss = 3.5016 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 1906 ntokens 247120320 Example 18600 of 138376 loss = 3.5012 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 1907 ntokens 247155720 Example 18900 of 138376 loss = 3.5007 nll loss = 2.1239 accu = 0.3730

Training: Epoch 5 of 10 Step 1908 ntokens 247191120 Example 19200 of 138376 loss = 3.5001 nll loss = 2.1234 accu = 0.3732

Training: Epoch 5 of 10 Step 1909 ntokens 247226520 Example 19500 of 138376 loss = 3.4987 nll loss = 2.1239 accu = 0.3730

Training: Epoch 5 of 10 Step 1910 ntokens 247261920 Example 19800 of 138376 loss = 3.4988 nll loss = 2.1241 accu = 0.3729

Training: Epoch 5 of 10 Step 1911 ntokens 247297320 Example 20100 of 138376 loss = 3.4976 nll loss = 2.1231 accu = 0.3733

Training: Epoch 5 of 10 Step 1912 ntokens 247332720 Example 20400 of 138376 loss = 3.4979 nll loss = 2.1219 accu = 0.3737

Training: Epoch 5 of 10 Step 1913 ntokens 247368120 Example 20700 of 138376 loss = 3.4978 nll loss = 2.1218 accu = 0.3738

Training: Epoch 5 of 10 Step 1914 ntokens 247403520 Example 21000 of 138376 loss = 3.4987 nll loss = 2.1215 accu = 0.3739

Training: Epoch 5 of 10 Step 1915 ntokens 247438920 Example 21300 of 138376 loss = 3.5001 nll loss = 2.1221 accu = 0.3736

Training: Epoch 5 of 10 Step 1916 ntokens 247474320 Example 21600 of 138376 loss = 3.4986 nll loss = 2.1225 accu = 0.3735

Training: Epoch 5 of 10 Step 1917 ntokens 247509720 Example 21900 of 138376 loss = 3.4978 nll loss = 2.1233 accu = 0.3732

Training: Epoch 5 of 10 Step 1918 ntokens 247545120 Example 22200 of 138376 loss = 3.4979 nll loss = 2.1228 accu = 0.3734

Training: Epoch 5 of 10 Step 1919 ntokens 247580520 Example 22500 of 138376 loss = 3.4961 nll loss = 2.1224 accu = 0.3735

Training: Epoch 5 of 10 Step 1920 ntokens 247615920 Example 22800 of 138376 loss = 3.4961 nll loss = 2.1229 accu = 0.3734

Training: Epoch 5 of 10 Step 1921 ntokens 247651320 Example 23100 of 138376 loss = 3.4951 nll loss = 2.1228 accu = 0.3734

Training: Epoch 5 of 10 Step 1922 ntokens 247686720 Example 23400 of 138376 loss = 3.4965 nll loss = 2.1226 accu = 0.3734

Training: Epoch 5 of 10 Step 1923 ntokens 247722120 Example 23700 of 138376 loss = 3.4966 nll loss = 2.1233 accu = 0.3732

Training: Epoch 5 of 10 Step 1924 ntokens 247757520 Example 24000 of 138376 loss = 3.4968 nll loss = 2.1226 accu = 0.3734

Training: Epoch 5 of 10 Step 1925 ntokens 247792920 Example 24300 of 138376 loss = 3.4959 nll loss = 2.1224 accu = 0.3735

Training: Epoch 5 of 10 Step 1926 ntokens 247828320 Example 24600 of 138376 loss = 3.4957 nll loss = 2.1219 accu = 0.3736

Training: Epoch 5 of 10 Step 1927 ntokens 247863720 Example 24900 of 138376 loss = 3.4953 nll loss = 2.1217 accu = 0.3737

Training: Epoch 5 of 10 Step 1928 ntokens 247899120 Example 25200 of 138376 loss = 3.4946 nll loss = 2.1224 accu = 0.3734

Training: Epoch 5 of 10 Step 1929 ntokens 247934520 Example 25500 of 138376 loss = 3.4947 nll loss = 2.1230 accu = 0.3732

Training: Epoch 5 of 10 Step 1930 ntokens 247969920 Example 25800 of 138376 loss = 3.4938 nll loss = 2.1225 accu = 0.3734

Training: Epoch 5 of 10 Step 1931 ntokens 248005320 Example 26100 of 138376 loss = 3.4937 nll loss = 2.1226 accu = 0.3734

Training: Epoch 5 of 10 Step 1932 ntokens 248040720 Example 26400 of 138376 loss = 3.4942 nll loss = 2.1221 accu = 0.3735

Training: Epoch 5 of 10 Step 1933 ntokens 248076120 Example 26700 of 138376 loss = 3.4947 nll loss = 2.1220 accu = 0.3735

Training: Epoch 5 of 10 Step 1934 ntokens 248111520 Example 27000 of 138376 loss = 3.4957 nll loss = 2.1209 accu = 0.3739

Training: Epoch 5 of 10 Step 1935 ntokens 248146920 Example 27300 of 138376 loss = 3.4957 nll loss = 2.1199 accu = 0.3743

Training: Epoch 5 of 10 Step 1936 ntokens 248182320 Example 27600 of 138376 loss = 3.4965 nll loss = 2.1203 accu = 0.3741

Training: Epoch 5 of 10 Step 1937 ntokens 248217720 Example 27900 of 138376 loss = 3.4963 nll loss = 2.1207 accu = 0.3740

Training: Epoch 5 of 10 Step 1938 ntokens 248253120 Example 28200 of 138376 loss = 3.4960 nll loss = 2.1209 accu = 0.3739

Training: Epoch 5 of 10 Step 1939 ntokens 248288520 Example 28500 of 138376 loss = 3.4964 nll loss = 2.1214 accu = 0.3738

Training: Epoch 5 of 10 Step 1940 ntokens 248323920 Example 28800 of 138376 loss = 3.4969 nll loss = 2.1217 accu = 0.3736

Training: Epoch 5 of 10 Step 1941 ntokens 248359320 Example 29100 of 138376 loss = 3.4973 nll loss = 2.1215 accu = 0.3737

Training: Epoch 5 of 10 Step 1942 ntokens 248394720 Example 29400 of 138376 loss = 3.4967 nll loss = 2.1208 accu = 0.3739

Training: Epoch 5 of 10 Step 1943 ntokens 248430120 Example 29700 of 138376 loss = 3.4968 nll loss = 2.1216 accu = 0.3737

Training: Epoch 5 of 10 Step 1944 ntokens 248465520 Example 30000 of 138376 loss = 3.4970 nll loss = 2.1215 accu = 0.3737

Training: Epoch 5 of 10 Step 1945 ntokens 248500920 Example 30300 of 138376 loss = 3.4970 nll loss = 2.1215 accu = 0.3737

Training: Epoch 5 of 10 Step 1946 ntokens 248536320 Example 30600 of 138376 loss = 3.4973 nll loss = 2.1208 accu = 0.3740

Training: Epoch 5 of 10 Step 1947 ntokens 248571720 Example 30900 of 138376 loss = 3.4987 nll loss = 2.1207 accu = 0.3741

Training: Epoch 5 of 10 Step 1948 ntokens 248607120 Example 31200 of 138376 loss = 3.4990 nll loss = 2.1210 accu = 0.3740

Training: Epoch 5 of 10 Step 1949 ntokens 248642520 Example 31500 of 138376 loss = 3.4996 nll loss = 2.1202 accu = 0.3742

Training: Epoch 5 of 10 Step 1950 ntokens 248677920 Example 31800 of 138376 loss = 3.4994 nll loss = 2.1202 accu = 0.3742

Training: Epoch 5 of 10 Step 1951 ntokens 248713320 Example 32100 of 138376 loss = 3.5002 nll loss = 2.1210 accu = 0.3740

Training: Epoch 5 of 10 Step 1952 ntokens 248748720 Example 32400 of 138376 loss = 3.5009 nll loss = 2.1217 accu = 0.3738

Training: Epoch 5 of 10 Step 1953 ntokens 248784120 Example 32700 of 138376 loss = 3.5018 nll loss = 2.1226 accu = 0.3735

Training: Epoch 5 of 10 Step 1954 ntokens 248819520 Example 33000 of 138376 loss = 3.5017 nll loss = 2.1223 accu = 0.3735

Training: Epoch 5 of 10 Step 1955 ntokens 248854920 Example 33300 of 138376 loss = 3.5013 nll loss = 2.1209 accu = 0.3740

Training: Epoch 5 of 10 Step 1956 ntokens 248890320 Example 33600 of 138376 loss = 3.5014 nll loss = 2.1212 accu = 0.3739

Training: Epoch 5 of 10 Step 1957 ntokens 248925720 Example 33900 of 138376 loss = 3.5019 nll loss = 2.1217 accu = 0.3737

Training: Epoch 5 of 10 Step 1958 ntokens 248961120 Example 34200 of 138376 loss = 3.5017 nll loss = 2.1214 accu = 0.3739

Training: Epoch 5 of 10 Step 1959 ntokens 248996520 Example 34500 of 138376 loss = 3.5017 nll loss = 2.1212 accu = 0.3739

Training: Epoch 5 of 10 Step 1960 ntokens 249031920 Example 34800 of 138376 loss = 3.5019 nll loss = 2.1215 accu = 0.3738

Training: Epoch 5 of 10 Step 1961 ntokens 249067320 Example 35100 of 138376 loss = 3.5017 nll loss = 2.1213 accu = 0.3739

Training: Epoch 5 of 10 Step 1962 ntokens 249102720 Example 35400 of 138376 loss = 3.5021 nll loss = 2.1212 accu = 0.3739

Training: Epoch 5 of 10 Step 1963 ntokens 249138120 Example 35700 of 138376 loss = 3.5016 nll loss = 2.1214 accu = 0.3739

Training: Epoch 5 of 10 Step 1964 ntokens 249173520 Example 36000 of 138376 loss = 3.5015 nll loss = 2.1214 accu = 0.3738

Training: Epoch 5 of 10 Step 1965 ntokens 249208920 Example 36300 of 138376 loss = 3.5020 nll loss = 2.1215 accu = 0.3738

Training: Epoch 5 of 10 Step 1966 ntokens 249244320 Example 36600 of 138376 loss = 3.5020 nll loss = 2.1220 accu = 0.3736

Training: Epoch 5 of 10 Step 1967 ntokens 249279720 Example 36900 of 138376 loss = 3.5015 nll loss = 2.1225 accu = 0.3734

Training: Epoch 5 of 10 Step 1968 ntokens 249315120 Example 37200 of 138376 loss = 3.5014 nll loss = 2.1231 accu = 0.3732

Training: Epoch 5 of 10 Step 1969 ntokens 249350520 Example 37500 of 138376 loss = 3.5009 nll loss = 2.1229 accu = 0.3733

Training: Epoch 5 of 10 Step 1970 ntokens 249385920 Example 37800 of 138376 loss = 3.5010 nll loss = 2.1232 accu = 0.3732

Training: Epoch 5 of 10 Step 1971 ntokens 249421320 Example 38100 of 138376 loss = 3.5013 nll loss = 2.1228 accu = 0.3733

Training: Epoch 5 of 10 Step 1972 ntokens 249456720 Example 38400 of 138376 loss = 3.5013 nll loss = 2.1228 accu = 0.3733

Training: Epoch 5 of 10 Step 1973 ntokens 249492120 Example 38700 of 138376 loss = 3.5016 nll loss = 2.1230 accu = 0.3732

Training: Epoch 5 of 10 Step 1974 ntokens 249527520 Example 39000 of 138376 loss = 3.5016 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 1975 ntokens 249562920 Example 39300 of 138376 loss = 3.5014 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 1976 ntokens 249598320 Example 39600 of 138376 loss = 3.5012 nll loss = 2.1228 accu = 0.3733

Training: Epoch 5 of 10 Step 1977 ntokens 249633720 Example 39900 of 138376 loss = 3.5019 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 1978 ntokens 249669120 Example 40200 of 138376 loss = 3.5022 nll loss = 2.1237 accu = 0.3729

Training: Epoch 5 of 10 Step 1979 ntokens 249704520 Example 40500 of 138376 loss = 3.5016 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 1980 ntokens 249739920 Example 40800 of 138376 loss = 3.5017 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 1981 ntokens 249775320 Example 41100 of 138376 loss = 3.5021 nll loss = 2.1241 accu = 0.3728

Training: Epoch 5 of 10 Step 1982 ntokens 249810720 Example 41400 of 138376 loss = 3.5012 nll loss = 2.1242 accu = 0.3727

Training: Epoch 5 of 10 Step 1983 ntokens 249846120 Example 41700 of 138376 loss = 3.5016 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 1984 ntokens 249881520 Example 42000 of 138376 loss = 3.5023 nll loss = 2.1240 accu = 0.3728

Training: Epoch 5 of 10 Step 1985 ntokens 249916920 Example 42300 of 138376 loss = 3.5024 nll loss = 2.1247 accu = 0.3725

Training: Epoch 5 of 10 Step 1986 ntokens 249952320 Example 42600 of 138376 loss = 3.5020 nll loss = 2.1245 accu = 0.3726

Training: Epoch 5 of 10 Step 1987 ntokens 249987720 Example 42900 of 138376 loss = 3.5013 nll loss = 2.1246 accu = 0.3725

Training: Epoch 5 of 10 Step 1988 ntokens 250023120 Example 43200 of 138376 loss = 3.5018 nll loss = 2.1241 accu = 0.3727

Training: Epoch 5 of 10 Step 1989 ntokens 250058520 Example 43500 of 138376 loss = 3.5028 nll loss = 2.1241 accu = 0.3727

Training: Epoch 5 of 10 Step 1990 ntokens 250093920 Example 43800 of 138376 loss = 3.5029 nll loss = 2.1242 accu = 0.3727

Training: Epoch 5 of 10 Step 1991 ntokens 250129320 Example 44100 of 138376 loss = 3.5024 nll loss = 2.1240 accu = 0.3727

Training: Epoch 5 of 10 Step 1992 ntokens 250164720 Example 44400 of 138376 loss = 3.5019 nll loss = 2.1240 accu = 0.3728

Training: Epoch 5 of 10 Step 1993 ntokens 250200120 Example 44700 of 138376 loss = 3.5026 nll loss = 2.1239 accu = 0.3728

Training: Epoch 5 of 10 Step 1994 ntokens 250235520 Example 45000 of 138376 loss = 3.5022 nll loss = 2.1234 accu = 0.3730

Training: Epoch 5 of 10 Step 1995 ntokens 250270920 Example 45300 of 138376 loss = 3.5018 nll loss = 2.1238 accu = 0.3728

Training: Epoch 5 of 10 Step 1996 ntokens 250306320 Example 45600 of 138376 loss = 3.5017 nll loss = 2.1243 accu = 0.3727

Training: Epoch 5 of 10 Step 1997 ntokens 250341720 Example 45900 of 138376 loss = 3.5020 nll loss = 2.1240 accu = 0.3728

Training: Epoch 5 of 10 Step 1998 ntokens 250377120 Example 46200 of 138376 loss = 3.5019 nll loss = 2.1239 accu = 0.3728

Training: Epoch 5 of 10 Step 1999 ntokens 250412520 Example 46500 of 138376 loss = 3.5017 nll loss = 2.1234 accu = 0.3730

Training: Epoch 5 of 10 Step 2000 ntokens 250447920 Example 46800 of 138376 loss = 3.5019 nll loss = 2.1234 accu = 0.3730

Training: Epoch 5 of 10 Step 2001 ntokens 250483320 Example 47100 of 138376 loss = 3.5016 nll loss = 2.1229 accu = 0.3732

Training: Epoch 5 of 10 Step 2002 ntokens 250518720 Example 47400 of 138376 loss = 3.5019 nll loss = 2.1232 accu = 0.3731

Training: Epoch 5 of 10 Step 2003 ntokens 250554120 Example 47700 of 138376 loss = 3.5010 nll loss = 2.1230 accu = 0.3732

Training: Epoch 5 of 10 Step 2004 ntokens 250589520 Example 48000 of 138376 loss = 3.5010 nll loss = 2.1228 accu = 0.3732

Training: Epoch 5 of 10 Step 2005 ntokens 250624920 Example 48300 of 138376 loss = 3.5010 nll loss = 2.1227 accu = 0.3732

Training: Epoch 5 of 10 Step 2006 ntokens 250660320 Example 48600 of 138376 loss = 3.5010 nll loss = 2.1230 accu = 0.3732

Training: Epoch 5 of 10 Step 2007 ntokens 250695720 Example 48900 of 138376 loss = 3.5016 nll loss = 2.1232 accu = 0.3731

Training: Epoch 5 of 10 Step 2008 ntokens 250731120 Example 49200 of 138376 loss = 3.5009 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2009 ntokens 250766520 Example 49500 of 138376 loss = 3.5008 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 2010 ntokens 250801920 Example 49800 of 138376 loss = 3.5006 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 2011 ntokens 250837320 Example 50100 of 138376 loss = 3.5007 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 2012 ntokens 250872720 Example 50400 of 138376 loss = 3.5001 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 2013 ntokens 250908120 Example 50700 of 138376 loss = 3.5004 nll loss = 2.1241 accu = 0.3729

Training: Epoch 5 of 10 Step 2014 ntokens 250943520 Example 51000 of 138376 loss = 3.5000 nll loss = 2.1245 accu = 0.3728

Training: Epoch 5 of 10 Step 2015 ntokens 250978920 Example 51300 of 138376 loss = 3.4999 nll loss = 2.1243 accu = 0.3729

Training: Epoch 5 of 10 Step 2016 ntokens 251014320 Example 51600 of 138376 loss = 3.5001 nll loss = 2.1239 accu = 0.3730

Training: Epoch 5 of 10 Step 2017 ntokens 251049720 Example 51900 of 138376 loss = 3.4998 nll loss = 2.1245 accu = 0.3728

Training: Epoch 5 of 10 Step 2018 ntokens 251085120 Example 52200 of 138376 loss = 3.4998 nll loss = 2.1247 accu = 0.3727

Training: Epoch 5 of 10 Step 2019 ntokens 251120520 Example 52500 of 138376 loss = 3.4997 nll loss = 2.1250 accu = 0.3727

Training: Epoch 5 of 10 Step 2020 ntokens 251155920 Example 52800 of 138376 loss = 3.5000 nll loss = 2.1249 accu = 0.3727

Training: Epoch 5 of 10 Step 2021 ntokens 251191320 Example 53100 of 138376 loss = 3.4998 nll loss = 2.1249 accu = 0.3727

Training: Epoch 5 of 10 Step 2022 ntokens 251226720 Example 53400 of 138376 loss = 3.4992 nll loss = 2.1246 accu = 0.3728

Training: Epoch 5 of 10 Step 2023 ntokens 251262120 Example 53700 of 138376 loss = 3.4988 nll loss = 2.1243 accu = 0.3729

Training: Epoch 5 of 10 Step 2024 ntokens 251297520 Example 54000 of 138376 loss = 3.4995 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2025 ntokens 251332920 Example 54300 of 138376 loss = 3.4995 nll loss = 2.1248 accu = 0.3727

Training: Epoch 5 of 10 Step 2026 ntokens 251368320 Example 54600 of 138376 loss = 3.4996 nll loss = 2.1251 accu = 0.3726

Training: Epoch 5 of 10 Step 2027 ntokens 251403720 Example 54900 of 138376 loss = 3.4997 nll loss = 2.1249 accu = 0.3727

Training: Epoch 5 of 10 Step 2028 ntokens 251439120 Example 55200 of 138376 loss = 3.5002 nll loss = 2.1246 accu = 0.3727

Training: Epoch 5 of 10 Step 2029 ntokens 251474520 Example 55500 of 138376 loss = 3.5001 nll loss = 2.1248 accu = 0.3727

Training: Epoch 5 of 10 Step 2030 ntokens 251509920 Example 55800 of 138376 loss = 3.4995 nll loss = 2.1247 accu = 0.3727

Training: Epoch 5 of 10 Step 2031 ntokens 251545320 Example 56100 of 138376 loss = 3.4997 nll loss = 2.1243 accu = 0.3728

Training: Epoch 5 of 10 Step 2032 ntokens 251580720 Example 56400 of 138376 loss = 3.5002 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2033 ntokens 251616120 Example 56700 of 138376 loss = 3.5003 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2034 ntokens 251651520 Example 57000 of 138376 loss = 3.5000 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2035 ntokens 251686920 Example 57300 of 138376 loss = 3.5002 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2036 ntokens 251722320 Example 57600 of 138376 loss = 3.5001 nll loss = 2.1247 accu = 0.3727

Training: Epoch 5 of 10 Step 2037 ntokens 251757720 Example 57900 of 138376 loss = 3.4998 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2038 ntokens 251793120 Example 58200 of 138376 loss = 3.4993 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2039 ntokens 251828520 Example 58500 of 138376 loss = 3.4996 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2040 ntokens 251863920 Example 58800 of 138376 loss = 3.5001 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2041 ntokens 251899320 Example 59100 of 138376 loss = 3.5003 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2042 ntokens 251934720 Example 59400 of 138376 loss = 3.5000 nll loss = 2.1254 accu = 0.3725

Training: Epoch 5 of 10 Step 2043 ntokens 251970120 Example 59700 of 138376 loss = 3.5007 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2044 ntokens 252005520 Example 60000 of 138376 loss = 3.5008 nll loss = 2.1258 accu = 0.3723

Training: Epoch 5 of 10 Step 2045 ntokens 252040920 Example 60300 of 138376 loss = 3.5002 nll loss = 2.1260 accu = 0.3722

Training: Epoch 5 of 10 Step 2046 ntokens 252076320 Example 60600 of 138376 loss = 3.5004 nll loss = 2.1264 accu = 0.3721

Training: Epoch 5 of 10 Step 2047 ntokens 252111720 Example 60900 of 138376 loss = 3.5004 nll loss = 2.1263 accu = 0.3721

Training: Epoch 5 of 10 Step 2048 ntokens 252147120 Example 61200 of 138376 loss = 3.5005 nll loss = 2.1261 accu = 0.3722

Training: Epoch 5 of 10 Step 2049 ntokens 252182520 Example 61500 of 138376 loss = 3.5005 nll loss = 2.1260 accu = 0.3722

Training: Epoch 5 of 10 Step 2050 ntokens 252217920 Example 61800 of 138376 loss = 3.5008 nll loss = 2.1257 accu = 0.3724

Training: Epoch 5 of 10 Step 2051 ntokens 252253320 Example 62100 of 138376 loss = 3.5002 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2052 ntokens 252288720 Example 62400 of 138376 loss = 3.4997 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2053 ntokens 252324120 Example 62700 of 138376 loss = 3.4993 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2054 ntokens 252359520 Example 63000 of 138376 loss = 3.4994 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2055 ntokens 252394920 Example 63300 of 138376 loss = 3.4997 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2056 ntokens 252430320 Example 63600 of 138376 loss = 3.4995 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2057 ntokens 252465720 Example 63900 of 138376 loss = 3.4997 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2058 ntokens 252501120 Example 64200 of 138376 loss = 3.4998 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2059 ntokens 252536520 Example 64500 of 138376 loss = 3.4990 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2060 ntokens 252571920 Example 64800 of 138376 loss = 3.4987 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2061 ntokens 252607320 Example 65100 of 138376 loss = 3.4983 nll loss = 2.1243 accu = 0.3728

Training: Epoch 5 of 10 Step 2062 ntokens 252642720 Example 65400 of 138376 loss = 3.4982 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2063 ntokens 252678120 Example 65700 of 138376 loss = 3.4984 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2064 ntokens 252713520 Example 66000 of 138376 loss = 3.4981 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2065 ntokens 252748920 Example 66300 of 138376 loss = 3.4987 nll loss = 2.1247 accu = 0.3727

Training: Epoch 5 of 10 Step 2066 ntokens 252784320 Example 66600 of 138376 loss = 3.4985 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2067 ntokens 252819720 Example 66900 of 138376 loss = 3.4983 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2068 ntokens 252855120 Example 67200 of 138376 loss = 3.4989 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2069 ntokens 252890520 Example 67500 of 138376 loss = 3.4990 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2070 ntokens 252925920 Example 67800 of 138376 loss = 3.4988 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2071 ntokens 252961320 Example 68100 of 138376 loss = 3.4987 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2072 ntokens 252996720 Example 68400 of 138376 loss = 3.4984 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2073 ntokens 253032120 Example 68700 of 138376 loss = 3.4985 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2074 ntokens 253067520 Example 69000 of 138376 loss = 3.4981 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2075 ntokens 253102920 Example 69300 of 138376 loss = 3.4980 nll loss = 2.1250 accu = 0.3725

Training: Epoch 5 of 10 Step 2076 ntokens 253138320 Example 69600 of 138376 loss = 3.4984 nll loss = 2.1247 accu = 0.3727

Training: Epoch 5 of 10 Step 2077 ntokens 253173720 Example 69900 of 138376 loss = 3.4986 nll loss = 2.1247 accu = 0.3726

Training: Epoch 5 of 10 Step 2078 ntokens 253209120 Example 70200 of 138376 loss = 3.4986 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2079 ntokens 253244520 Example 70500 of 138376 loss = 3.4992 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2080 ntokens 253279920 Example 70800 of 138376 loss = 3.4994 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2081 ntokens 253315320 Example 71100 of 138376 loss = 3.4994 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2082 ntokens 253350720 Example 71400 of 138376 loss = 3.4994 nll loss = 2.1252 accu = 0.3724

Training: Epoch 5 of 10 Step 2083 ntokens 253386120 Example 71700 of 138376 loss = 3.5000 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2084 ntokens 253421520 Example 72000 of 138376 loss = 3.5001 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2085 ntokens 253456920 Example 72300 of 138376 loss = 3.5000 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2086 ntokens 253492320 Example 72600 of 138376 loss = 3.5003 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2087 ntokens 253527720 Example 72900 of 138376 loss = 3.5001 nll loss = 2.1250 accu = 0.3725

Training: Epoch 5 of 10 Step 2088 ntokens 253563120 Example 73200 of 138376 loss = 3.5003 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2089 ntokens 253598520 Example 73500 of 138376 loss = 3.4998 nll loss = 2.1249 accu = 0.3725

Training: Epoch 5 of 10 Step 2090 ntokens 253633920 Example 73800 of 138376 loss = 3.4998 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2091 ntokens 253669320 Example 74100 of 138376 loss = 3.4997 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2092 ntokens 253704720 Example 74400 of 138376 loss = 3.4996 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2093 ntokens 253740120 Example 74700 of 138376 loss = 3.4998 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2094 ntokens 253775520 Example 75000 of 138376 loss = 3.4997 nll loss = 2.1255 accu = 0.3723

Training: Epoch 5 of 10 Step 2095 ntokens 253810920 Example 75300 of 138376 loss = 3.4995 nll loss = 2.1255 accu = 0.3723

Training: Epoch 5 of 10 Step 2096 ntokens 253846320 Example 75600 of 138376 loss = 3.4994 nll loss = 2.1255 accu = 0.3723

Training: Epoch 5 of 10 Step 2097 ntokens 253881720 Example 75900 of 138376 loss = 3.4995 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2098 ntokens 253917120 Example 76200 of 138376 loss = 3.4997 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2099 ntokens 253952520 Example 76500 of 138376 loss = 3.4998 nll loss = 2.1252 accu = 0.3724

Training: Epoch 5 of 10 Step 2100 ntokens 253987920 Example 76800 of 138376 loss = 3.5001 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2101 ntokens 254023320 Example 77100 of 138376 loss = 3.4998 nll loss = 2.1255 accu = 0.3723

Training: Epoch 5 of 10 Step 2102 ntokens 254058720 Example 77400 of 138376 loss = 3.4996 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2103 ntokens 254094120 Example 77700 of 138376 loss = 3.4998 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2104 ntokens 254129520 Example 78000 of 138376 loss = 3.4997 nll loss = 2.1251 accu = 0.3724

Training: Epoch 5 of 10 Step 2105 ntokens 254164920 Example 78300 of 138376 loss = 3.5002 nll loss = 2.1251 accu = 0.3724

Training: Epoch 5 of 10 Step 2106 ntokens 254200320 Example 78600 of 138376 loss = 3.5005 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2107 ntokens 254235720 Example 78900 of 138376 loss = 3.5007 nll loss = 2.1252 accu = 0.3724

Training: Epoch 5 of 10 Step 2108 ntokens 254271120 Example 79200 of 138376 loss = 3.5008 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2109 ntokens 254306520 Example 79500 of 138376 loss = 3.5003 nll loss = 2.1252 accu = 0.3724

Training: Epoch 5 of 10 Step 2110 ntokens 254341920 Example 79800 of 138376 loss = 3.5004 nll loss = 2.1254 accu = 0.3723

Training: Epoch 5 of 10 Step 2111 ntokens 254377320 Example 80100 of 138376 loss = 3.5003 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2112 ntokens 254412720 Example 80400 of 138376 loss = 3.5007 nll loss = 2.1255 accu = 0.3723

Training: Epoch 5 of 10 Step 2113 ntokens 254448120 Example 80700 of 138376 loss = 3.5008 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2114 ntokens 254483520 Example 81000 of 138376 loss = 3.5010 nll loss = 2.1255 accu = 0.3723

Training: Epoch 5 of 10 Step 2115 ntokens 254518920 Example 81300 of 138376 loss = 3.5010 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2116 ntokens 254554320 Example 81600 of 138376 loss = 3.5013 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2117 ntokens 254589720 Example 81900 of 138376 loss = 3.5017 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2118 ntokens 254625120 Example 82200 of 138376 loss = 3.5016 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2119 ntokens 254660520 Example 82500 of 138376 loss = 3.5014 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2120 ntokens 254695920 Example 82800 of 138376 loss = 3.5013 nll loss = 2.1252 accu = 0.3724

Training: Epoch 5 of 10 Step 2121 ntokens 254731320 Example 83100 of 138376 loss = 3.5011 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2122 ntokens 254766720 Example 83400 of 138376 loss = 3.5009 nll loss = 2.1252 accu = 0.3724

Training: Epoch 5 of 10 Step 2123 ntokens 254802120 Example 83700 of 138376 loss = 3.5010 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2124 ntokens 254837520 Example 84000 of 138376 loss = 3.5012 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2125 ntokens 254872920 Example 84300 of 138376 loss = 3.5010 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2126 ntokens 254908320 Example 84600 of 138376 loss = 3.5006 nll loss = 2.1249 accu = 0.3725

Training: Epoch 5 of 10 Step 2127 ntokens 254943720 Example 84900 of 138376 loss = 3.5009 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2128 ntokens 254979120 Example 85200 of 138376 loss = 3.5012 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2129 ntokens 255014520 Example 85500 of 138376 loss = 3.5016 nll loss = 2.1250 accu = 0.3725

Training: Epoch 5 of 10 Step 2130 ntokens 255049920 Example 85800 of 138376 loss = 3.5015 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2131 ntokens 255085320 Example 86100 of 138376 loss = 3.5016 nll loss = 2.1250 accu = 0.3725

Training: Epoch 5 of 10 Step 2132 ntokens 255120720 Example 86400 of 138376 loss = 3.5023 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2133 ntokens 255156120 Example 86700 of 138376 loss = 3.5027 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2134 ntokens 255191520 Example 87000 of 138376 loss = 3.5026 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2135 ntokens 255226920 Example 87300 of 138376 loss = 3.5026 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2136 ntokens 255262320 Example 87600 of 138376 loss = 3.5023 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2137 ntokens 255297720 Example 87900 of 138376 loss = 3.5024 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2138 ntokens 255333120 Example 88200 of 138376 loss = 3.5023 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2139 ntokens 255368520 Example 88500 of 138376 loss = 3.5023 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2140 ntokens 255403920 Example 88800 of 138376 loss = 3.5023 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2141 ntokens 255439320 Example 89100 of 138376 loss = 3.5024 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2142 ntokens 255474720 Example 89400 of 138376 loss = 3.5021 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2143 ntokens 255510120 Example 89700 of 138376 loss = 3.5020 nll loss = 2.1253 accu = 0.3724

Training: Epoch 5 of 10 Step 2144 ntokens 255545520 Example 90000 of 138376 loss = 3.5023 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2145 ntokens 255580920 Example 90300 of 138376 loss = 3.5023 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2146 ntokens 255616320 Example 90600 of 138376 loss = 3.5023 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2147 ntokens 255651720 Example 90900 of 138376 loss = 3.5027 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2148 ntokens 255687120 Example 91200 of 138376 loss = 3.5026 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2149 ntokens 255722520 Example 91500 of 138376 loss = 3.5025 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2150 ntokens 255757920 Example 91800 of 138376 loss = 3.5026 nll loss = 2.1246 accu = 0.3727

Training: Epoch 5 of 10 Step 2151 ntokens 255793320 Example 92100 of 138376 loss = 3.5027 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 2152 ntokens 255828720 Example 92400 of 138376 loss = 3.5030 nll loss = 2.1244 accu = 0.3728

Training: Epoch 5 of 10 Step 2153 ntokens 255864120 Example 92700 of 138376 loss = 3.5029 nll loss = 2.1241 accu = 0.3728

Training: Epoch 5 of 10 Step 2154 ntokens 255899520 Example 93000 of 138376 loss = 3.5027 nll loss = 2.1241 accu = 0.3729

Training: Epoch 5 of 10 Step 2155 ntokens 255934920 Example 93300 of 138376 loss = 3.5028 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2156 ntokens 255970320 Example 93600 of 138376 loss = 3.5024 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 2157 ntokens 256005720 Example 93900 of 138376 loss = 3.5022 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 2158 ntokens 256041120 Example 94200 of 138376 loss = 3.5019 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 2159 ntokens 256076520 Example 94500 of 138376 loss = 3.5019 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 2160 ntokens 256111920 Example 94800 of 138376 loss = 3.5019 nll loss = 2.1235 accu = 0.3731

Training: Epoch 5 of 10 Step 2161 ntokens 256147320 Example 95100 of 138376 loss = 3.5021 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2162 ntokens 256182720 Example 95400 of 138376 loss = 3.5021 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2163 ntokens 256218120 Example 95700 of 138376 loss = 3.5021 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 2164 ntokens 256253520 Example 96000 of 138376 loss = 3.5018 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 2165 ntokens 256288920 Example 96300 of 138376 loss = 3.5017 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2166 ntokens 256324320 Example 96600 of 138376 loss = 3.5014 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 2167 ntokens 256359720 Example 96900 of 138376 loss = 3.5014 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2168 ntokens 256395120 Example 97200 of 138376 loss = 3.5016 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2169 ntokens 256430520 Example 97500 of 138376 loss = 3.5019 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2170 ntokens 256465920 Example 97800 of 138376 loss = 3.5017 nll loss = 2.1232 accu = 0.3731

Training: Epoch 5 of 10 Step 2171 ntokens 256501320 Example 98100 of 138376 loss = 3.5018 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2172 ntokens 256536720 Example 98400 of 138376 loss = 3.5020 nll loss = 2.1234 accu = 0.3731

Training: Epoch 5 of 10 Step 2173 ntokens 256572120 Example 98700 of 138376 loss = 3.5018 nll loss = 2.1234 accu = 0.3731

Training: Epoch 5 of 10 Step 2174 ntokens 256607520 Example 99000 of 138376 loss = 3.5019 nll loss = 2.1232 accu = 0.3732

Training: Epoch 5 of 10 Step 2175 ntokens 256642920 Example 99300 of 138376 loss = 3.5017 nll loss = 2.1231 accu = 0.3732

Training: Epoch 5 of 10 Step 2176 ntokens 256678320 Example 99600 of 138376 loss = 3.5018 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2177 ntokens 256713720 Example 99900 of 138376 loss = 3.5019 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2178 ntokens 256749120 Example 100200 of 138376 loss = 3.5018 nll loss = 2.1232 accu = 0.3731

Training: Epoch 5 of 10 Step 2179 ntokens 256784520 Example 100500 of 138376 loss = 3.5018 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2180 ntokens 256819920 Example 100800 of 138376 loss = 3.5017 nll loss = 2.1232 accu = 0.3732

Training: Epoch 5 of 10 Step 2181 ntokens 256855320 Example 101100 of 138376 loss = 3.5018 nll loss = 2.1232 accu = 0.3732

Training: Epoch 5 of 10 Step 2182 ntokens 256890720 Example 101400 of 138376 loss = 3.5016 nll loss = 2.1231 accu = 0.3732

Training: Epoch 5 of 10 Step 2183 ntokens 256926120 Example 101700 of 138376 loss = 3.5017 nll loss = 2.1232 accu = 0.3732

Training: Epoch 5 of 10 Step 2184 ntokens 256961520 Example 102000 of 138376 loss = 3.5015 nll loss = 2.1231 accu = 0.3732

Training: Epoch 5 of 10 Step 2185 ntokens 256996920 Example 102300 of 138376 loss = 3.5015 nll loss = 2.1231 accu = 0.3732

Training: Epoch 5 of 10 Step 2186 ntokens 257032320 Example 102600 of 138376 loss = 3.5013 nll loss = 2.1233 accu = 0.3731

Training: Epoch 5 of 10 Step 2187 ntokens 257067720 Example 102900 of 138376 loss = 3.5012 nll loss = 2.1231 accu = 0.3732

Training: Epoch 5 of 10 Step 2188 ntokens 257103120 Example 103200 of 138376 loss = 3.5011 nll loss = 2.1232 accu = 0.3732

Training: Epoch 5 of 10 Step 2189 ntokens 257138520 Example 103500 of 138376 loss = 3.5007 nll loss = 2.1234 accu = 0.3731

Training: Epoch 5 of 10 Step 2190 ntokens 257173920 Example 103800 of 138376 loss = 3.5013 nll loss = 2.1233 accu = 0.3732

Training: Epoch 5 of 10 Step 2191 ntokens 257209320 Example 104100 of 138376 loss = 3.5014 nll loss = 2.1235 accu = 0.3731

Training: Epoch 5 of 10 Step 2192 ntokens 257244720 Example 104400 of 138376 loss = 3.5015 nll loss = 2.1234 accu = 0.3731

Training: Epoch 5 of 10 Step 2193 ntokens 257280120 Example 104700 of 138376 loss = 3.5011 nll loss = 2.1235 accu = 0.3731

Training: Epoch 5 of 10 Step 2194 ntokens 257315520 Example 105000 of 138376 loss = 3.5013 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2195 ntokens 257350920 Example 105300 of 138376 loss = 3.5014 nll loss = 2.1235 accu = 0.3731

Training: Epoch 5 of 10 Step 2196 ntokens 257386320 Example 105600 of 138376 loss = 3.5010 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2197 ntokens 257421720 Example 105900 of 138376 loss = 3.5010 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 2198 ntokens 257457120 Example 106200 of 138376 loss = 3.5009 nll loss = 2.1240 accu = 0.3729

Training: Epoch 5 of 10 Step 2199 ntokens 257492520 Example 106500 of 138376 loss = 3.5012 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 2200 ntokens 257527920 Example 106800 of 138376 loss = 3.5012 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2201 ntokens 257563320 Example 107100 of 138376 loss = 3.5012 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2202 ntokens 257598720 Example 107400 of 138376 loss = 3.5013 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2203 ntokens 257634120 Example 107700 of 138376 loss = 3.5012 nll loss = 2.1238 accu = 0.3730

Training: Epoch 5 of 10 Step 2204 ntokens 257669520 Example 108000 of 138376 loss = 3.5013 nll loss = 2.1236 accu = 0.3730

Training: Epoch 5 of 10 Step 2205 ntokens 257704920 Example 108300 of 138376 loss = 3.5013 nll loss = 2.1237 accu = 0.3730

Training: Epoch 5 of 10 Step 2206 ntokens 257740320 Example 108600 of 138376 loss = 3.5013 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 2207 ntokens 257775720 Example 108900 of 138376 loss = 3.5014 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 2208 ntokens 257811120 Example 109200 of 138376 loss = 3.5013 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2209 ntokens 257846520 Example 109500 of 138376 loss = 3.5014 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2210 ntokens 257881920 Example 109800 of 138376 loss = 3.5014 nll loss = 2.1238 accu = 0.3729

Training: Epoch 5 of 10 Step 2211 ntokens 257917320 Example 110100 of 138376 loss = 3.5014 nll loss = 2.1239 accu = 0.3729

Training: Epoch 5 of 10 Step 2212 ntokens 257952720 Example 110400 of 138376 loss = 3.5015 nll loss = 2.1240 accu = 0.3729

Training: Epoch 5 of 10 Step 2213 ntokens 257988120 Example 110700 of 138376 loss = 3.5016 nll loss = 2.1241 accu = 0.3728

Training: Epoch 5 of 10 Step 2214 ntokens 258023520 Example 111000 of 138376 loss = 3.5018 nll loss = 2.1242 accu = 0.3728

Training: Epoch 5 of 10 Step 2215 ntokens 258058920 Example 111300 of 138376 loss = 3.5019 nll loss = 2.1243 accu = 0.3728

Training: Epoch 5 of 10 Step 2216 ntokens 258094320 Example 111600 of 138376 loss = 3.5022 nll loss = 2.1244 accu = 0.3727

Training: Epoch 5 of 10 Step 2217 ntokens 258129720 Example 111900 of 138376 loss = 3.5022 nll loss = 2.1244 accu = 0.3727

Training: Epoch 5 of 10 Step 2218 ntokens 258165120 Example 112200 of 138376 loss = 3.5020 nll loss = 2.1243 accu = 0.3728

Training: Epoch 5 of 10 Step 2219 ntokens 258200520 Example 112500 of 138376 loss = 3.5018 nll loss = 2.1243 accu = 0.3728

Training: Epoch 5 of 10 Step 2220 ntokens 258235920 Example 112800 of 138376 loss = 3.5017 nll loss = 2.1244 accu = 0.3727

Training: Epoch 5 of 10 Step 2221 ntokens 258271320 Example 113100 of 138376 loss = 3.5016 nll loss = 2.1244 accu = 0.3727

Training: Epoch 5 of 10 Step 2222 ntokens 258306720 Example 113400 of 138376 loss = 3.5015 nll loss = 2.1244 accu = 0.3727

Training: Epoch 5 of 10 Step 2223 ntokens 258342120 Example 113700 of 138376 loss = 3.5016 nll loss = 2.1244 accu = 0.3728

Training: Epoch 5 of 10 Step 2224 ntokens 258377520 Example 114000 of 138376 loss = 3.5015 nll loss = 2.1246 accu = 0.3727

Training: Epoch 5 of 10 Step 2225 ntokens 258412920 Example 114300 of 138376 loss = 3.5016 nll loss = 2.1247 accu = 0.3726

Training: Epoch 5 of 10 Step 2226 ntokens 258448320 Example 114600 of 138376 loss = 3.5016 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2227 ntokens 258483720 Example 114900 of 138376 loss = 3.5018 nll loss = 2.1246 accu = 0.3726

Training: Epoch 5 of 10 Step 2228 ntokens 258519120 Example 115200 of 138376 loss = 3.5019 nll loss = 2.1247 accu = 0.3726

Training: Epoch 5 of 10 Step 2229 ntokens 258554520 Example 115500 of 138376 loss = 3.5017 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 2230 ntokens 258589920 Example 115800 of 138376 loss = 3.5018 nll loss = 2.1246 accu = 0.3727

Training: Epoch 5 of 10 Step 2231 ntokens 258625320 Example 116100 of 138376 loss = 3.5019 nll loss = 2.1246 accu = 0.3727

Training: Epoch 5 of 10 Step 2232 ntokens 258660720 Example 116400 of 138376 loss = 3.5019 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 2233 ntokens 258696120 Example 116700 of 138376 loss = 3.5019 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 2234 ntokens 258731520 Example 117000 of 138376 loss = 3.5019 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 2235 ntokens 258766920 Example 117300 of 138376 loss = 3.5018 nll loss = 2.1244 accu = 0.3727

Training: Epoch 5 of 10 Step 2236 ntokens 258802320 Example 117600 of 138376 loss = 3.5015 nll loss = 2.1243 accu = 0.3728

Training: Epoch 5 of 10 Step 2237 ntokens 258837720 Example 117900 of 138376 loss = 3.5014 nll loss = 2.1245 accu = 0.3727

Training: Epoch 5 of 10 Step 2238 ntokens 258873120 Example 118200 of 138376 loss = 3.5013 nll loss = 2.1246 accu = 0.3727

Training: Epoch 5 of 10 Step 2239 ntokens 258908520 Example 118500 of 138376 loss = 3.5011 nll loss = 2.1247 accu = 0.3727

Training: Epoch 5 of 10 Step 2240 ntokens 258943920 Example 118800 of 138376 loss = 3.5010 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2241 ntokens 258979320 Example 119100 of 138376 loss = 3.5008 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2242 ntokens 259014720 Example 119400 of 138376 loss = 3.5006 nll loss = 2.1248 accu = 0.3726

Training: Epoch 5 of 10 Step 2243 ntokens 259050120 Example 119700 of 138376 loss = 3.5006 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2244 ntokens 259085520 Example 120000 of 138376 loss = 3.5006 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2245 ntokens 259120920 Example 120300 of 138376 loss = 3.5004 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2246 ntokens 259156320 Example 120600 of 138376 loss = 3.5003 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2247 ntokens 259191720 Example 120900 of 138376 loss = 3.5007 nll loss = 2.1250 accu = 0.3725

Training: Epoch 5 of 10 Step 2248 ntokens 259227120 Example 121200 of 138376 loss = 3.5004 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2249 ntokens 259262520 Example 121500 of 138376 loss = 3.5007 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2250 ntokens 259297920 Example 121800 of 138376 loss = 3.5004 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2251 ntokens 259333320 Example 122100 of 138376 loss = 3.5005 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2252 ntokens 259368720 Example 122400 of 138376 loss = 3.5004 nll loss = 2.1249 accu = 0.3726

Training: Epoch 5 of 10 Step 2253 ntokens 259404120 Example 122700 of 138376 loss = 3.5003 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2254 ntokens 259439520 Example 123000 of 138376 loss = 3.5003 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2255 ntokens 259474920 Example 123300 of 138376 loss = 3.5005 nll loss = 2.1251 accu = 0.3725

Training: Epoch 5 of 10 Step 2256 ntokens 259510320 Example 123600 of 138376 loss = 3.5005 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2257 ntokens 259545720 Example 123900 of 138376 loss = 3.5005 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2258 ntokens 259581120 Example 124200 of 138376 loss = 3.5006 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2259 ntokens 259616520 Example 124500 of 138376 loss = 3.5007 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2260 ntokens 259651920 Example 124800 of 138376 loss = 3.5008 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2261 ntokens 259687320 Example 125100 of 138376 loss = 3.5006 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2262 ntokens 259722720 Example 125400 of 138376 loss = 3.5009 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2263 ntokens 259758120 Example 125700 of 138376 loss = 3.5008 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2264 ntokens 259793520 Example 126000 of 138376 loss = 3.5006 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2265 ntokens 259828920 Example 126300 of 138376 loss = 3.5005 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2266 ntokens 259864320 Example 126600 of 138376 loss = 3.5005 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2267 ntokens 259899720 Example 126900 of 138376 loss = 3.5004 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2268 ntokens 259935120 Example 127200 of 138376 loss = 3.5003 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2269 ntokens 259970520 Example 127500 of 138376 loss = 3.5002 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2270 ntokens 260005920 Example 127800 of 138376 loss = 3.5003 nll loss = 2.1257 accu = 0.3723

Training: Epoch 5 of 10 Step 2271 ntokens 260041320 Example 128100 of 138376 loss = 3.5004 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2272 ntokens 260076720 Example 128400 of 138376 loss = 3.5001 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2273 ntokens 260112120 Example 128700 of 138376 loss = 3.5000 nll loss = 2.1256 accu = 0.3723

Training: Epoch 5 of 10 Step 2274 ntokens 260147520 Example 129000 of 138376 loss = 3.4998 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2275 ntokens 260182920 Example 129300 of 138376 loss = 3.4997 nll loss = 2.1257 accu = 0.3723

Training: Epoch 5 of 10 Step 2276 ntokens 260218320 Example 129600 of 138376 loss = 3.4998 nll loss = 2.1258 accu = 0.3723

Training: Epoch 5 of 10 Step 2277 ntokens 260253720 Example 129900 of 138376 loss = 3.4997 nll loss = 2.1257 accu = 0.3723

Training: Epoch 5 of 10 Step 2278 ntokens 260289120 Example 130200 of 138376 loss = 3.4997 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2279 ntokens 260324520 Example 130500 of 138376 loss = 3.4997 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2280 ntokens 260359920 Example 130800 of 138376 loss = 3.4998 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2281 ntokens 260395320 Example 131100 of 138376 loss = 3.4998 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2282 ntokens 260430720 Example 131400 of 138376 loss = 3.4995 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2283 ntokens 260466120 Example 131700 of 138376 loss = 3.4995 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2284 ntokens 260501520 Example 132000 of 138376 loss = 3.4998 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2285 ntokens 260536920 Example 132300 of 138376 loss = 3.4999 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2286 ntokens 260572320 Example 132600 of 138376 loss = 3.4999 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2287 ntokens 260607720 Example 132900 of 138376 loss = 3.5000 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2288 ntokens 260643120 Example 133200 of 138376 loss = 3.5001 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2289 ntokens 260678520 Example 133500 of 138376 loss = 3.5002 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2290 ntokens 260713920 Example 133800 of 138376 loss = 3.5003 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2291 ntokens 260749320 Example 134100 of 138376 loss = 3.5004 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2292 ntokens 260784720 Example 134400 of 138376 loss = 3.5003 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2293 ntokens 260820120 Example 134700 of 138376 loss = 3.5001 nll loss = 2.1254 accu = 0.3724

Training: Epoch 5 of 10 Step 2294 ntokens 260855520 Example 135000 of 138376 loss = 3.5001 nll loss = 2.1255 accu = 0.3724

Training: Epoch 5 of 10 Step 2295 ntokens 260890920 Example 135300 of 138376 loss = 3.5000 nll loss = 2.1257 accu = 0.3724

Training: Epoch 5 of 10 Step 2296 ntokens 260926320 Example 135600 of 138376 loss = 3.5001 nll loss = 2.1257 accu = 0.3723

Training: Epoch 5 of 10 Step 2297 ntokens 260961720 Example 135900 of 138376 loss = 3.5001 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2298 ntokens 260997120 Example 136200 of 138376 loss = 3.4999 nll loss = 2.1256 accu = 0.3724

Training: Epoch 5 of 10 Step 2299 ntokens 261032520 Example 136500 of 138376 loss = 3.4998 nll loss = 2.1254 accu = 0.3725

Training: Epoch 5 of 10 Step 2300 ntokens 261067920 Example 136800 of 138376 loss = 3.4997 nll loss = 2.1253 accu = 0.3725

Training: Epoch 5 of 10 Step 2301 ntokens 261103320 Example 137100 of 138376 loss = 3.4998 nll loss = 2.1251 accu = 0.3726

Training: Epoch 5 of 10 Step 2302 ntokens 261138720 Example 137400 of 138376 loss = 3.5000 nll loss = 2.1252 accu = 0.3725

Training: Epoch 5 of 10 Step 2303 ntokens 261174120 Example 137700 of 138376 loss = 3.4999 nll loss = 2.1251 accu = 0.3726

Training: Epoch 5 of 10 Step 2304 ntokens 261209520 Example 138000 of 138376 loss = 3.4999 nll loss = 2.1251 accu = 0.3726

Training: Epoch 5 of 10 Step 2305 ntokens 261244920 Example 138300 of 138376 loss = 3.4997 nll loss = 2.1250 accu = 0.3726

Training: Epoch 5 of 10 Step 2306 ntokens 261253888 Example 138376 of 138376 loss = 3.4998 nll loss = 2.1250 accu = 0.3726

Writing to checkpoint at 2024-05-28 17:00:33.046704
Validating: Epoch 5 of 10 Step 0 ntokens 261253888 Example 300 of 34323 loss = 3.5254 nll loss = 2.1961 accu = 0.3509

Validating: Epoch 5 of 10 Step 1 ntokens 261253888 Example 600 of 34323 loss = 3.5135 nll loss = 2.1906 accu = 0.3512

Validating: Epoch 5 of 10 Step 2 ntokens 261253888 Example 900 of 34323 loss = 3.5420 nll loss = 2.1572 accu = 0.3618

Validating: Epoch 5 of 10 Step 3 ntokens 261253888 Example 1200 of 34323 loss = 3.5232 nll loss = 2.1574 accu = 0.3618

Validating: Epoch 5 of 10 Step 4 ntokens 261253888 Example 1500 of 34323 loss = 3.5077 nll loss = 2.1572 accu = 0.3610

Validating: Epoch 5 of 10 Step 5 ntokens 261253888 Example 1800 of 34323 loss = 3.5117 nll loss = 2.1524 accu = 0.3621

Validating: Epoch 5 of 10 Step 6 ntokens 261253888 Example 2100 of 34323 loss = 3.5126 nll loss = 2.1427 accu = 0.3655

Validating: Epoch 5 of 10 Step 7 ntokens 261253888 Example 2400 of 34323 loss = 3.5232 nll loss = 2.1299 accu = 0.3699

Validating: Epoch 5 of 10 Step 8 ntokens 261253888 Example 2700 of 34323 loss = 3.5325 nll loss = 2.1184 accu = 0.3742

Validating: Epoch 5 of 10 Step 9 ntokens 261253888 Example 3000 of 34323 loss = 3.5441 nll loss = 2.1301 accu = 0.3704

Validating: Epoch 5 of 10 Step 10 ntokens 261253888 Example 3300 of 34323 loss = 3.5262 nll loss = 2.1272 accu = 0.3716

Validating: Epoch 5 of 10 Step 11 ntokens 261253888 Example 3600 of 34323 loss = 3.5236 nll loss = 2.1237 accu = 0.3728

Validating: Epoch 5 of 10 Step 12 ntokens 261253888 Example 3900 of 34323 loss = 3.5196 nll loss = 2.1174 accu = 0.3751

Validating: Epoch 5 of 10 Step 13 ntokens 261253888 Example 4200 of 34323 loss = 3.5124 nll loss = 2.1285 accu = 0.3713

Validating: Epoch 5 of 10 Step 14 ntokens 261253888 Example 4500 of 34323 loss = 3.5134 nll loss = 2.1290 accu = 0.3712

Validating: Epoch 5 of 10 Step 15 ntokens 261253888 Example 4800 of 34323 loss = 3.5075 nll loss = 2.1317 accu = 0.3703

Validating: Epoch 5 of 10 Step 16 ntokens 261253888 Example 5100 of 34323 loss = 3.5101 nll loss = 2.1286 accu = 0.3713

Validating: Epoch 5 of 10 Step 17 ntokens 261253888 Example 5400 of 34323 loss = 3.5130 nll loss = 2.1261 accu = 0.3722

Validating: Epoch 5 of 10 Step 18 ntokens 261253888 Example 5700 of 34323 loss = 3.5148 nll loss = 2.1229 accu = 0.3733

Validating: Epoch 5 of 10 Step 19 ntokens 261253888 Example 6000 of 34323 loss = 3.5162 nll loss = 2.1185 accu = 0.3749

Validating: Epoch 5 of 10 Step 20 ntokens 261253888 Example 6300 of 34323 loss = 3.5185 nll loss = 2.1184 accu = 0.3750

Validating: Epoch 5 of 10 Step 21 ntokens 261253888 Example 6600 of 34323 loss = 3.5215 nll loss = 2.1167 accu = 0.3755

Validating: Epoch 5 of 10 Step 22 ntokens 261253888 Example 6900 of 34323 loss = 3.5162 nll loss = 2.1185 accu = 0.3747

Validating: Epoch 5 of 10 Step 23 ntokens 261253888 Example 7200 of 34323 loss = 3.5140 nll loss = 2.1172 accu = 0.3752

Validating: Epoch 5 of 10 Step 24 ntokens 261253888 Example 7500 of 34323 loss = 3.5096 nll loss = 2.1169 accu = 0.3753

Validating: Epoch 5 of 10 Step 25 ntokens 261253888 Example 7800 of 34323 loss = 3.5095 nll loss = 2.1181 accu = 0.3748

Validating: Epoch 5 of 10 Step 26 ntokens 261253888 Example 8100 of 34323 loss = 3.5075 nll loss = 2.1199 accu = 0.3741

Validating: Epoch 5 of 10 Step 27 ntokens 261253888 Example 8400 of 34323 loss = 3.5089 nll loss = 2.1202 accu = 0.3740

Validating: Epoch 5 of 10 Step 28 ntokens 261253888 Example 8700 of 34323 loss = 3.5104 nll loss = 2.1188 accu = 0.3745

Validating: Epoch 5 of 10 Step 29 ntokens 261253888 Example 9000 of 34323 loss = 3.5083 nll loss = 2.1219 accu = 0.3734

Validating: Epoch 5 of 10 Step 30 ntokens 261253888 Example 9300 of 34323 loss = 3.5047 nll loss = 2.1213 accu = 0.3737

Validating: Epoch 5 of 10 Step 31 ntokens 261253888 Example 9600 of 34323 loss = 3.5049 nll loss = 2.1212 accu = 0.3737

Validating: Epoch 5 of 10 Step 32 ntokens 261253888 Example 9900 of 34323 loss = 3.5036 nll loss = 2.1195 accu = 0.3743

Validating: Epoch 5 of 10 Step 33 ntokens 261253888 Example 10200 of 34323 loss = 3.5014 nll loss = 2.1184 accu = 0.3748

Validating: Epoch 5 of 10 Step 34 ntokens 261253888 Example 10500 of 34323 loss = 3.4999 nll loss = 2.1205 accu = 0.3740

Validating: Epoch 5 of 10 Step 35 ntokens 261253888 Example 10800 of 34323 loss = 3.5000 nll loss = 2.1198 accu = 0.3742

Validating: Epoch 5 of 10 Step 36 ntokens 261253888 Example 11100 of 34323 loss = 3.5023 nll loss = 2.1196 accu = 0.3742

Validating: Epoch 5 of 10 Step 37 ntokens 261253888 Example 11400 of 34323 loss = 3.5018 nll loss = 2.1196 accu = 0.3742

Validating: Epoch 5 of 10 Step 38 ntokens 261253888 Example 11700 of 34323 loss = 3.5005 nll loss = 2.1192 accu = 0.3743

Validating: Epoch 5 of 10 Step 39 ntokens 261253888 Example 12000 of 34323 loss = 3.4964 nll loss = 2.1197 accu = 0.3741

Validating: Epoch 5 of 10 Step 40 ntokens 261253888 Example 12300 of 34323 loss = 3.4949 nll loss = 2.1191 accu = 0.3743

Validating: Epoch 5 of 10 Step 41 ntokens 261253888 Example 12600 of 34323 loss = 3.4946 nll loss = 2.1180 accu = 0.3746

Validating: Epoch 5 of 10 Step 42 ntokens 261253888 Example 12900 of 34323 loss = 3.4932 nll loss = 2.1181 accu = 0.3746

Validating: Epoch 5 of 10 Step 43 ntokens 261253888 Example 13200 of 34323 loss = 3.4905 nll loss = 2.1193 accu = 0.3742

Validating: Epoch 5 of 10 Step 44 ntokens 261253888 Example 13500 of 34323 loss = 3.4906 nll loss = 2.1207 accu = 0.3736

Validating: Epoch 5 of 10 Step 45 ntokens 261253888 Example 13800 of 34323 loss = 3.4899 nll loss = 2.1222 accu = 0.3732

Validating: Epoch 5 of 10 Step 46 ntokens 261253888 Example 14100 of 34323 loss = 3.4911 nll loss = 2.1230 accu = 0.3729

Validating: Epoch 5 of 10 Step 47 ntokens 261253888 Example 14400 of 34323 loss = 3.4929 nll loss = 2.1238 accu = 0.3726

Validating: Epoch 5 of 10 Step 48 ntokens 261253888 Example 14700 of 34323 loss = 3.4940 nll loss = 2.1213 accu = 0.3735

Validating: Epoch 5 of 10 Step 49 ntokens 261253888 Example 15000 of 34323 loss = 3.4952 nll loss = 2.1206 accu = 0.3737

Validating: Epoch 5 of 10 Step 50 ntokens 261253888 Example 15300 of 34323 loss = 3.4965 nll loss = 2.1212 accu = 0.3735

Validating: Epoch 5 of 10 Step 51 ntokens 261253888 Example 15600 of 34323 loss = 3.4966 nll loss = 2.1219 accu = 0.3733

Validating: Epoch 5 of 10 Step 52 ntokens 261253888 Example 15900 of 34323 loss = 3.4944 nll loss = 2.1225 accu = 0.3732

Validating: Epoch 5 of 10 Step 53 ntokens 261253888 Example 16200 of 34323 loss = 3.4941 nll loss = 2.1237 accu = 0.3727

Validating: Epoch 5 of 10 Step 54 ntokens 261253888 Example 16500 of 34323 loss = 3.4940 nll loss = 2.1231 accu = 0.3729

Validating: Epoch 5 of 10 Step 55 ntokens 261253888 Example 16800 of 34323 loss = 3.4933 nll loss = 2.1229 accu = 0.3730

Validating: Epoch 5 of 10 Step 56 ntokens 261253888 Example 17100 of 34323 loss = 3.4943 nll loss = 2.1229 accu = 0.3730

Validating: Epoch 5 of 10 Step 57 ntokens 261253888 Example 17400 of 34323 loss = 3.4954 nll loss = 2.1233 accu = 0.3729

Validating: Epoch 5 of 10 Step 58 ntokens 261253888 Example 17700 of 34323 loss = 3.4951 nll loss = 2.1228 accu = 0.3730

Validating: Epoch 5 of 10 Step 59 ntokens 261253888 Example 18000 of 34323 loss = 3.4961 nll loss = 2.1213 accu = 0.3736

Validating: Epoch 5 of 10 Step 60 ntokens 261253888 Example 18300 of 34323 loss = 3.4965 nll loss = 2.1211 accu = 0.3737

Validating: Epoch 5 of 10 Step 61 ntokens 261253888 Example 18600 of 34323 loss = 3.4972 nll loss = 2.1206 accu = 0.3738

Validating: Epoch 5 of 10 Step 62 ntokens 261253888 Example 18900 of 34323 loss = 3.4963 nll loss = 2.1198 accu = 0.3740

Validating: Epoch 5 of 10 Step 63 ntokens 261253888 Example 19200 of 34323 loss = 3.4975 nll loss = 2.1197 accu = 0.3741

Validating: Epoch 5 of 10 Step 64 ntokens 261253888 Example 19500 of 34323 loss = 3.4981 nll loss = 2.1206 accu = 0.3738

Validating: Epoch 5 of 10 Step 65 ntokens 261253888 Example 19800 of 34323 loss = 3.4999 nll loss = 2.1215 accu = 0.3734

Validating: Epoch 5 of 10 Step 66 ntokens 261253888 Example 20100 of 34323 loss = 3.5000 nll loss = 2.1215 accu = 0.3734

Validating: Epoch 5 of 10 Step 67 ntokens 261253888 Example 20400 of 34323 loss = 3.5003 nll loss = 2.1219 accu = 0.3733

Validating: Epoch 5 of 10 Step 68 ntokens 261253888 Example 20700 of 34323 loss = 3.5003 nll loss = 2.1219 accu = 0.3732

Validating: Epoch 5 of 10 Step 69 ntokens 261253888 Example 21000 of 34323 loss = 3.5004 nll loss = 2.1226 accu = 0.3730

Validating: Epoch 5 of 10 Step 70 ntokens 261253888 Example 21300 of 34323 loss = 3.4997 nll loss = 2.1232 accu = 0.3728

Validating: Epoch 5 of 10 Step 71 ntokens 261253888 Example 21600 of 34323 loss = 3.5011 nll loss = 2.1234 accu = 0.3727

Validating: Epoch 5 of 10 Step 72 ntokens 261253888 Example 21900 of 34323 loss = 3.5007 nll loss = 2.1245 accu = 0.3724

Validating: Epoch 5 of 10 Step 73 ntokens 261253888 Example 22200 of 34323 loss = 3.5015 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 5 of 10 Step 74 ntokens 261253888 Example 22500 of 34323 loss = 3.5016 nll loss = 2.1251 accu = 0.3721

Validating: Epoch 5 of 10 Step 75 ntokens 261253888 Example 22800 of 34323 loss = 3.5017 nll loss = 2.1241 accu = 0.3725

Validating: Epoch 5 of 10 Step 76 ntokens 261253888 Example 23100 of 34323 loss = 3.5017 nll loss = 2.1243 accu = 0.3724

Validating: Epoch 5 of 10 Step 77 ntokens 261253888 Example 23400 of 34323 loss = 3.5021 nll loss = 2.1249 accu = 0.3722

Validating: Epoch 5 of 10 Step 78 ntokens 261253888 Example 23700 of 34323 loss = 3.5024 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 5 of 10 Step 79 ntokens 261253888 Example 24000 of 34323 loss = 3.5023 nll loss = 2.1248 accu = 0.3722

Validating: Epoch 5 of 10 Step 80 ntokens 261253888 Example 24300 of 34323 loss = 3.5020 nll loss = 2.1247 accu = 0.3722

Validating: Epoch 5 of 10 Step 81 ntokens 261253888 Example 24600 of 34323 loss = 3.5020 nll loss = 2.1257 accu = 0.3719

Validating: Epoch 5 of 10 Step 82 ntokens 261253888 Example 24900 of 34323 loss = 3.5033 nll loss = 2.1267 accu = 0.3715

Validating: Epoch 5 of 10 Step 83 ntokens 261253888 Example 25200 of 34323 loss = 3.5031 nll loss = 2.1268 accu = 0.3715

Validating: Epoch 5 of 10 Step 84 ntokens 261253888 Example 25500 of 34323 loss = 3.5027 nll loss = 2.1268 accu = 0.3715

Validating: Epoch 5 of 10 Step 85 ntokens 261253888 Example 25800 of 34323 loss = 3.5033 nll loss = 2.1270 accu = 0.3714

Validating: Epoch 5 of 10 Step 86 ntokens 261253888 Example 26100 of 34323 loss = 3.5032 nll loss = 2.1270 accu = 0.3714

Validating: Epoch 5 of 10 Step 87 ntokens 261253888 Example 26400 of 34323 loss = 3.5032 nll loss = 2.1272 accu = 0.3714

Validating: Epoch 5 of 10 Step 88 ntokens 261253888 Example 26700 of 34323 loss = 3.5020 nll loss = 2.1271 accu = 0.3714

Validating: Epoch 5 of 10 Step 89 ntokens 261253888 Example 27000 of 34323 loss = 3.5021 nll loss = 2.1273 accu = 0.3713

Validating: Epoch 5 of 10 Step 90 ntokens 261253888 Example 27300 of 34323 loss = 3.5002 nll loss = 2.1262 accu = 0.3717

Validating: Epoch 5 of 10 Step 91 ntokens 261253888 Example 27600 of 34323 loss = 3.4988 nll loss = 2.1264 accu = 0.3717

Validating: Epoch 5 of 10 Step 92 ntokens 261253888 Example 27900 of 34323 loss = 3.4992 nll loss = 2.1266 accu = 0.3716

Validating: Epoch 5 of 10 Step 93 ntokens 261253888 Example 28200 of 34323 loss = 3.5007 nll loss = 2.1264 accu = 0.3717

Validating: Epoch 5 of 10 Step 94 ntokens 261253888 Example 28500 of 34323 loss = 3.5010 nll loss = 2.1260 accu = 0.3718

Validating: Epoch 5 of 10 Step 95 ntokens 261253888 Example 28800 of 34323 loss = 3.5001 nll loss = 2.1258 accu = 0.3719

Validating: Epoch 5 of 10 Step 96 ntokens 261253888 Example 29100 of 34323 loss = 3.4998 nll loss = 2.1254 accu = 0.3720

Validating: Epoch 5 of 10 Step 97 ntokens 261253888 Example 29400 of 34323 loss = 3.5012 nll loss = 2.1251 accu = 0.3722

Validating: Epoch 5 of 10 Step 98 ntokens 261253888 Example 29700 of 34323 loss = 3.5006 nll loss = 2.1252 accu = 0.3721

Validating: Epoch 5 of 10 Step 99 ntokens 261253888 Example 30000 of 34323 loss = 3.5011 nll loss = 2.1252 accu = 0.3721

Validating: Epoch 5 of 10 Step 100 ntokens 261253888 Example 30300 of 34323 loss = 3.5005 nll loss = 2.1252 accu = 0.3721

Validating: Epoch 5 of 10 Step 101 ntokens 261253888 Example 30600 of 34323 loss = 3.5004 nll loss = 2.1252 accu = 0.3721

Validating: Epoch 5 of 10 Step 102 ntokens 261253888 Example 30900 of 34323 loss = 3.5013 nll loss = 2.1254 accu = 0.3721

Validating: Epoch 5 of 10 Step 103 ntokens 261253888 Example 31200 of 34323 loss = 3.5007 nll loss = 2.1248 accu = 0.3723

Validating: Epoch 5 of 10 Step 104 ntokens 261253888 Example 31500 of 34323 loss = 3.5018 nll loss = 2.1250 accu = 0.3723

Validating: Epoch 5 of 10 Step 105 ntokens 261253888 Example 31800 of 34323 loss = 3.5017 nll loss = 2.1252 accu = 0.3722

Validating: Epoch 5 of 10 Step 106 ntokens 261253888 Example 32100 of 34323 loss = 3.5022 nll loss = 2.1249 accu = 0.3723

Validating: Epoch 5 of 10 Step 107 ntokens 261253888 Example 32400 of 34323 loss = 3.5019 nll loss = 2.1257 accu = 0.3720

Validating: Epoch 5 of 10 Step 108 ntokens 261253888 Example 32700 of 34323 loss = 3.5015 nll loss = 2.1250 accu = 0.3722

Validating: Epoch 5 of 10 Step 109 ntokens 261253888 Example 33000 of 34323 loss = 3.5003 nll loss = 2.1255 accu = 0.3721

Validating: Epoch 5 of 10 Step 110 ntokens 261253888 Example 33300 of 34323 loss = 3.5002 nll loss = 2.1251 accu = 0.3722

Validating: Epoch 5 of 10 Step 111 ntokens 261253888 Example 33600 of 34323 loss = 3.5007 nll loss = 2.1248 accu = 0.3723

Validating: Epoch 5 of 10 Step 112 ntokens 261253888 Example 33900 of 34323 loss = 3.4999 nll loss = 2.1250 accu = 0.3723

Validating: Epoch 5 of 10 Step 113 ntokens 261253888 Example 34200 of 34323 loss = 3.4996 nll loss = 2.1245 accu = 0.3725

Validating: Epoch 5 of 10 Step 114 ntokens 261253888 Example 34323 of 34323 loss = 3.4992 nll loss = 2.1241 accu = 0.3726

Validation complete in 0:00:15.041026
Epoch complete in 0:02:30.908017
Training: Epoch 6 of 10 Step 2306 ntokens 506214808 Example 300 of 138376 loss = 3.4667 nll loss = 2.1329 accu = 0.3689

Training: Epoch 6 of 10 Step 2307 ntokens 506250208 Example 600 of 138376 loss = 3.4422 nll loss = 2.1307 accu = 0.3691

Training: Epoch 6 of 10 Step 2308 ntokens 506285608 Example 900 of 138376 loss = 3.4477 nll loss = 2.1143 accu = 0.3763

Training: Epoch 6 of 10 Step 2309 ntokens 506321008 Example 1200 of 138376 loss = 3.4711 nll loss = 2.1124 accu = 0.3771

Training: Epoch 6 of 10 Step 2310 ntokens 506356408 Example 1500 of 138376 loss = 3.4711 nll loss = 2.1058 accu = 0.3793

Training: Epoch 6 of 10 Step 2311 ntokens 506391808 Example 1800 of 138376 loss = 3.4903 nll loss = 2.1112 accu = 0.3769

Training: Epoch 6 of 10 Step 2312 ntokens 506427208 Example 2100 of 138376 loss = 3.4868 nll loss = 2.1150 accu = 0.3754

Training: Epoch 6 of 10 Step 2313 ntokens 506462608 Example 2400 of 138376 loss = 3.5048 nll loss = 2.1142 accu = 0.3759

Training: Epoch 6 of 10 Step 2314 ntokens 506498008 Example 2700 of 138376 loss = 3.5119 nll loss = 2.1161 accu = 0.3749

Training: Epoch 6 of 10 Step 2315 ntokens 506533408 Example 3000 of 138376 loss = 3.4993 nll loss = 2.1111 accu = 0.3764

Training: Epoch 6 of 10 Step 2316 ntokens 506568808 Example 3300 of 138376 loss = 3.4977 nll loss = 2.1084 accu = 0.3774

Training: Epoch 6 of 10 Step 2317 ntokens 506604208 Example 3600 of 138376 loss = 3.5039 nll loss = 2.1105 accu = 0.3768

Training: Epoch 6 of 10 Step 2318 ntokens 506639608 Example 3900 of 138376 loss = 3.5011 nll loss = 2.1101 accu = 0.3772

Training: Epoch 6 of 10 Step 2319 ntokens 506675008 Example 4200 of 138376 loss = 3.5003 nll loss = 2.1117 accu = 0.3765

Training: Epoch 6 of 10 Step 2320 ntokens 506710408 Example 4500 of 138376 loss = 3.5003 nll loss = 2.1125 accu = 0.3761

Training: Epoch 6 of 10 Step 2321 ntokens 506745808 Example 4800 of 138376 loss = 3.5023 nll loss = 2.1095 accu = 0.3772

Training: Epoch 6 of 10 Step 2322 ntokens 506781208 Example 5100 of 138376 loss = 3.5006 nll loss = 2.1128 accu = 0.3761

Training: Epoch 6 of 10 Step 2323 ntokens 506816608 Example 5400 of 138376 loss = 3.4977 nll loss = 2.1141 accu = 0.3756

Training: Epoch 6 of 10 Step 2324 ntokens 506852008 Example 5700 of 138376 loss = 3.4942 nll loss = 2.1098 accu = 0.3770

Training: Epoch 6 of 10 Step 2325 ntokens 506887408 Example 6000 of 138376 loss = 3.4944 nll loss = 2.1133 accu = 0.3757

Training: Epoch 6 of 10 Step 2326 ntokens 506922808 Example 6300 of 138376 loss = 3.4953 nll loss = 2.1144 accu = 0.3754

Training: Epoch 6 of 10 Step 2327 ntokens 506958208 Example 6600 of 138376 loss = 3.4948 nll loss = 2.1162 accu = 0.3747

Training: Epoch 6 of 10 Step 2328 ntokens 506993608 Example 6900 of 138376 loss = 3.4897 nll loss = 2.1140 accu = 0.3755

Training: Epoch 6 of 10 Step 2329 ntokens 507029008 Example 7200 of 138376 loss = 3.4903 nll loss = 2.1147 accu = 0.3752

Training: Epoch 6 of 10 Step 2330 ntokens 507064408 Example 7500 of 138376 loss = 3.4844 nll loss = 2.1134 accu = 0.3758

Training: Epoch 6 of 10 Step 2331 ntokens 507099808 Example 7800 of 138376 loss = 3.4826 nll loss = 2.1125 accu = 0.3762

Training: Epoch 6 of 10 Step 2332 ntokens 507135208 Example 8100 of 138376 loss = 3.4820 nll loss = 2.1151 accu = 0.3753

Training: Epoch 6 of 10 Step 2333 ntokens 507170608 Example 8400 of 138376 loss = 3.4863 nll loss = 2.1145 accu = 0.3756

Training: Epoch 6 of 10 Step 2334 ntokens 507206008 Example 8700 of 138376 loss = 3.4848 nll loss = 2.1170 accu = 0.3748

Training: Epoch 6 of 10 Step 2335 ntokens 507241408 Example 9000 of 138376 loss = 3.4854 nll loss = 2.1150 accu = 0.3756

Training: Epoch 6 of 10 Step 2336 ntokens 507276808 Example 9300 of 138376 loss = 3.4860 nll loss = 2.1128 accu = 0.3763

Training: Epoch 6 of 10 Step 2337 ntokens 507312208 Example 9600 of 138376 loss = 3.4866 nll loss = 2.1127 accu = 0.3764

Training: Epoch 6 of 10 Step 2338 ntokens 507347608 Example 9900 of 138376 loss = 3.4881 nll loss = 2.1140 accu = 0.3761

Training: Epoch 6 of 10 Step 2339 ntokens 507383008 Example 10200 of 138376 loss = 3.4884 nll loss = 2.1150 accu = 0.3757

Training: Epoch 6 of 10 Step 2340 ntokens 507418408 Example 10500 of 138376 loss = 3.4872 nll loss = 2.1143 accu = 0.3760

Training: Epoch 6 of 10 Step 2341 ntokens 507453808 Example 10800 of 138376 loss = 3.4905 nll loss = 2.1119 accu = 0.3768

Training: Epoch 6 of 10 Step 2342 ntokens 507489208 Example 11100 of 138376 loss = 3.4936 nll loss = 2.1107 accu = 0.3773

Training: Epoch 6 of 10 Step 2343 ntokens 507524608 Example 11400 of 138376 loss = 3.4951 nll loss = 2.1119 accu = 0.3768

Training: Epoch 6 of 10 Step 2344 ntokens 507560008 Example 11700 of 138376 loss = 3.4904 nll loss = 2.1109 accu = 0.3772

Training: Epoch 6 of 10 Step 2345 ntokens 507595408 Example 12000 of 138376 loss = 3.4915 nll loss = 2.1116 accu = 0.3770

Training: Epoch 6 of 10 Step 2346 ntokens 507630808 Example 12300 of 138376 loss = 3.4899 nll loss = 2.1146 accu = 0.3760

Training: Epoch 6 of 10 Step 2347 ntokens 507666208 Example 12600 of 138376 loss = 3.4901 nll loss = 2.1133 accu = 0.3764

Training: Epoch 6 of 10 Step 2348 ntokens 507701608 Example 12900 of 138376 loss = 3.4892 nll loss = 2.1135 accu = 0.3763

Training: Epoch 6 of 10 Step 2349 ntokens 507737008 Example 13200 of 138376 loss = 3.4920 nll loss = 2.1131 accu = 0.3764

Training: Epoch 6 of 10 Step 2350 ntokens 507772408 Example 13500 of 138376 loss = 3.4937 nll loss = 2.1142 accu = 0.3761

Training: Epoch 6 of 10 Step 2351 ntokens 507807808 Example 13800 of 138376 loss = 3.4954 nll loss = 2.1131 accu = 0.3766

Training: Epoch 6 of 10 Step 2352 ntokens 507843208 Example 14100 of 138376 loss = 3.4957 nll loss = 2.1132 accu = 0.3765

Training: Epoch 6 of 10 Step 2353 ntokens 507878608 Example 14400 of 138376 loss = 3.4956 nll loss = 2.1131 accu = 0.3766

Training: Epoch 6 of 10 Step 2354 ntokens 507914008 Example 14700 of 138376 loss = 3.4993 nll loss = 2.1127 accu = 0.3767

Training: Epoch 6 of 10 Step 2355 ntokens 507949408 Example 15000 of 138376 loss = 3.4972 nll loss = 2.1126 accu = 0.3768

Training: Epoch 6 of 10 Step 2356 ntokens 507984808 Example 15300 of 138376 loss = 3.4966 nll loss = 2.1134 accu = 0.3764

Training: Epoch 6 of 10 Step 2357 ntokens 508020208 Example 15600 of 138376 loss = 3.4980 nll loss = 2.1140 accu = 0.3762

Training: Epoch 6 of 10 Step 2358 ntokens 508055608 Example 15900 of 138376 loss = 3.4966 nll loss = 2.1133 accu = 0.3764

Training: Epoch 6 of 10 Step 2359 ntokens 508091008 Example 16200 of 138376 loss = 3.4960 nll loss = 2.1137 accu = 0.3763

Training: Epoch 6 of 10 Step 2360 ntokens 508126408 Example 16500 of 138376 loss = 3.4956 nll loss = 2.1131 accu = 0.3765

Training: Epoch 6 of 10 Step 2361 ntokens 508161808 Example 16800 of 138376 loss = 3.4959 nll loss = 2.1117 accu = 0.3770

Training: Epoch 6 of 10 Step 2362 ntokens 508197208 Example 17100 of 138376 loss = 3.4969 nll loss = 2.1120 accu = 0.3768

Training: Epoch 6 of 10 Step 2363 ntokens 508232608 Example 17400 of 138376 loss = 3.4978 nll loss = 2.1125 accu = 0.3767

Training: Epoch 6 of 10 Step 2364 ntokens 508268008 Example 17700 of 138376 loss = 3.4967 nll loss = 2.1121 accu = 0.3768

Training: Epoch 6 of 10 Step 2365 ntokens 508303408 Example 18000 of 138376 loss = 3.4952 nll loss = 2.1122 accu = 0.3768

Training: Epoch 6 of 10 Step 2366 ntokens 508338808 Example 18300 of 138376 loss = 3.4981 nll loss = 2.1123 accu = 0.3768

Training: Epoch 6 of 10 Step 2367 ntokens 508374208 Example 18600 of 138376 loss = 3.4982 nll loss = 2.1121 accu = 0.3769

Training: Epoch 6 of 10 Step 2368 ntokens 508409608 Example 18900 of 138376 loss = 3.4966 nll loss = 2.1113 accu = 0.3772

Training: Epoch 6 of 10 Step 2369 ntokens 508445008 Example 19200 of 138376 loss = 3.4975 nll loss = 2.1125 accu = 0.3767

Training: Epoch 6 of 10 Step 2370 ntokens 508480408 Example 19500 of 138376 loss = 3.4951 nll loss = 2.1124 accu = 0.3767

Training: Epoch 6 of 10 Step 2371 ntokens 508515808 Example 19800 of 138376 loss = 3.4941 nll loss = 2.1123 accu = 0.3768

Training: Epoch 6 of 10 Step 2372 ntokens 508551208 Example 20100 of 138376 loss = 3.4941 nll loss = 2.1115 accu = 0.3770

Training: Epoch 6 of 10 Step 2373 ntokens 508586608 Example 20400 of 138376 loss = 3.4961 nll loss = 2.1123 accu = 0.3767

Training: Epoch 6 of 10 Step 2374 ntokens 508622008 Example 20700 of 138376 loss = 3.4974 nll loss = 2.1129 accu = 0.3765

Training: Epoch 6 of 10 Step 2375 ntokens 508657408 Example 21000 of 138376 loss = 3.4979 nll loss = 2.1130 accu = 0.3765

Training: Epoch 6 of 10 Step 2376 ntokens 508692808 Example 21300 of 138376 loss = 3.4983 nll loss = 2.1129 accu = 0.3765

Training: Epoch 6 of 10 Step 2377 ntokens 508728208 Example 21600 of 138376 loss = 3.4988 nll loss = 2.1136 accu = 0.3762

Training: Epoch 6 of 10 Step 2378 ntokens 508763608 Example 21900 of 138376 loss = 3.4997 nll loss = 2.1138 accu = 0.3761

Training: Epoch 6 of 10 Step 2379 ntokens 508799008 Example 22200 of 138376 loss = 3.5000 nll loss = 2.1147 accu = 0.3758

Training: Epoch 6 of 10 Step 2380 ntokens 508834408 Example 22500 of 138376 loss = 3.5013 nll loss = 2.1145 accu = 0.3759

Training: Epoch 6 of 10 Step 2381 ntokens 508869808 Example 22800 of 138376 loss = 3.5004 nll loss = 2.1161 accu = 0.3753

Training: Epoch 6 of 10 Step 2382 ntokens 508905208 Example 23100 of 138376 loss = 3.5002 nll loss = 2.1162 accu = 0.3753

Training: Epoch 6 of 10 Step 2383 ntokens 508940608 Example 23400 of 138376 loss = 3.5014 nll loss = 2.1156 accu = 0.3756

Training: Epoch 6 of 10 Step 2384 ntokens 508976008 Example 23700 of 138376 loss = 3.5028 nll loss = 2.1154 accu = 0.3757

Training: Epoch 6 of 10 Step 2385 ntokens 509011408 Example 24000 of 138376 loss = 3.5016 nll loss = 2.1152 accu = 0.3758

Training: Epoch 6 of 10 Step 2386 ntokens 509046808 Example 24300 of 138376 loss = 3.5007 nll loss = 2.1162 accu = 0.3754

Training: Epoch 6 of 10 Step 2387 ntokens 509082208 Example 24600 of 138376 loss = 3.5002 nll loss = 2.1168 accu = 0.3752

Training: Epoch 6 of 10 Step 2388 ntokens 509117608 Example 24900 of 138376 loss = 3.5014 nll loss = 2.1157 accu = 0.3756

Training: Epoch 6 of 10 Step 2389 ntokens 509153008 Example 25200 of 138376 loss = 3.5018 nll loss = 2.1161 accu = 0.3754

Training: Epoch 6 of 10 Step 2390 ntokens 509188408 Example 25500 of 138376 loss = 3.5012 nll loss = 2.1169 accu = 0.3752

Training: Epoch 6 of 10 Step 2391 ntokens 509223808 Example 25800 of 138376 loss = 3.5010 nll loss = 2.1166 accu = 0.3752

Training: Epoch 6 of 10 Step 2392 ntokens 509259208 Example 26100 of 138376 loss = 3.5023 nll loss = 2.1170 accu = 0.3751

Training: Epoch 6 of 10 Step 2393 ntokens 509294608 Example 26400 of 138376 loss = 3.5020 nll loss = 2.1171 accu = 0.3751

Training: Epoch 6 of 10 Step 2394 ntokens 509330008 Example 26700 of 138376 loss = 3.5030 nll loss = 2.1169 accu = 0.3751

Training: Epoch 6 of 10 Step 2395 ntokens 509365408 Example 27000 of 138376 loss = 3.5029 nll loss = 2.1183 accu = 0.3747

Training: Epoch 6 of 10 Step 2396 ntokens 509400808 Example 27300 of 138376 loss = 3.5031 nll loss = 2.1176 accu = 0.3749

Training: Epoch 6 of 10 Step 2397 ntokens 509436208 Example 27600 of 138376 loss = 3.5035 nll loss = 2.1170 accu = 0.3751

Training: Epoch 6 of 10 Step 2398 ntokens 509471608 Example 27900 of 138376 loss = 3.5034 nll loss = 2.1178 accu = 0.3749

Training: Epoch 6 of 10 Step 2399 ntokens 509507008 Example 28200 of 138376 loss = 3.5029 nll loss = 2.1180 accu = 0.3748

Training: Epoch 6 of 10 Step 2400 ntokens 509542408 Example 28500 of 138376 loss = 3.5023 nll loss = 2.1172 accu = 0.3751

Training: Epoch 6 of 10 Step 2401 ntokens 509577808 Example 28800 of 138376 loss = 3.5028 nll loss = 2.1175 accu = 0.3750

Training: Epoch 6 of 10 Step 2402 ntokens 509613208 Example 29100 of 138376 loss = 3.5029 nll loss = 2.1177 accu = 0.3750

Training: Epoch 6 of 10 Step 2403 ntokens 509648608 Example 29400 of 138376 loss = 3.5044 nll loss = 2.1183 accu = 0.3747

Training: Epoch 6 of 10 Step 2404 ntokens 509684008 Example 29700 of 138376 loss = 3.5047 nll loss = 2.1183 accu = 0.3748

Training: Epoch 6 of 10 Step 2405 ntokens 509719408 Example 30000 of 138376 loss = 3.5046 nll loss = 2.1184 accu = 0.3747

Training: Epoch 6 of 10 Step 2406 ntokens 509754808 Example 30300 of 138376 loss = 3.5054 nll loss = 2.1184 accu = 0.3747

Training: Epoch 6 of 10 Step 2407 ntokens 509790208 Example 30600 of 138376 loss = 3.5062 nll loss = 2.1186 accu = 0.3747

Training: Epoch 6 of 10 Step 2408 ntokens 509825608 Example 30900 of 138376 loss = 3.5053 nll loss = 2.1181 accu = 0.3749

Training: Epoch 6 of 10 Step 2409 ntokens 509861008 Example 31200 of 138376 loss = 3.5058 nll loss = 2.1180 accu = 0.3749

Training: Epoch 6 of 10 Step 2410 ntokens 509896408 Example 31500 of 138376 loss = 3.5056 nll loss = 2.1187 accu = 0.3747

Training: Epoch 6 of 10 Step 2411 ntokens 509931808 Example 31800 of 138376 loss = 3.5066 nll loss = 2.1199 accu = 0.3743

Training: Epoch 6 of 10 Step 2412 ntokens 509967208 Example 32100 of 138376 loss = 3.5052 nll loss = 2.1198 accu = 0.3743

Training: Epoch 6 of 10 Step 2413 ntokens 510002608 Example 32400 of 138376 loss = 3.5046 nll loss = 2.1198 accu = 0.3743

Training: Epoch 6 of 10 Step 2414 ntokens 510038008 Example 32700 of 138376 loss = 3.5048 nll loss = 2.1202 accu = 0.3742

Training: Epoch 6 of 10 Step 2415 ntokens 510073408 Example 33000 of 138376 loss = 3.5049 nll loss = 2.1204 accu = 0.3741

Training: Epoch 6 of 10 Step 2416 ntokens 510108808 Example 33300 of 138376 loss = 3.5048 nll loss = 2.1198 accu = 0.3744

Training: Epoch 6 of 10 Step 2417 ntokens 510144208 Example 33600 of 138376 loss = 3.5052 nll loss = 2.1203 accu = 0.3742

Training: Epoch 6 of 10 Step 2418 ntokens 510179608 Example 33900 of 138376 loss = 3.5047 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2419 ntokens 510215008 Example 34200 of 138376 loss = 3.5047 nll loss = 2.1201 accu = 0.3742

Training: Epoch 6 of 10 Step 2420 ntokens 510250408 Example 34500 of 138376 loss = 3.5038 nll loss = 2.1201 accu = 0.3742

Training: Epoch 6 of 10 Step 2421 ntokens 510285808 Example 34800 of 138376 loss = 3.5039 nll loss = 2.1208 accu = 0.3740

Training: Epoch 6 of 10 Step 2422 ntokens 510321208 Example 35100 of 138376 loss = 3.5041 nll loss = 2.1205 accu = 0.3741

Training: Epoch 6 of 10 Step 2423 ntokens 510356608 Example 35400 of 138376 loss = 3.5032 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2424 ntokens 510392008 Example 35700 of 138376 loss = 3.5023 nll loss = 2.1205 accu = 0.3740

Training: Epoch 6 of 10 Step 2425 ntokens 510427408 Example 36000 of 138376 loss = 3.5022 nll loss = 2.1209 accu = 0.3739

Training: Epoch 6 of 10 Step 2426 ntokens 510462808 Example 36300 of 138376 loss = 3.5022 nll loss = 2.1214 accu = 0.3737

Training: Epoch 6 of 10 Step 2427 ntokens 510498208 Example 36600 of 138376 loss = 3.5020 nll loss = 2.1209 accu = 0.3739

Training: Epoch 6 of 10 Step 2428 ntokens 510533608 Example 36900 of 138376 loss = 3.5026 nll loss = 2.1200 accu = 0.3742

Training: Epoch 6 of 10 Step 2429 ntokens 510569008 Example 37200 of 138376 loss = 3.5023 nll loss = 2.1201 accu = 0.3742

Training: Epoch 6 of 10 Step 2430 ntokens 510604408 Example 37500 of 138376 loss = 3.5020 nll loss = 2.1209 accu = 0.3739

Training: Epoch 6 of 10 Step 2431 ntokens 510639808 Example 37800 of 138376 loss = 3.5017 nll loss = 2.1213 accu = 0.3738

Training: Epoch 6 of 10 Step 2432 ntokens 510675208 Example 38100 of 138376 loss = 3.5014 nll loss = 2.1215 accu = 0.3737

Training: Epoch 6 of 10 Step 2433 ntokens 510710608 Example 38400 of 138376 loss = 3.5018 nll loss = 2.1217 accu = 0.3736

Training: Epoch 6 of 10 Step 2434 ntokens 510746008 Example 38700 of 138376 loss = 3.5018 nll loss = 2.1219 accu = 0.3736

Training: Epoch 6 of 10 Step 2435 ntokens 510781408 Example 39000 of 138376 loss = 3.5020 nll loss = 2.1224 accu = 0.3734

Training: Epoch 6 of 10 Step 2436 ntokens 510816808 Example 39300 of 138376 loss = 3.5026 nll loss = 2.1217 accu = 0.3737

Training: Epoch 6 of 10 Step 2437 ntokens 510852208 Example 39600 of 138376 loss = 3.5031 nll loss = 2.1217 accu = 0.3737

Training: Epoch 6 of 10 Step 2438 ntokens 510887608 Example 39900 of 138376 loss = 3.5032 nll loss = 2.1225 accu = 0.3734

Training: Epoch 6 of 10 Step 2439 ntokens 510923008 Example 40200 of 138376 loss = 3.5038 nll loss = 2.1219 accu = 0.3736

Training: Epoch 6 of 10 Step 2440 ntokens 510958408 Example 40500 of 138376 loss = 3.5041 nll loss = 2.1220 accu = 0.3736

Training: Epoch 6 of 10 Step 2441 ntokens 510993808 Example 40800 of 138376 loss = 3.5035 nll loss = 2.1221 accu = 0.3736

Training: Epoch 6 of 10 Step 2442 ntokens 511029208 Example 41100 of 138376 loss = 3.5035 nll loss = 2.1223 accu = 0.3735

Training: Epoch 6 of 10 Step 2443 ntokens 511064608 Example 41400 of 138376 loss = 3.5036 nll loss = 2.1220 accu = 0.3736

Training: Epoch 6 of 10 Step 2444 ntokens 511100008 Example 41700 of 138376 loss = 3.5034 nll loss = 2.1217 accu = 0.3737

Training: Epoch 6 of 10 Step 2445 ntokens 511135408 Example 42000 of 138376 loss = 3.5026 nll loss = 2.1215 accu = 0.3737

Training: Epoch 6 of 10 Step 2446 ntokens 511170808 Example 42300 of 138376 loss = 3.5022 nll loss = 2.1213 accu = 0.3738

Training: Epoch 6 of 10 Step 2447 ntokens 511206208 Example 42600 of 138376 loss = 3.5022 nll loss = 2.1210 accu = 0.3739

Training: Epoch 6 of 10 Step 2448 ntokens 511241608 Example 42900 of 138376 loss = 3.5022 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2449 ntokens 511277008 Example 43200 of 138376 loss = 3.5020 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2450 ntokens 511312408 Example 43500 of 138376 loss = 3.5031 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2451 ntokens 511347808 Example 43800 of 138376 loss = 3.5024 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2452 ntokens 511383208 Example 44100 of 138376 loss = 3.5039 nll loss = 2.1207 accu = 0.3740

Training: Epoch 6 of 10 Step 2453 ntokens 511418608 Example 44400 of 138376 loss = 3.5049 nll loss = 2.1214 accu = 0.3737

Training: Epoch 6 of 10 Step 2454 ntokens 511454008 Example 44700 of 138376 loss = 3.5056 nll loss = 2.1217 accu = 0.3737

Training: Epoch 6 of 10 Step 2455 ntokens 511489408 Example 45000 of 138376 loss = 3.5040 nll loss = 2.1211 accu = 0.3738

Training: Epoch 6 of 10 Step 2456 ntokens 511524808 Example 45300 of 138376 loss = 3.5039 nll loss = 2.1209 accu = 0.3739

Training: Epoch 6 of 10 Step 2457 ntokens 511560208 Example 45600 of 138376 loss = 3.5042 nll loss = 2.1210 accu = 0.3738

Training: Epoch 6 of 10 Step 2458 ntokens 511595608 Example 45900 of 138376 loss = 3.5041 nll loss = 2.1209 accu = 0.3739

Training: Epoch 6 of 10 Step 2459 ntokens 511631008 Example 46200 of 138376 loss = 3.5045 nll loss = 2.1211 accu = 0.3739

Training: Epoch 6 of 10 Step 2460 ntokens 511666408 Example 46500 of 138376 loss = 3.5040 nll loss = 2.1213 accu = 0.3738

Training: Epoch 6 of 10 Step 2461 ntokens 511701808 Example 46800 of 138376 loss = 3.5044 nll loss = 2.1212 accu = 0.3738

Training: Epoch 6 of 10 Step 2462 ntokens 511737208 Example 47100 of 138376 loss = 3.5049 nll loss = 2.1214 accu = 0.3737

Training: Epoch 6 of 10 Step 2463 ntokens 511772608 Example 47400 of 138376 loss = 3.5052 nll loss = 2.1212 accu = 0.3738

Training: Epoch 6 of 10 Step 2464 ntokens 511808008 Example 47700 of 138376 loss = 3.5050 nll loss = 2.1220 accu = 0.3735

Training: Epoch 6 of 10 Step 2465 ntokens 511843408 Example 48000 of 138376 loss = 3.5045 nll loss = 2.1215 accu = 0.3737

Training: Epoch 6 of 10 Step 2466 ntokens 511878808 Example 48300 of 138376 loss = 3.5043 nll loss = 2.1218 accu = 0.3736

Training: Epoch 6 of 10 Step 2467 ntokens 511914208 Example 48600 of 138376 loss = 3.5039 nll loss = 2.1218 accu = 0.3736

Training: Epoch 6 of 10 Step 2468 ntokens 511949608 Example 48900 of 138376 loss = 3.5042 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2469 ntokens 511985008 Example 49200 of 138376 loss = 3.5042 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2470 ntokens 512020408 Example 49500 of 138376 loss = 3.5039 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2471 ntokens 512055808 Example 49800 of 138376 loss = 3.5034 nll loss = 2.1222 accu = 0.3735

Training: Epoch 6 of 10 Step 2472 ntokens 512091208 Example 50100 of 138376 loss = 3.5029 nll loss = 2.1221 accu = 0.3735

Training: Epoch 6 of 10 Step 2473 ntokens 512126608 Example 50400 of 138376 loss = 3.5030 nll loss = 2.1221 accu = 0.3735

Training: Epoch 6 of 10 Step 2474 ntokens 512162008 Example 50700 of 138376 loss = 3.5033 nll loss = 2.1222 accu = 0.3735

Training: Epoch 6 of 10 Step 2475 ntokens 512197408 Example 51000 of 138376 loss = 3.5030 nll loss = 2.1225 accu = 0.3734

Training: Epoch 6 of 10 Step 2476 ntokens 512232808 Example 51300 of 138376 loss = 3.5034 nll loss = 2.1225 accu = 0.3734

Training: Epoch 6 of 10 Step 2477 ntokens 512268208 Example 51600 of 138376 loss = 3.5033 nll loss = 2.1229 accu = 0.3733

Training: Epoch 6 of 10 Step 2478 ntokens 512303608 Example 51900 of 138376 loss = 3.5035 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2479 ntokens 512339008 Example 52200 of 138376 loss = 3.5032 nll loss = 2.1231 accu = 0.3732

Training: Epoch 6 of 10 Step 2480 ntokens 512374408 Example 52500 of 138376 loss = 3.5035 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2481 ntokens 512409808 Example 52800 of 138376 loss = 3.5031 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2482 ntokens 512445208 Example 53100 of 138376 loss = 3.5032 nll loss = 2.1228 accu = 0.3733

Training: Epoch 6 of 10 Step 2483 ntokens 512480608 Example 53400 of 138376 loss = 3.5032 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2484 ntokens 512516008 Example 53700 of 138376 loss = 3.5026 nll loss = 2.1221 accu = 0.3735

Training: Epoch 6 of 10 Step 2485 ntokens 512551408 Example 54000 of 138376 loss = 3.5028 nll loss = 2.1217 accu = 0.3736

Training: Epoch 6 of 10 Step 2486 ntokens 512586808 Example 54300 of 138376 loss = 3.5026 nll loss = 2.1218 accu = 0.3736

Training: Epoch 6 of 10 Step 2487 ntokens 512622208 Example 54600 of 138376 loss = 3.5032 nll loss = 2.1220 accu = 0.3735

Training: Epoch 6 of 10 Step 2488 ntokens 512657608 Example 54900 of 138376 loss = 3.5025 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2489 ntokens 512693008 Example 55200 of 138376 loss = 3.5020 nll loss = 2.1224 accu = 0.3734

Training: Epoch 6 of 10 Step 2490 ntokens 512728408 Example 55500 of 138376 loss = 3.5024 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2491 ntokens 512763808 Example 55800 of 138376 loss = 3.5027 nll loss = 2.1222 accu = 0.3734

Training: Epoch 6 of 10 Step 2492 ntokens 512799208 Example 56100 of 138376 loss = 3.5033 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2493 ntokens 512834608 Example 56400 of 138376 loss = 3.5032 nll loss = 2.1221 accu = 0.3735

Training: Epoch 6 of 10 Step 2494 ntokens 512870008 Example 56700 of 138376 loss = 3.5035 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2495 ntokens 512905408 Example 57000 of 138376 loss = 3.5034 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2496 ntokens 512940808 Example 57300 of 138376 loss = 3.5031 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2497 ntokens 512976208 Example 57600 of 138376 loss = 3.5031 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2498 ntokens 513011608 Example 57900 of 138376 loss = 3.5027 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2499 ntokens 513047008 Example 58200 of 138376 loss = 3.5025 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2500 ntokens 513082408 Example 58500 of 138376 loss = 3.5027 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2501 ntokens 513117808 Example 58800 of 138376 loss = 3.5031 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2502 ntokens 513153208 Example 59100 of 138376 loss = 3.5033 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2503 ntokens 513188608 Example 59400 of 138376 loss = 3.5033 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2504 ntokens 513224008 Example 59700 of 138376 loss = 3.5029 nll loss = 2.1225 accu = 0.3734

Training: Epoch 6 of 10 Step 2505 ntokens 513259408 Example 60000 of 138376 loss = 3.5032 nll loss = 2.1228 accu = 0.3733

Training: Epoch 6 of 10 Step 2506 ntokens 513294808 Example 60300 of 138376 loss = 3.5032 nll loss = 2.1233 accu = 0.3731

Training: Epoch 6 of 10 Step 2507 ntokens 513330208 Example 60600 of 138376 loss = 3.5029 nll loss = 2.1231 accu = 0.3732

Training: Epoch 6 of 10 Step 2508 ntokens 513365608 Example 60900 of 138376 loss = 3.5032 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2509 ntokens 513401008 Example 61200 of 138376 loss = 3.5028 nll loss = 2.1233 accu = 0.3731

Training: Epoch 6 of 10 Step 2510 ntokens 513436408 Example 61500 of 138376 loss = 3.5024 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2511 ntokens 513471808 Example 61800 of 138376 loss = 3.5023 nll loss = 2.1229 accu = 0.3733

Training: Epoch 6 of 10 Step 2512 ntokens 513507208 Example 62100 of 138376 loss = 3.5023 nll loss = 2.1228 accu = 0.3733

Training: Epoch 6 of 10 Step 2513 ntokens 513542608 Example 62400 of 138376 loss = 3.5027 nll loss = 2.1223 accu = 0.3735

Training: Epoch 6 of 10 Step 2514 ntokens 513578008 Example 62700 of 138376 loss = 3.5031 nll loss = 2.1220 accu = 0.3736

Training: Epoch 6 of 10 Step 2515 ntokens 513613408 Example 63000 of 138376 loss = 3.5029 nll loss = 2.1226 accu = 0.3734

Training: Epoch 6 of 10 Step 2516 ntokens 513648808 Example 63300 of 138376 loss = 3.5027 nll loss = 2.1228 accu = 0.3733

Training: Epoch 6 of 10 Step 2517 ntokens 513684208 Example 63600 of 138376 loss = 3.5026 nll loss = 2.1231 accu = 0.3732

Training: Epoch 6 of 10 Step 2518 ntokens 513719608 Example 63900 of 138376 loss = 3.5025 nll loss = 2.1234 accu = 0.3731

Training: Epoch 6 of 10 Step 2519 ntokens 513755008 Example 64200 of 138376 loss = 3.5018 nll loss = 2.1233 accu = 0.3731

Training: Epoch 6 of 10 Step 2520 ntokens 513790408 Example 64500 of 138376 loss = 3.5019 nll loss = 2.1234 accu = 0.3731

Training: Epoch 6 of 10 Step 2521 ntokens 513825808 Example 64800 of 138376 loss = 3.5019 nll loss = 2.1231 accu = 0.3732

Training: Epoch 6 of 10 Step 2522 ntokens 513861208 Example 65100 of 138376 loss = 3.5016 nll loss = 2.1229 accu = 0.3733

Training: Epoch 6 of 10 Step 2523 ntokens 513896608 Example 65400 of 138376 loss = 3.5009 nll loss = 2.1226 accu = 0.3734

Training: Epoch 6 of 10 Step 2524 ntokens 513932008 Example 65700 of 138376 loss = 3.5010 nll loss = 2.1229 accu = 0.3733

Training: Epoch 6 of 10 Step 2525 ntokens 513967408 Example 66000 of 138376 loss = 3.5006 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2526 ntokens 514002808 Example 66300 of 138376 loss = 3.5005 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2527 ntokens 514038208 Example 66600 of 138376 loss = 3.5002 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2528 ntokens 514073608 Example 66900 of 138376 loss = 3.4999 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2529 ntokens 514109008 Example 67200 of 138376 loss = 3.5001 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2530 ntokens 514144408 Example 67500 of 138376 loss = 3.5001 nll loss = 2.1232 accu = 0.3732

Training: Epoch 6 of 10 Step 2531 ntokens 514179808 Example 67800 of 138376 loss = 3.5004 nll loss = 2.1231 accu = 0.3732

Training: Epoch 6 of 10 Step 2532 ntokens 514215208 Example 68100 of 138376 loss = 3.5001 nll loss = 2.1235 accu = 0.3731

Training: Epoch 6 of 10 Step 2533 ntokens 514250608 Example 68400 of 138376 loss = 3.5007 nll loss = 2.1236 accu = 0.3731

Training: Epoch 6 of 10 Step 2534 ntokens 514286008 Example 68700 of 138376 loss = 3.5005 nll loss = 2.1240 accu = 0.3729

Training: Epoch 6 of 10 Step 2535 ntokens 514321408 Example 69000 of 138376 loss = 3.5007 nll loss = 2.1239 accu = 0.3729

Training: Epoch 6 of 10 Step 2536 ntokens 514356808 Example 69300 of 138376 loss = 3.5006 nll loss = 2.1240 accu = 0.3729

Training: Epoch 6 of 10 Step 2537 ntokens 514392208 Example 69600 of 138376 loss = 3.5008 nll loss = 2.1242 accu = 0.3728

Training: Epoch 6 of 10 Step 2538 ntokens 514427608 Example 69900 of 138376 loss = 3.5012 nll loss = 2.1243 accu = 0.3728

Training: Epoch 6 of 10 Step 2539 ntokens 514463008 Example 70200 of 138376 loss = 3.5013 nll loss = 2.1241 accu = 0.3729

Training: Epoch 6 of 10 Step 2540 ntokens 514498408 Example 70500 of 138376 loss = 3.5012 nll loss = 2.1240 accu = 0.3729

Training: Epoch 6 of 10 Step 2541 ntokens 514533808 Example 70800 of 138376 loss = 3.5014 nll loss = 2.1245 accu = 0.3727

Training: Epoch 6 of 10 Step 2542 ntokens 514569208 Example 71100 of 138376 loss = 3.5013 nll loss = 2.1243 accu = 0.3728

Training: Epoch 6 of 10 Step 2543 ntokens 514604608 Example 71400 of 138376 loss = 3.5010 nll loss = 2.1243 accu = 0.3728

Training: Epoch 6 of 10 Step 2544 ntokens 514640008 Example 71700 of 138376 loss = 3.5012 nll loss = 2.1244 accu = 0.3727

Training: Epoch 6 of 10 Step 2545 ntokens 514675408 Example 72000 of 138376 loss = 3.5010 nll loss = 2.1246 accu = 0.3727

Training: Epoch 6 of 10 Step 2546 ntokens 514710808 Example 72300 of 138376 loss = 3.5006 nll loss = 2.1248 accu = 0.3726

Training: Epoch 6 of 10 Step 2547 ntokens 514746208 Example 72600 of 138376 loss = 3.5008 nll loss = 2.1251 accu = 0.3725

Training: Epoch 6 of 10 Step 2548 ntokens 514781608 Example 72900 of 138376 loss = 3.5008 nll loss = 2.1252 accu = 0.3725

Training: Epoch 6 of 10 Step 2549 ntokens 514817008 Example 73200 of 138376 loss = 3.5006 nll loss = 2.1249 accu = 0.3726

Training: Epoch 6 of 10 Step 2550 ntokens 514852408 Example 73500 of 138376 loss = 3.5009 nll loss = 2.1249 accu = 0.3726

Training: Epoch 6 of 10 Step 2551 ntokens 514887808 Example 73800 of 138376 loss = 3.5009 nll loss = 2.1249 accu = 0.3725

Training: Epoch 6 of 10 Step 2552 ntokens 514923208 Example 74100 of 138376 loss = 3.5011 nll loss = 2.1251 accu = 0.3725

Training: Epoch 6 of 10 Step 2553 ntokens 514958608 Example 74400 of 138376 loss = 3.5013 nll loss = 2.1247 accu = 0.3726

Training: Epoch 6 of 10 Step 2554 ntokens 514994008 Example 74700 of 138376 loss = 3.5018 nll loss = 2.1245 accu = 0.3727

Training: Epoch 6 of 10 Step 2555 ntokens 515029408 Example 75000 of 138376 loss = 3.5016 nll loss = 2.1246 accu = 0.3727

Training: Epoch 6 of 10 Step 2556 ntokens 515064808 Example 75300 of 138376 loss = 3.5017 nll loss = 2.1245 accu = 0.3727

Training: Epoch 6 of 10 Step 2557 ntokens 515100208 Example 75600 of 138376 loss = 3.5025 nll loss = 2.1247 accu = 0.3726

Training: Epoch 6 of 10 Step 2558 ntokens 515135608 Example 75900 of 138376 loss = 3.5026 nll loss = 2.1248 accu = 0.3726

Training: Epoch 6 of 10 Step 2559 ntokens 515171008 Example 76200 of 138376 loss = 3.5031 nll loss = 2.1248 accu = 0.3726

Training: Epoch 6 of 10 Step 2560 ntokens 515206408 Example 76500 of 138376 loss = 3.5036 nll loss = 2.1244 accu = 0.3727

Training: Epoch 6 of 10 Step 2561 ntokens 515241808 Example 76800 of 138376 loss = 3.5036 nll loss = 2.1241 accu = 0.3728

Training: Epoch 6 of 10 Step 2562 ntokens 515277208 Example 77100 of 138376 loss = 3.5038 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2563 ntokens 515312608 Example 77400 of 138376 loss = 3.5033 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2564 ntokens 515348008 Example 77700 of 138376 loss = 3.5036 nll loss = 2.1245 accu = 0.3726

Training: Epoch 6 of 10 Step 2565 ntokens 515383408 Example 78000 of 138376 loss = 3.5035 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2566 ntokens 515418808 Example 78300 of 138376 loss = 3.5034 nll loss = 2.1242 accu = 0.3728

Training: Epoch 6 of 10 Step 2567 ntokens 515454208 Example 78600 of 138376 loss = 3.5035 nll loss = 2.1241 accu = 0.3728

Training: Epoch 6 of 10 Step 2568 ntokens 515489608 Example 78900 of 138376 loss = 3.5034 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2569 ntokens 515525008 Example 79200 of 138376 loss = 3.5034 nll loss = 2.1246 accu = 0.3726

Training: Epoch 6 of 10 Step 2570 ntokens 515560408 Example 79500 of 138376 loss = 3.5035 nll loss = 2.1246 accu = 0.3726

Training: Epoch 6 of 10 Step 2571 ntokens 515595808 Example 79800 of 138376 loss = 3.5036 nll loss = 2.1247 accu = 0.3725

Training: Epoch 6 of 10 Step 2572 ntokens 515631208 Example 80100 of 138376 loss = 3.5038 nll loss = 2.1248 accu = 0.3725

Training: Epoch 6 of 10 Step 2573 ntokens 515666608 Example 80400 of 138376 loss = 3.5034 nll loss = 2.1248 accu = 0.3725

Training: Epoch 6 of 10 Step 2574 ntokens 515702008 Example 80700 of 138376 loss = 3.5038 nll loss = 2.1249 accu = 0.3724

Training: Epoch 6 of 10 Step 2575 ntokens 515737408 Example 81000 of 138376 loss = 3.5035 nll loss = 2.1251 accu = 0.3724

Training: Epoch 6 of 10 Step 2576 ntokens 515772808 Example 81300 of 138376 loss = 3.5032 nll loss = 2.1251 accu = 0.3724

Training: Epoch 6 of 10 Step 2577 ntokens 515808208 Example 81600 of 138376 loss = 3.5031 nll loss = 2.1249 accu = 0.3725

Training: Epoch 6 of 10 Step 2578 ntokens 515843608 Example 81900 of 138376 loss = 3.5033 nll loss = 2.1249 accu = 0.3725

Training: Epoch 6 of 10 Step 2579 ntokens 515879008 Example 82200 of 138376 loss = 3.5030 nll loss = 2.1249 accu = 0.3725

Training: Epoch 6 of 10 Step 2580 ntokens 515914408 Example 82500 of 138376 loss = 3.5028 nll loss = 2.1250 accu = 0.3724

Training: Epoch 6 of 10 Step 2581 ntokens 515949808 Example 82800 of 138376 loss = 3.5027 nll loss = 2.1248 accu = 0.3725

Training: Epoch 6 of 10 Step 2582 ntokens 515985208 Example 83100 of 138376 loss = 3.5029 nll loss = 2.1247 accu = 0.3725

Training: Epoch 6 of 10 Step 2583 ntokens 516020608 Example 83400 of 138376 loss = 3.5030 nll loss = 2.1247 accu = 0.3725

Training: Epoch 6 of 10 Step 2584 ntokens 516056008 Example 83700 of 138376 loss = 3.5025 nll loss = 2.1246 accu = 0.3725

Training: Epoch 6 of 10 Step 2585 ntokens 516091408 Example 84000 of 138376 loss = 3.5026 nll loss = 2.1245 accu = 0.3726

Training: Epoch 6 of 10 Step 2586 ntokens 516126808 Example 84300 of 138376 loss = 3.5023 nll loss = 2.1247 accu = 0.3725

Training: Epoch 6 of 10 Step 2587 ntokens 516162208 Example 84600 of 138376 loss = 3.5029 nll loss = 2.1249 accu = 0.3724

Training: Epoch 6 of 10 Step 2588 ntokens 516197608 Example 84900 of 138376 loss = 3.5028 nll loss = 2.1249 accu = 0.3724

Training: Epoch 6 of 10 Step 2589 ntokens 516233008 Example 85200 of 138376 loss = 3.5026 nll loss = 2.1251 accu = 0.3723

Training: Epoch 6 of 10 Step 2590 ntokens 516268408 Example 85500 of 138376 loss = 3.5027 nll loss = 2.1248 accu = 0.3725

Training: Epoch 6 of 10 Step 2591 ntokens 516303808 Example 85800 of 138376 loss = 3.5024 nll loss = 2.1250 accu = 0.3724

Training: Epoch 6 of 10 Step 2592 ntokens 516339208 Example 86100 of 138376 loss = 3.5026 nll loss = 2.1251 accu = 0.3724

Training: Epoch 6 of 10 Step 2593 ntokens 516374608 Example 86400 of 138376 loss = 3.5027 nll loss = 2.1249 accu = 0.3724

Training: Epoch 6 of 10 Step 2594 ntokens 516410008 Example 86700 of 138376 loss = 3.5028 nll loss = 2.1247 accu = 0.3725

Training: Epoch 6 of 10 Step 2595 ntokens 516445408 Example 87000 of 138376 loss = 3.5030 nll loss = 2.1246 accu = 0.3725

Training: Epoch 6 of 10 Step 2596 ntokens 516480808 Example 87300 of 138376 loss = 3.5032 nll loss = 2.1248 accu = 0.3725

Training: Epoch 6 of 10 Step 2597 ntokens 516516208 Example 87600 of 138376 loss = 3.5033 nll loss = 2.1246 accu = 0.3726

Training: Epoch 6 of 10 Step 2598 ntokens 516551608 Example 87900 of 138376 loss = 3.5027 nll loss = 2.1247 accu = 0.3725

Training: Epoch 6 of 10 Step 2599 ntokens 516587008 Example 88200 of 138376 loss = 3.5029 nll loss = 2.1246 accu = 0.3726

Training: Epoch 6 of 10 Step 2600 ntokens 516622408 Example 88500 of 138376 loss = 3.5029 nll loss = 2.1248 accu = 0.3725

Training: Epoch 6 of 10 Step 2601 ntokens 516657808 Example 88800 of 138376 loss = 3.5029 nll loss = 2.1250 accu = 0.3724

Training: Epoch 6 of 10 Step 2602 ntokens 516693208 Example 89100 of 138376 loss = 3.5024 nll loss = 2.1249 accu = 0.3725

Training: Epoch 6 of 10 Step 2603 ntokens 516728608 Example 89400 of 138376 loss = 3.5028 nll loss = 2.1245 accu = 0.3726

Training: Epoch 6 of 10 Step 2604 ntokens 516764008 Example 89700 of 138376 loss = 3.5030 nll loss = 2.1244 accu = 0.3726

Training: Epoch 6 of 10 Step 2605 ntokens 516799408 Example 90000 of 138376 loss = 3.5029 nll loss = 2.1244 accu = 0.3726

Training: Epoch 6 of 10 Step 2606 ntokens 516834808 Example 90300 of 138376 loss = 3.5029 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2607 ntokens 516870208 Example 90600 of 138376 loss = 3.5029 nll loss = 2.1238 accu = 0.3728

Training: Epoch 6 of 10 Step 2608 ntokens 516905608 Example 90900 of 138376 loss = 3.5030 nll loss = 2.1239 accu = 0.3728

Training: Epoch 6 of 10 Step 2609 ntokens 516941008 Example 91200 of 138376 loss = 3.5032 nll loss = 2.1239 accu = 0.3728

Training: Epoch 6 of 10 Step 2610 ntokens 516976408 Example 91500 of 138376 loss = 3.5034 nll loss = 2.1242 accu = 0.3727

Training: Epoch 6 of 10 Step 2611 ntokens 517011808 Example 91800 of 138376 loss = 3.5030 nll loss = 2.1240 accu = 0.3728

Training: Epoch 6 of 10 Step 2612 ntokens 517047208 Example 92100 of 138376 loss = 3.5035 nll loss = 2.1240 accu = 0.3728

Training: Epoch 6 of 10 Step 2613 ntokens 517082608 Example 92400 of 138376 loss = 3.5038 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2614 ntokens 517118008 Example 92700 of 138376 loss = 3.5040 nll loss = 2.1245 accu = 0.3726

Training: Epoch 6 of 10 Step 2615 ntokens 517153408 Example 93000 of 138376 loss = 3.5039 nll loss = 2.1247 accu = 0.3726

Training: Epoch 6 of 10 Step 2616 ntokens 517188808 Example 93300 of 138376 loss = 3.5039 nll loss = 2.1244 accu = 0.3727

Training: Epoch 6 of 10 Step 2617 ntokens 517224208 Example 93600 of 138376 loss = 3.5039 nll loss = 2.1244 accu = 0.3727

Training: Epoch 6 of 10 Step 2618 ntokens 517259608 Example 93900 of 138376 loss = 3.5041 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2619 ntokens 517295008 Example 94200 of 138376 loss = 3.5044 nll loss = 2.1242 accu = 0.3728

Training: Epoch 6 of 10 Step 2620 ntokens 517330408 Example 94500 of 138376 loss = 3.5045 nll loss = 2.1240 accu = 0.3728

Training: Epoch 6 of 10 Step 2621 ntokens 517365808 Example 94800 of 138376 loss = 3.5051 nll loss = 2.1239 accu = 0.3729

Training: Epoch 6 of 10 Step 2622 ntokens 517401208 Example 95100 of 138376 loss = 3.5053 nll loss = 2.1241 accu = 0.3728

Training: Epoch 6 of 10 Step 2623 ntokens 517436608 Example 95400 of 138376 loss = 3.5051 nll loss = 2.1243 accu = 0.3727

Training: Epoch 6 of 10 Step 2624 ntokens 517472008 Example 95700 of 138376 loss = 3.5054 nll loss = 2.1241 accu = 0.3728

Training: Epoch 6 of 10 Step 2625 ntokens 517507408 Example 96000 of 138376 loss = 3.5054 nll loss = 2.1238 accu = 0.3729

Training: Epoch 6 of 10 Step 2626 ntokens 517542808 Example 96300 of 138376 loss = 3.5052 nll loss = 2.1238 accu = 0.3729

Training: Epoch 6 of 10 Step 2627 ntokens 517578208 Example 96600 of 138376 loss = 3.5053 nll loss = 2.1238 accu = 0.3729

Training: Epoch 6 of 10 Step 2628 ntokens 517613608 Example 96900 of 138376 loss = 3.5057 nll loss = 2.1237 accu = 0.3729

Training: Epoch 6 of 10 Step 2629 ntokens 517649008 Example 97200 of 138376 loss = 3.5055 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2630 ntokens 517684408 Example 97500 of 138376 loss = 3.5054 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2631 ntokens 517719808 Example 97800 of 138376 loss = 3.5055 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2632 ntokens 517755208 Example 98100 of 138376 loss = 3.5054 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2633 ntokens 517790608 Example 98400 of 138376 loss = 3.5053 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2634 ntokens 517826008 Example 98700 of 138376 loss = 3.5054 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2635 ntokens 517861408 Example 99000 of 138376 loss = 3.5056 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2636 ntokens 517896808 Example 99300 of 138376 loss = 3.5056 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2637 ntokens 517932208 Example 99600 of 138376 loss = 3.5059 nll loss = 2.1233 accu = 0.3730

Training: Epoch 6 of 10 Step 2638 ntokens 517967608 Example 99900 of 138376 loss = 3.5057 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2639 ntokens 518003008 Example 100200 of 138376 loss = 3.5060 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2640 ntokens 518038408 Example 100500 of 138376 loss = 3.5063 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2641 ntokens 518073808 Example 100800 of 138376 loss = 3.5064 nll loss = 2.1233 accu = 0.3731

Training: Epoch 6 of 10 Step 2642 ntokens 518109208 Example 101100 of 138376 loss = 3.5064 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2643 ntokens 518144608 Example 101400 of 138376 loss = 3.5063 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2644 ntokens 518180008 Example 101700 of 138376 loss = 3.5063 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2645 ntokens 518215408 Example 102000 of 138376 loss = 3.5063 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2646 ntokens 518250808 Example 102300 of 138376 loss = 3.5062 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2647 ntokens 518286208 Example 102600 of 138376 loss = 3.5062 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2648 ntokens 518321608 Example 102900 of 138376 loss = 3.5059 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2649 ntokens 518357008 Example 103200 of 138376 loss = 3.5058 nll loss = 2.1227 accu = 0.3732

Training: Epoch 6 of 10 Step 2650 ntokens 518392408 Example 103500 of 138376 loss = 3.5057 nll loss = 2.1227 accu = 0.3732

Training: Epoch 6 of 10 Step 2651 ntokens 518427808 Example 103800 of 138376 loss = 3.5057 nll loss = 2.1227 accu = 0.3732

Training: Epoch 6 of 10 Step 2652 ntokens 518463208 Example 104100 of 138376 loss = 3.5060 nll loss = 2.1227 accu = 0.3732

Training: Epoch 6 of 10 Step 2653 ntokens 518498608 Example 104400 of 138376 loss = 3.5062 nll loss = 2.1227 accu = 0.3732

Training: Epoch 6 of 10 Step 2654 ntokens 518534008 Example 104700 of 138376 loss = 3.5059 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2655 ntokens 518569408 Example 105000 of 138376 loss = 3.5059 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2656 ntokens 518604808 Example 105300 of 138376 loss = 3.5063 nll loss = 2.1232 accu = 0.3730

Training: Epoch 6 of 10 Step 2657 ntokens 518640208 Example 105600 of 138376 loss = 3.5063 nll loss = 2.1233 accu = 0.3730

Training: Epoch 6 of 10 Step 2658 ntokens 518675608 Example 105900 of 138376 loss = 3.5063 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2659 ntokens 518711008 Example 106200 of 138376 loss = 3.5060 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2660 ntokens 518746408 Example 106500 of 138376 loss = 3.5060 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2661 ntokens 518781808 Example 106800 of 138376 loss = 3.5061 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2662 ntokens 518817208 Example 107100 of 138376 loss = 3.5062 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2663 ntokens 518852608 Example 107400 of 138376 loss = 3.5063 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2664 ntokens 518888008 Example 107700 of 138376 loss = 3.5061 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2665 ntokens 518923408 Example 108000 of 138376 loss = 3.5062 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2666 ntokens 518958808 Example 108300 of 138376 loss = 3.5060 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2667 ntokens 518994208 Example 108600 of 138376 loss = 3.5061 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2668 ntokens 519029608 Example 108900 of 138376 loss = 3.5062 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2669 ntokens 519065008 Example 109200 of 138376 loss = 3.5065 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2670 ntokens 519100408 Example 109500 of 138376 loss = 3.5065 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2671 ntokens 519135808 Example 109800 of 138376 loss = 3.5066 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2672 ntokens 519171208 Example 110100 of 138376 loss = 3.5068 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2673 ntokens 519206608 Example 110400 of 138376 loss = 3.5068 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2674 ntokens 519242008 Example 110700 of 138376 loss = 3.5067 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2675 ntokens 519277408 Example 111000 of 138376 loss = 3.5067 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2676 ntokens 519312808 Example 111300 of 138376 loss = 3.5067 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2677 ntokens 519348208 Example 111600 of 138376 loss = 3.5065 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2678 ntokens 519383608 Example 111900 of 138376 loss = 3.5066 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2679 ntokens 519419008 Example 112200 of 138376 loss = 3.5068 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2680 ntokens 519454408 Example 112500 of 138376 loss = 3.5070 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2681 ntokens 519489808 Example 112800 of 138376 loss = 3.5065 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2682 ntokens 519525208 Example 113100 of 138376 loss = 3.5067 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2683 ntokens 519560608 Example 113400 of 138376 loss = 3.5067 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2684 ntokens 519596008 Example 113700 of 138376 loss = 3.5066 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2685 ntokens 519631408 Example 114000 of 138376 loss = 3.5067 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2686 ntokens 519666808 Example 114300 of 138376 loss = 3.5063 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2687 ntokens 519702208 Example 114600 of 138376 loss = 3.5063 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2688 ntokens 519737608 Example 114900 of 138376 loss = 3.5062 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2689 ntokens 519773008 Example 115200 of 138376 loss = 3.5059 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2690 ntokens 519808408 Example 115500 of 138376 loss = 3.5057 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2691 ntokens 519843808 Example 115800 of 138376 loss = 3.5057 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2692 ntokens 519879208 Example 116100 of 138376 loss = 3.5058 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2693 ntokens 519914608 Example 116400 of 138376 loss = 3.5056 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2694 ntokens 519950008 Example 116700 of 138376 loss = 3.5054 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2695 ntokens 519985408 Example 117000 of 138376 loss = 3.5054 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2696 ntokens 520020808 Example 117300 of 138376 loss = 3.5056 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2697 ntokens 520056208 Example 117600 of 138376 loss = 3.5058 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2698 ntokens 520091608 Example 117900 of 138376 loss = 3.5060 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2699 ntokens 520127008 Example 118200 of 138376 loss = 3.5060 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2700 ntokens 520162408 Example 118500 of 138376 loss = 3.5060 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2701 ntokens 520197808 Example 118800 of 138376 loss = 3.5060 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2702 ntokens 520233208 Example 119100 of 138376 loss = 3.5063 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2703 ntokens 520268608 Example 119400 of 138376 loss = 3.5063 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2704 ntokens 520304008 Example 119700 of 138376 loss = 3.5060 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2705 ntokens 520339408 Example 120000 of 138376 loss = 3.5061 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2706 ntokens 520374808 Example 120300 of 138376 loss = 3.5061 nll loss = 2.1224 accu = 0.3734

Training: Epoch 6 of 10 Step 2707 ntokens 520410208 Example 120600 of 138376 loss = 3.5059 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2708 ntokens 520445608 Example 120900 of 138376 loss = 3.5063 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2709 ntokens 520481008 Example 121200 of 138376 loss = 3.5062 nll loss = 2.1222 accu = 0.3734

Training: Epoch 6 of 10 Step 2710 ntokens 520516408 Example 121500 of 138376 loss = 3.5061 nll loss = 2.1222 accu = 0.3735

Training: Epoch 6 of 10 Step 2711 ntokens 520551808 Example 121800 of 138376 loss = 3.5061 nll loss = 2.1223 accu = 0.3734

Training: Epoch 6 of 10 Step 2712 ntokens 520587208 Example 122100 of 138376 loss = 3.5061 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2713 ntokens 520622608 Example 122400 of 138376 loss = 3.5060 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2714 ntokens 520658008 Example 122700 of 138376 loss = 3.5062 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2715 ntokens 520693408 Example 123000 of 138376 loss = 3.5061 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2716 ntokens 520728808 Example 123300 of 138376 loss = 3.5062 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2717 ntokens 520764208 Example 123600 of 138376 loss = 3.5059 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2718 ntokens 520799608 Example 123900 of 138376 loss = 3.5057 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2719 ntokens 520835008 Example 124200 of 138376 loss = 3.5061 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2720 ntokens 520870408 Example 124500 of 138376 loss = 3.5062 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2721 ntokens 520905808 Example 124800 of 138376 loss = 3.5062 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2722 ntokens 520941208 Example 125100 of 138376 loss = 3.5063 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2723 ntokens 520976608 Example 125400 of 138376 loss = 3.5062 nll loss = 2.1225 accu = 0.3733

Training: Epoch 6 of 10 Step 2724 ntokens 521012008 Example 125700 of 138376 loss = 3.5061 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2725 ntokens 521047408 Example 126000 of 138376 loss = 3.5062 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2726 ntokens 521082808 Example 126300 of 138376 loss = 3.5058 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2727 ntokens 521118208 Example 126600 of 138376 loss = 3.5055 nll loss = 2.1226 accu = 0.3733

Training: Epoch 6 of 10 Step 2728 ntokens 521153608 Example 126900 of 138376 loss = 3.5054 nll loss = 2.1227 accu = 0.3733

Training: Epoch 6 of 10 Step 2729 ntokens 521189008 Example 127200 of 138376 loss = 3.5054 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2730 ntokens 521224408 Example 127500 of 138376 loss = 3.5054 nll loss = 2.1227 accu = 0.3732

Training: Epoch 6 of 10 Step 2731 ntokens 521259808 Example 127800 of 138376 loss = 3.5053 nll loss = 2.1228 accu = 0.3732

Training: Epoch 6 of 10 Step 2732 ntokens 521295208 Example 128100 of 138376 loss = 3.5053 nll loss = 2.1229 accu = 0.3732

Training: Epoch 6 of 10 Step 2733 ntokens 521330608 Example 128400 of 138376 loss = 3.5051 nll loss = 2.1230 accu = 0.3732

Training: Epoch 6 of 10 Step 2734 ntokens 521366008 Example 128700 of 138376 loss = 3.5052 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2735 ntokens 521401408 Example 129000 of 138376 loss = 3.5052 nll loss = 2.1233 accu = 0.3731

Training: Epoch 6 of 10 Step 2736 ntokens 521436808 Example 129300 of 138376 loss = 3.5050 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2737 ntokens 521472208 Example 129600 of 138376 loss = 3.5051 nll loss = 2.1233 accu = 0.3730

Training: Epoch 6 of 10 Step 2738 ntokens 521507608 Example 129900 of 138376 loss = 3.5052 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2739 ntokens 521543008 Example 130200 of 138376 loss = 3.5052 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2740 ntokens 521578408 Example 130500 of 138376 loss = 3.5051 nll loss = 2.1236 accu = 0.3729

Training: Epoch 6 of 10 Step 2741 ntokens 521613808 Example 130800 of 138376 loss = 3.5053 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2742 ntokens 521649208 Example 131100 of 138376 loss = 3.5051 nll loss = 2.1236 accu = 0.3730

Training: Epoch 6 of 10 Step 2743 ntokens 521684608 Example 131400 of 138376 loss = 3.5049 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2744 ntokens 521720008 Example 131700 of 138376 loss = 3.5049 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2745 ntokens 521755408 Example 132000 of 138376 loss = 3.5048 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2746 ntokens 521790808 Example 132300 of 138376 loss = 3.5049 nll loss = 2.1236 accu = 0.3729

Training: Epoch 6 of 10 Step 2747 ntokens 521826208 Example 132600 of 138376 loss = 3.5047 nll loss = 2.1236 accu = 0.3729

Training: Epoch 6 of 10 Step 2748 ntokens 521861608 Example 132900 of 138376 loss = 3.5047 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2749 ntokens 521897008 Example 133200 of 138376 loss = 3.5044 nll loss = 2.1233 accu = 0.3730

Training: Epoch 6 of 10 Step 2750 ntokens 521932408 Example 133500 of 138376 loss = 3.5044 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2751 ntokens 521967808 Example 133800 of 138376 loss = 3.5044 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2752 ntokens 522003208 Example 134100 of 138376 loss = 3.5045 nll loss = 2.1235 accu = 0.3730

Training: Epoch 6 of 10 Step 2753 ntokens 522038608 Example 134400 of 138376 loss = 3.5044 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2754 ntokens 522074008 Example 134700 of 138376 loss = 3.5047 nll loss = 2.1234 accu = 0.3730

Training: Epoch 6 of 10 Step 2755 ntokens 522109408 Example 135000 of 138376 loss = 3.5048 nll loss = 2.1233 accu = 0.3730

Training: Epoch 6 of 10 Step 2756 ntokens 522144808 Example 135300 of 138376 loss = 3.5046 nll loss = 2.1233 accu = 0.3730

Training: Epoch 6 of 10 Step 2757 ntokens 522180208 Example 135600 of 138376 loss = 3.5047 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2758 ntokens 522215608 Example 135900 of 138376 loss = 3.5046 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2759 ntokens 522251008 Example 136200 of 138376 loss = 3.5047 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2760 ntokens 522286408 Example 136500 of 138376 loss = 3.5049 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2761 ntokens 522321808 Example 136800 of 138376 loss = 3.5048 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2762 ntokens 522357208 Example 137100 of 138376 loss = 3.5049 nll loss = 2.1230 accu = 0.3731

Training: Epoch 6 of 10 Step 2763 ntokens 522392608 Example 137400 of 138376 loss = 3.5050 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2764 ntokens 522428008 Example 137700 of 138376 loss = 3.5049 nll loss = 2.1231 accu = 0.3731

Training: Epoch 6 of 10 Step 2765 ntokens 522463408 Example 138000 of 138376 loss = 3.5050 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2766 ntokens 522498808 Example 138300 of 138376 loss = 3.5053 nll loss = 2.1232 accu = 0.3731

Training: Epoch 6 of 10 Step 2767 ntokens 522507776 Example 138376 of 138376 loss = 3.5056 nll loss = 2.1232 accu = 0.3731

Writing to checkpoint at 2024-05-28 17:03:03.955095
Validating: Epoch 6 of 10 Step 0 ntokens 522507776 Example 300 of 34323 loss = 3.4991 nll loss = 2.0708 accu = 0.3928

Validating: Epoch 6 of 10 Step 1 ntokens 522507776 Example 600 of 34323 loss = 3.4831 nll loss = 2.0891 accu = 0.3846

Validating: Epoch 6 of 10 Step 2 ntokens 522507776 Example 900 of 34323 loss = 3.4902 nll loss = 2.1002 accu = 0.3809

Validating: Epoch 6 of 10 Step 3 ntokens 522507776 Example 1200 of 34323 loss = 3.4882 nll loss = 2.0875 accu = 0.3845

Validating: Epoch 6 of 10 Step 4 ntokens 522507776 Example 1500 of 34323 loss = 3.4910 nll loss = 2.1093 accu = 0.3775

Validating: Epoch 6 of 10 Step 5 ntokens 522507776 Example 1800 of 34323 loss = 3.4977 nll loss = 2.1164 accu = 0.3746

Validating: Epoch 6 of 10 Step 6 ntokens 522507776 Example 2100 of 34323 loss = 3.4987 nll loss = 2.1142 accu = 0.3750

Validating: Epoch 6 of 10 Step 7 ntokens 522507776 Example 2400 of 34323 loss = 3.5153 nll loss = 2.1153 accu = 0.3749

Validating: Epoch 6 of 10 Step 8 ntokens 522507776 Example 2700 of 34323 loss = 3.5134 nll loss = 2.1092 accu = 0.3775

Validating: Epoch 6 of 10 Step 9 ntokens 522507776 Example 3000 of 34323 loss = 3.5066 nll loss = 2.1117 accu = 0.3763

Validating: Epoch 6 of 10 Step 10 ntokens 522507776 Example 3300 of 34323 loss = 3.5087 nll loss = 2.1105 accu = 0.3768

Validating: Epoch 6 of 10 Step 11 ntokens 522507776 Example 3600 of 34323 loss = 3.5003 nll loss = 2.1095 accu = 0.3769

Validating: Epoch 6 of 10 Step 12 ntokens 522507776 Example 3900 of 34323 loss = 3.5004 nll loss = 2.1126 accu = 0.3760

Validating: Epoch 6 of 10 Step 13 ntokens 522507776 Example 4200 of 34323 loss = 3.4932 nll loss = 2.1124 accu = 0.3759

Validating: Epoch 6 of 10 Step 14 ntokens 522507776 Example 4500 of 34323 loss = 3.4913 nll loss = 2.1134 accu = 0.3757

Validating: Epoch 6 of 10 Step 15 ntokens 522507776 Example 4800 of 34323 loss = 3.4965 nll loss = 2.1175 accu = 0.3744

Validating: Epoch 6 of 10 Step 16 ntokens 522507776 Example 5100 of 34323 loss = 3.4972 nll loss = 2.1172 accu = 0.3746

Validating: Epoch 6 of 10 Step 17 ntokens 522507776 Example 5400 of 34323 loss = 3.4963 nll loss = 2.1148 accu = 0.3753

Validating: Epoch 6 of 10 Step 18 ntokens 522507776 Example 5700 of 34323 loss = 3.5002 nll loss = 2.1109 accu = 0.3767

Validating: Epoch 6 of 10 Step 19 ntokens 522507776 Example 6000 of 34323 loss = 3.4973 nll loss = 2.1099 accu = 0.3772

Validating: Epoch 6 of 10 Step 20 ntokens 522507776 Example 6300 of 34323 loss = 3.4950 nll loss = 2.1119 accu = 0.3764

Validating: Epoch 6 of 10 Step 21 ntokens 522507776 Example 6600 of 34323 loss = 3.4914 nll loss = 2.1109 accu = 0.3769

Validating: Epoch 6 of 10 Step 22 ntokens 522507776 Example 6900 of 34323 loss = 3.4926 nll loss = 2.1101 accu = 0.3773

Validating: Epoch 6 of 10 Step 23 ntokens 522507776 Example 7200 of 34323 loss = 3.4945 nll loss = 2.1103 accu = 0.3774

Validating: Epoch 6 of 10 Step 24 ntokens 522507776 Example 7500 of 34323 loss = 3.4950 nll loss = 2.1129 accu = 0.3766

Validating: Epoch 6 of 10 Step 25 ntokens 522507776 Example 7800 of 34323 loss = 3.4945 nll loss = 2.1147 accu = 0.3760

Validating: Epoch 6 of 10 Step 26 ntokens 522507776 Example 8100 of 34323 loss = 3.4953 nll loss = 2.1152 accu = 0.3758

Validating: Epoch 6 of 10 Step 27 ntokens 522507776 Example 8400 of 34323 loss = 3.4973 nll loss = 2.1147 accu = 0.3760

Validating: Epoch 6 of 10 Step 28 ntokens 522507776 Example 8700 of 34323 loss = 3.4984 nll loss = 2.1155 accu = 0.3757

Validating: Epoch 6 of 10 Step 29 ntokens 522507776 Example 9000 of 34323 loss = 3.5040 nll loss = 2.1173 accu = 0.3750

Validating: Epoch 6 of 10 Step 30 ntokens 522507776 Example 9300 of 34323 loss = 3.5047 nll loss = 2.1190 accu = 0.3743

Validating: Epoch 6 of 10 Step 31 ntokens 522507776 Example 9600 of 34323 loss = 3.5051 nll loss = 2.1164 accu = 0.3752

Validating: Epoch 6 of 10 Step 32 ntokens 522507776 Example 9900 of 34323 loss = 3.5062 nll loss = 2.1188 accu = 0.3743

Validating: Epoch 6 of 10 Step 33 ntokens 522507776 Example 10200 of 34323 loss = 3.5020 nll loss = 2.1197 accu = 0.3740

Validating: Epoch 6 of 10 Step 34 ntokens 522507776 Example 10500 of 34323 loss = 3.5022 nll loss = 2.1183 accu = 0.3746

Validating: Epoch 6 of 10 Step 35 ntokens 522507776 Example 10800 of 34323 loss = 3.5041 nll loss = 2.1198 accu = 0.3740

Validating: Epoch 6 of 10 Step 36 ntokens 522507776 Example 11100 of 34323 loss = 3.5055 nll loss = 2.1190 accu = 0.3743

Validating: Epoch 6 of 10 Step 37 ntokens 522507776 Example 11400 of 34323 loss = 3.5068 nll loss = 2.1178 accu = 0.3748

Validating: Epoch 6 of 10 Step 38 ntokens 522507776 Example 11700 of 34323 loss = 3.5067 nll loss = 2.1174 accu = 0.3749

Validating: Epoch 6 of 10 Step 39 ntokens 522507776 Example 12000 of 34323 loss = 3.5077 nll loss = 2.1195 accu = 0.3742

Validating: Epoch 6 of 10 Step 40 ntokens 522507776 Example 12300 of 34323 loss = 3.5094 nll loss = 2.1210 accu = 0.3736

Validating: Epoch 6 of 10 Step 41 ntokens 522507776 Example 12600 of 34323 loss = 3.5101 nll loss = 2.1200 accu = 0.3740

Validating: Epoch 6 of 10 Step 42 ntokens 522507776 Example 12900 of 34323 loss = 3.5099 nll loss = 2.1196 accu = 0.3740

Validating: Epoch 6 of 10 Step 43 ntokens 522507776 Example 13200 of 34323 loss = 3.5105 nll loss = 2.1209 accu = 0.3736

Validating: Epoch 6 of 10 Step 44 ntokens 522507776 Example 13500 of 34323 loss = 3.5088 nll loss = 2.1220 accu = 0.3732

Validating: Epoch 6 of 10 Step 45 ntokens 522507776 Example 13800 of 34323 loss = 3.5102 nll loss = 2.1235 accu = 0.3727

Validating: Epoch 6 of 10 Step 46 ntokens 522507776 Example 14100 of 34323 loss = 3.5112 nll loss = 2.1223 accu = 0.3731

Validating: Epoch 6 of 10 Step 47 ntokens 522507776 Example 14400 of 34323 loss = 3.5122 nll loss = 2.1231 accu = 0.3729

Validating: Epoch 6 of 10 Step 48 ntokens 522507776 Example 14700 of 34323 loss = 3.5116 nll loss = 2.1225 accu = 0.3730

Validating: Epoch 6 of 10 Step 49 ntokens 522507776 Example 15000 of 34323 loss = 3.5113 nll loss = 2.1225 accu = 0.3731

Validating: Epoch 6 of 10 Step 50 ntokens 522507776 Example 15300 of 34323 loss = 3.5116 nll loss = 2.1238 accu = 0.3726

Validating: Epoch 6 of 10 Step 51 ntokens 522507776 Example 15600 of 34323 loss = 3.5085 nll loss = 2.1220 accu = 0.3733

Validating: Epoch 6 of 10 Step 52 ntokens 522507776 Example 15900 of 34323 loss = 3.5077 nll loss = 2.1213 accu = 0.3735

Validating: Epoch 6 of 10 Step 53 ntokens 522507776 Example 16200 of 34323 loss = 3.5073 nll loss = 2.1225 accu = 0.3730

Validating: Epoch 6 of 10 Step 54 ntokens 522507776 Example 16500 of 34323 loss = 3.5068 nll loss = 2.1224 accu = 0.3731

Validating: Epoch 6 of 10 Step 55 ntokens 522507776 Example 16800 of 34323 loss = 3.5060 nll loss = 2.1229 accu = 0.3729

Validating: Epoch 6 of 10 Step 56 ntokens 522507776 Example 17100 of 34323 loss = 3.5068 nll loss = 2.1231 accu = 0.3729

Validating: Epoch 6 of 10 Step 57 ntokens 522507776 Example 17400 of 34323 loss = 3.5065 nll loss = 2.1227 accu = 0.3730

Validating: Epoch 6 of 10 Step 58 ntokens 522507776 Example 17700 of 34323 loss = 3.5056 nll loss = 2.1235 accu = 0.3727

Validating: Epoch 6 of 10 Step 59 ntokens 522507776 Example 18000 of 34323 loss = 3.5061 nll loss = 2.1235 accu = 0.3728

Validating: Epoch 6 of 10 Step 60 ntokens 522507776 Example 18300 of 34323 loss = 3.5067 nll loss = 2.1215 accu = 0.3735

Validating: Epoch 6 of 10 Step 61 ntokens 522507776 Example 18600 of 34323 loss = 3.5069 nll loss = 2.1213 accu = 0.3736

Validating: Epoch 6 of 10 Step 62 ntokens 522507776 Example 18900 of 34323 loss = 3.5075 nll loss = 2.1217 accu = 0.3736

Validating: Epoch 6 of 10 Step 63 ntokens 522507776 Example 19200 of 34323 loss = 3.5067 nll loss = 2.1203 accu = 0.3741

Validating: Epoch 6 of 10 Step 64 ntokens 522507776 Example 19500 of 34323 loss = 3.5059 nll loss = 2.1200 accu = 0.3742

Validating: Epoch 6 of 10 Step 65 ntokens 522507776 Example 19800 of 34323 loss = 3.5064 nll loss = 2.1195 accu = 0.3744

Validating: Epoch 6 of 10 Step 66 ntokens 522507776 Example 20100 of 34323 loss = 3.5050 nll loss = 2.1191 accu = 0.3745

Validating: Epoch 6 of 10 Step 67 ntokens 522507776 Example 20400 of 34323 loss = 3.5057 nll loss = 2.1194 accu = 0.3744

Validating: Epoch 6 of 10 Step 68 ntokens 522507776 Example 20700 of 34323 loss = 3.5065 nll loss = 2.1193 accu = 0.3745

Validating: Epoch 6 of 10 Step 69 ntokens 522507776 Example 21000 of 34323 loss = 3.5072 nll loss = 2.1189 accu = 0.3746

Validating: Epoch 6 of 10 Step 70 ntokens 522507776 Example 21300 of 34323 loss = 3.5077 nll loss = 2.1197 accu = 0.3742

Validating: Epoch 6 of 10 Step 71 ntokens 522507776 Example 21600 of 34323 loss = 3.5080 nll loss = 2.1202 accu = 0.3740

Validating: Epoch 6 of 10 Step 72 ntokens 522507776 Example 21900 of 34323 loss = 3.5080 nll loss = 2.1193 accu = 0.3743

Validating: Epoch 6 of 10 Step 73 ntokens 522507776 Example 22200 of 34323 loss = 3.5087 nll loss = 2.1190 accu = 0.3744

Validating: Epoch 6 of 10 Step 74 ntokens 522507776 Example 22500 of 34323 loss = 3.5077 nll loss = 2.1192 accu = 0.3743

Validating: Epoch 6 of 10 Step 75 ntokens 522507776 Example 22800 of 34323 loss = 3.5070 nll loss = 2.1193 accu = 0.3743

Validating: Epoch 6 of 10 Step 76 ntokens 522507776 Example 23100 of 34323 loss = 3.5062 nll loss = 2.1186 accu = 0.3746

Validating: Epoch 6 of 10 Step 77 ntokens 522507776 Example 23400 of 34323 loss = 3.5062 nll loss = 2.1193 accu = 0.3743

Validating: Epoch 6 of 10 Step 78 ntokens 522507776 Example 23700 of 34323 loss = 3.5058 nll loss = 2.1205 accu = 0.3739

Validating: Epoch 6 of 10 Step 79 ntokens 522507776 Example 24000 of 34323 loss = 3.5049 nll loss = 2.1204 accu = 0.3740

Validating: Epoch 6 of 10 Step 80 ntokens 522507776 Example 24300 of 34323 loss = 3.5051 nll loss = 2.1203 accu = 0.3740

Validating: Epoch 6 of 10 Step 81 ntokens 522507776 Example 24600 of 34323 loss = 3.5067 nll loss = 2.1204 accu = 0.3739

Validating: Epoch 6 of 10 Step 82 ntokens 522507776 Example 24900 of 34323 loss = 3.5066 nll loss = 2.1203 accu = 0.3740

Validating: Epoch 6 of 10 Step 83 ntokens 522507776 Example 25200 of 34323 loss = 3.5063 nll loss = 2.1206 accu = 0.3738

Validating: Epoch 6 of 10 Step 84 ntokens 522507776 Example 25500 of 34323 loss = 3.5060 nll loss = 2.1202 accu = 0.3739

Validating: Epoch 6 of 10 Step 85 ntokens 522507776 Example 25800 of 34323 loss = 3.5066 nll loss = 2.1200 accu = 0.3740

Validating: Epoch 6 of 10 Step 86 ntokens 522507776 Example 26100 of 34323 loss = 3.5074 nll loss = 2.1193 accu = 0.3742

Validating: Epoch 6 of 10 Step 87 ntokens 522507776 Example 26400 of 34323 loss = 3.5061 nll loss = 2.1197 accu = 0.3741

Validating: Epoch 6 of 10 Step 88 ntokens 522507776 Example 26700 of 34323 loss = 3.5050 nll loss = 2.1192 accu = 0.3743

Validating: Epoch 6 of 10 Step 89 ntokens 522507776 Example 27000 of 34323 loss = 3.5048 nll loss = 2.1187 accu = 0.3745

Validating: Epoch 6 of 10 Step 90 ntokens 522507776 Example 27300 of 34323 loss = 3.5048 nll loss = 2.1194 accu = 0.3742

Validating: Epoch 6 of 10 Step 91 ntokens 522507776 Example 27600 of 34323 loss = 3.5047 nll loss = 2.1192 accu = 0.3743

Validating: Epoch 6 of 10 Step 92 ntokens 522507776 Example 27900 of 34323 loss = 3.5051 nll loss = 2.1199 accu = 0.3740

Validating: Epoch 6 of 10 Step 93 ntokens 522507776 Example 28200 of 34323 loss = 3.5049 nll loss = 2.1194 accu = 0.3743

Validating: Epoch 6 of 10 Step 94 ntokens 522507776 Example 28500 of 34323 loss = 3.5048 nll loss = 2.1202 accu = 0.3740

Validating: Epoch 6 of 10 Step 95 ntokens 522507776 Example 28800 of 34323 loss = 3.5040 nll loss = 2.1208 accu = 0.3738

Validating: Epoch 6 of 10 Step 96 ntokens 522507776 Example 29100 of 34323 loss = 3.5040 nll loss = 2.1211 accu = 0.3737

Validating: Epoch 6 of 10 Step 97 ntokens 522507776 Example 29400 of 34323 loss = 3.5043 nll loss = 2.1204 accu = 0.3739

Validating: Epoch 6 of 10 Step 98 ntokens 522507776 Example 29700 of 34323 loss = 3.5050 nll loss = 2.1210 accu = 0.3737

Validating: Epoch 6 of 10 Step 99 ntokens 522507776 Example 30000 of 34323 loss = 3.5059 nll loss = 2.1215 accu = 0.3735

Validating: Epoch 6 of 10 Step 100 ntokens 522507776 Example 30300 of 34323 loss = 3.5049 nll loss = 2.1209 accu = 0.3737

Validating: Epoch 6 of 10 Step 101 ntokens 522507776 Example 30600 of 34323 loss = 3.5052 nll loss = 2.1207 accu = 0.3738

Validating: Epoch 6 of 10 Step 102 ntokens 522507776 Example 30900 of 34323 loss = 3.5045 nll loss = 2.1206 accu = 0.3738

Validating: Epoch 6 of 10 Step 103 ntokens 522507776 Example 31200 of 34323 loss = 3.5027 nll loss = 2.1202 accu = 0.3739

Validating: Epoch 6 of 10 Step 104 ntokens 522507776 Example 31500 of 34323 loss = 3.5029 nll loss = 2.1200 accu = 0.3740

Validating: Epoch 6 of 10 Step 105 ntokens 522507776 Example 31800 of 34323 loss = 3.5042 nll loss = 2.1193 accu = 0.3742

Validating: Epoch 6 of 10 Step 106 ntokens 522507776 Example 32100 of 34323 loss = 3.5041 nll loss = 2.1192 accu = 0.3743

Validating: Epoch 6 of 10 Step 107 ntokens 522507776 Example 32400 of 34323 loss = 3.5043 nll loss = 2.1194 accu = 0.3742

Validating: Epoch 6 of 10 Step 108 ntokens 522507776 Example 32700 of 34323 loss = 3.5035 nll loss = 2.1190 accu = 0.3743

Validating: Epoch 6 of 10 Step 109 ntokens 522507776 Example 33000 of 34323 loss = 3.5040 nll loss = 2.1201 accu = 0.3739

Validating: Epoch 6 of 10 Step 110 ntokens 522507776 Example 33300 of 34323 loss = 3.5044 nll loss = 2.1210 accu = 0.3736

Validating: Epoch 6 of 10 Step 111 ntokens 522507776 Example 33600 of 34323 loss = 3.5046 nll loss = 2.1218 accu = 0.3733

Validating: Epoch 6 of 10 Step 112 ntokens 522507776 Example 33900 of 34323 loss = 3.5046 nll loss = 2.1223 accu = 0.3731

Validating: Epoch 6 of 10 Step 113 ntokens 522507776 Example 34200 of 34323 loss = 3.5031 nll loss = 2.1227 accu = 0.3730

Validating: Epoch 6 of 10 Step 114 ntokens 522507776 Example 34323 of 34323 loss = 3.5038 nll loss = 2.1225 accu = 0.3731

Validation complete in 0:00:15.045967
Epoch complete in 0:02:30.155723
Training: Epoch 7 of 10 Step 2767 ntokens 1028722584 Example 300 of 138376 loss = 3.3700 nll loss = 2.1058 accu = 0.3801

Training: Epoch 7 of 10 Step 2768 ntokens 1028757984 Example 600 of 138376 loss = 3.4449 nll loss = 2.0797 accu = 0.3898

Training: Epoch 7 of 10 Step 2769 ntokens 1028793384 Example 900 of 138376 loss = 3.4681 nll loss = 2.0945 accu = 0.3841

Training: Epoch 7 of 10 Step 2770 ntokens 1028828784 Example 1200 of 138376 loss = 3.4832 nll loss = 2.0997 accu = 0.3815

Training: Epoch 7 of 10 Step 2771 ntokens 1028864184 Example 1500 of 138376 loss = 3.4953 nll loss = 2.0965 accu = 0.3831

Training: Epoch 7 of 10 Step 2772 ntokens 1028899584 Example 1800 of 138376 loss = 3.4877 nll loss = 2.1001 accu = 0.3812

Training: Epoch 7 of 10 Step 2773 ntokens 1028934984 Example 2100 of 138376 loss = 3.4953 nll loss = 2.0975 accu = 0.3818

Training: Epoch 7 of 10 Step 2774 ntokens 1028970384 Example 2400 of 138376 loss = 3.5071 nll loss = 2.0993 accu = 0.3809

Training: Epoch 7 of 10 Step 2775 ntokens 1029005784 Example 2700 of 138376 loss = 3.5256 nll loss = 2.0961 accu = 0.3822

Training: Epoch 7 of 10 Step 2776 ntokens 1029041184 Example 3000 of 138376 loss = 3.5249 nll loss = 2.1021 accu = 0.3800

Training: Epoch 7 of 10 Step 2777 ntokens 1029076584 Example 3300 of 138376 loss = 3.5196 nll loss = 2.1101 accu = 0.3770

Training: Epoch 7 of 10 Step 2778 ntokens 1029111984 Example 3600 of 138376 loss = 3.5222 nll loss = 2.1079 accu = 0.3779

Training: Epoch 7 of 10 Step 2779 ntokens 1029147384 Example 3900 of 138376 loss = 3.5180 nll loss = 2.0981 accu = 0.3816

Training: Epoch 7 of 10 Step 2780 ntokens 1029182784 Example 4200 of 138376 loss = 3.5176 nll loss = 2.0993 accu = 0.3813

Training: Epoch 7 of 10 Step 2781 ntokens 1029218184 Example 4500 of 138376 loss = 3.5191 nll loss = 2.1003 accu = 0.3812

Training: Epoch 7 of 10 Step 2782 ntokens 1029253584 Example 4800 of 138376 loss = 3.5166 nll loss = 2.1006 accu = 0.3809

Training: Epoch 7 of 10 Step 2783 ntokens 1029288984 Example 5100 of 138376 loss = 3.5164 nll loss = 2.1002 accu = 0.3811

Training: Epoch 7 of 10 Step 2784 ntokens 1029324384 Example 5400 of 138376 loss = 3.5184 nll loss = 2.1036 accu = 0.3799

Training: Epoch 7 of 10 Step 2785 ntokens 1029359784 Example 5700 of 138376 loss = 3.5220 nll loss = 2.1049 accu = 0.3796

Training: Epoch 7 of 10 Step 2786 ntokens 1029395184 Example 6000 of 138376 loss = 3.5231 nll loss = 2.1064 accu = 0.3790

Training: Epoch 7 of 10 Step 2787 ntokens 1029430584 Example 6300 of 138376 loss = 3.5225 nll loss = 2.1055 accu = 0.3794

Training: Epoch 7 of 10 Step 2788 ntokens 1029465984 Example 6600 of 138376 loss = 3.5235 nll loss = 2.1058 accu = 0.3792

Training: Epoch 7 of 10 Step 2789 ntokens 1029501384 Example 6900 of 138376 loss = 3.5255 nll loss = 2.1079 accu = 0.3786

Training: Epoch 7 of 10 Step 2790 ntokens 1029536784 Example 7200 of 138376 loss = 3.5197 nll loss = 2.1040 accu = 0.3797

Training: Epoch 7 of 10 Step 2791 ntokens 1029572184 Example 7500 of 138376 loss = 3.5169 nll loss = 2.1027 accu = 0.3801

Training: Epoch 7 of 10 Step 2792 ntokens 1029607584 Example 7800 of 138376 loss = 3.5095 nll loss = 2.1036 accu = 0.3799

Training: Epoch 7 of 10 Step 2793 ntokens 1029642984 Example 8100 of 138376 loss = 3.5090 nll loss = 2.1049 accu = 0.3793

Training: Epoch 7 of 10 Step 2794 ntokens 1029678384 Example 8400 of 138376 loss = 3.5094 nll loss = 2.1064 accu = 0.3787

Training: Epoch 7 of 10 Step 2795 ntokens 1029713784 Example 8700 of 138376 loss = 3.5095 nll loss = 2.1074 accu = 0.3783

Training: Epoch 7 of 10 Step 2796 ntokens 1029749184 Example 9000 of 138376 loss = 3.5118 nll loss = 2.1083 accu = 0.3779

Training: Epoch 7 of 10 Step 2797 ntokens 1029784584 Example 9300 of 138376 loss = 3.5136 nll loss = 2.1092 accu = 0.3776

Training: Epoch 7 of 10 Step 2798 ntokens 1029819984 Example 9600 of 138376 loss = 3.5116 nll loss = 2.1092 accu = 0.3777

Training: Epoch 7 of 10 Step 2799 ntokens 1029855384 Example 9900 of 138376 loss = 3.5140 nll loss = 2.1127 accu = 0.3766

Training: Epoch 7 of 10 Step 2800 ntokens 1029890784 Example 10200 of 138376 loss = 3.5133 nll loss = 2.1151 accu = 0.3757

Training: Epoch 7 of 10 Step 2801 ntokens 1029926184 Example 10500 of 138376 loss = 3.5111 nll loss = 2.1161 accu = 0.3754

Training: Epoch 7 of 10 Step 2802 ntokens 1029961584 Example 10800 of 138376 loss = 3.5115 nll loss = 2.1193 accu = 0.3742

Training: Epoch 7 of 10 Step 2803 ntokens 1029996984 Example 11100 of 138376 loss = 3.5094 nll loss = 2.1186 accu = 0.3744

Training: Epoch 7 of 10 Step 2804 ntokens 1030032384 Example 11400 of 138376 loss = 3.5127 nll loss = 2.1200 accu = 0.3740

Training: Epoch 7 of 10 Step 2805 ntokens 1030067784 Example 11700 of 138376 loss = 3.5134 nll loss = 2.1204 accu = 0.3739

Training: Epoch 7 of 10 Step 2806 ntokens 1030103184 Example 12000 of 138376 loss = 3.5140 nll loss = 2.1182 accu = 0.3745

Training: Epoch 7 of 10 Step 2807 ntokens 1030138584 Example 12300 of 138376 loss = 3.5125 nll loss = 2.1210 accu = 0.3735

Training: Epoch 7 of 10 Step 2808 ntokens 1030173984 Example 12600 of 138376 loss = 3.5142 nll loss = 2.1224 accu = 0.3730

Training: Epoch 7 of 10 Step 2809 ntokens 1030209384 Example 12900 of 138376 loss = 3.5142 nll loss = 2.1227 accu = 0.3729

Training: Epoch 7 of 10 Step 2810 ntokens 1030244784 Example 13200 of 138376 loss = 3.5125 nll loss = 2.1238 accu = 0.3725

Training: Epoch 7 of 10 Step 2811 ntokens 1030280184 Example 13500 of 138376 loss = 3.5122 nll loss = 2.1261 accu = 0.3717

Training: Epoch 7 of 10 Step 2812 ntokens 1030315584 Example 13800 of 138376 loss = 3.5110 nll loss = 2.1262 accu = 0.3718

Training: Epoch 7 of 10 Step 2813 ntokens 1030350984 Example 14100 of 138376 loss = 3.5104 nll loss = 2.1283 accu = 0.3711

Training: Epoch 7 of 10 Step 2814 ntokens 1030386384 Example 14400 of 138376 loss = 3.5115 nll loss = 2.1266 accu = 0.3716

Training: Epoch 7 of 10 Step 2815 ntokens 1030421784 Example 14700 of 138376 loss = 3.5096 nll loss = 2.1275 accu = 0.3713

Training: Epoch 7 of 10 Step 2816 ntokens 1030457184 Example 15000 of 138376 loss = 3.5086 nll loss = 2.1269 accu = 0.3715

Training: Epoch 7 of 10 Step 2817 ntokens 1030492584 Example 15300 of 138376 loss = 3.5077 nll loss = 2.1267 accu = 0.3715

Training: Epoch 7 of 10 Step 2818 ntokens 1030527984 Example 15600 of 138376 loss = 3.5090 nll loss = 2.1251 accu = 0.3721

Training: Epoch 7 of 10 Step 2819 ntokens 1030563384 Example 15900 of 138376 loss = 3.5098 nll loss = 2.1241 accu = 0.3724

Training: Epoch 7 of 10 Step 2820 ntokens 1030598784 Example 16200 of 138376 loss = 3.5102 nll loss = 2.1252 accu = 0.3720

Training: Epoch 7 of 10 Step 2821 ntokens 1030634184 Example 16500 of 138376 loss = 3.5097 nll loss = 2.1246 accu = 0.3722

Training: Epoch 7 of 10 Step 2822 ntokens 1030669584 Example 16800 of 138376 loss = 3.5110 nll loss = 2.1246 accu = 0.3722

Training: Epoch 7 of 10 Step 2823 ntokens 1030704984 Example 17100 of 138376 loss = 3.5097 nll loss = 2.1268 accu = 0.3715

Training: Epoch 7 of 10 Step 2824 ntokens 1030740384 Example 17400 of 138376 loss = 3.5094 nll loss = 2.1269 accu = 0.3715

Training: Epoch 7 of 10 Step 2825 ntokens 1030775784 Example 17700 of 138376 loss = 3.5094 nll loss = 2.1280 accu = 0.3712

Training: Epoch 7 of 10 Step 2826 ntokens 1030811184 Example 18000 of 138376 loss = 3.5089 nll loss = 2.1278 accu = 0.3712

Training: Epoch 7 of 10 Step 2827 ntokens 1030846584 Example 18300 of 138376 loss = 3.5082 nll loss = 2.1271 accu = 0.3715

Training: Epoch 7 of 10 Step 2828 ntokens 1030881984 Example 18600 of 138376 loss = 3.5084 nll loss = 2.1259 accu = 0.3719

Training: Epoch 7 of 10 Step 2829 ntokens 1030917384 Example 18900 of 138376 loss = 3.5088 nll loss = 2.1260 accu = 0.3719

Training: Epoch 7 of 10 Step 2830 ntokens 1030952784 Example 19200 of 138376 loss = 3.5085 nll loss = 2.1265 accu = 0.3717

Training: Epoch 7 of 10 Step 2831 ntokens 1030988184 Example 19500 of 138376 loss = 3.5093 nll loss = 2.1253 accu = 0.3722

Training: Epoch 7 of 10 Step 2832 ntokens 1031023584 Example 19800 of 138376 loss = 3.5104 nll loss = 2.1248 accu = 0.3723

Training: Epoch 7 of 10 Step 2833 ntokens 1031058984 Example 20100 of 138376 loss = 3.5103 nll loss = 2.1249 accu = 0.3723

Training: Epoch 7 of 10 Step 2834 ntokens 1031094384 Example 20400 of 138376 loss = 3.5103 nll loss = 2.1253 accu = 0.3722

Training: Epoch 7 of 10 Step 2835 ntokens 1031129784 Example 20700 of 138376 loss = 3.5103 nll loss = 2.1259 accu = 0.3720

Training: Epoch 7 of 10 Step 2836 ntokens 1031165184 Example 21000 of 138376 loss = 3.5106 nll loss = 2.1267 accu = 0.3717

Training: Epoch 7 of 10 Step 2837 ntokens 1031200584 Example 21300 of 138376 loss = 3.5103 nll loss = 2.1265 accu = 0.3718

Training: Epoch 7 of 10 Step 2838 ntokens 1031235984 Example 21600 of 138376 loss = 3.5107 nll loss = 2.1257 accu = 0.3720

Training: Epoch 7 of 10 Step 2839 ntokens 1031271384 Example 21900 of 138376 loss = 3.5105 nll loss = 2.1261 accu = 0.3718

Training: Epoch 7 of 10 Step 2840 ntokens 1031306784 Example 22200 of 138376 loss = 3.5110 nll loss = 2.1270 accu = 0.3715

Training: Epoch 7 of 10 Step 2841 ntokens 1031342184 Example 22500 of 138376 loss = 3.5117 nll loss = 2.1264 accu = 0.3717

Training: Epoch 7 of 10 Step 2842 ntokens 1031377584 Example 22800 of 138376 loss = 3.5118 nll loss = 2.1267 accu = 0.3716

Training: Epoch 7 of 10 Step 2843 ntokens 1031412984 Example 23100 of 138376 loss = 3.5120 nll loss = 2.1265 accu = 0.3717

Training: Epoch 7 of 10 Step 2844 ntokens 1031448384 Example 23400 of 138376 loss = 3.5119 nll loss = 2.1282 accu = 0.3711

Training: Epoch 7 of 10 Step 2845 ntokens 1031483784 Example 23700 of 138376 loss = 3.5110 nll loss = 2.1274 accu = 0.3714

Training: Epoch 7 of 10 Step 2846 ntokens 1031519184 Example 24000 of 138376 loss = 3.5110 nll loss = 2.1259 accu = 0.3720

Training: Epoch 7 of 10 Step 2847 ntokens 1031554584 Example 24300 of 138376 loss = 3.5106 nll loss = 2.1260 accu = 0.3720

Training: Epoch 7 of 10 Step 2848 ntokens 1031589984 Example 24600 of 138376 loss = 3.5110 nll loss = 2.1259 accu = 0.3720

Training: Epoch 7 of 10 Step 2849 ntokens 1031625384 Example 24900 of 138376 loss = 3.5108 nll loss = 2.1257 accu = 0.3720

Training: Epoch 7 of 10 Step 2850 ntokens 1031660784 Example 25200 of 138376 loss = 3.5109 nll loss = 2.1248 accu = 0.3724

Training: Epoch 7 of 10 Step 2851 ntokens 1031696184 Example 25500 of 138376 loss = 3.5104 nll loss = 2.1257 accu = 0.3721

Training: Epoch 7 of 10 Step 2852 ntokens 1031731584 Example 25800 of 138376 loss = 3.5119 nll loss = 2.1253 accu = 0.3722

Training: Epoch 7 of 10 Step 2853 ntokens 1031766984 Example 26100 of 138376 loss = 3.5125 nll loss = 2.1258 accu = 0.3720

Training: Epoch 7 of 10 Step 2854 ntokens 1031802384 Example 26400 of 138376 loss = 3.5136 nll loss = 2.1264 accu = 0.3718

Training: Epoch 7 of 10 Step 2855 ntokens 1031837784 Example 26700 of 138376 loss = 3.5138 nll loss = 2.1269 accu = 0.3716

Training: Epoch 7 of 10 Step 2856 ntokens 1031873184 Example 27000 of 138376 loss = 3.5143 nll loss = 2.1272 accu = 0.3715

Training: Epoch 7 of 10 Step 2857 ntokens 1031908584 Example 27300 of 138376 loss = 3.5139 nll loss = 2.1270 accu = 0.3715

Training: Epoch 7 of 10 Step 2858 ntokens 1031943984 Example 27600 of 138376 loss = 3.5149 nll loss = 2.1273 accu = 0.3714

Training: Epoch 7 of 10 Step 2859 ntokens 1031979384 Example 27900 of 138376 loss = 3.5140 nll loss = 2.1267 accu = 0.3716

Training: Epoch 7 of 10 Step 2860 ntokens 1032014784 Example 28200 of 138376 loss = 3.5143 nll loss = 2.1274 accu = 0.3714

Training: Epoch 7 of 10 Step 2861 ntokens 1032050184 Example 28500 of 138376 loss = 3.5137 nll loss = 2.1279 accu = 0.3712

Training: Epoch 7 of 10 Step 2862 ntokens 1032085584 Example 28800 of 138376 loss = 3.5128 nll loss = 2.1274 accu = 0.3714

Training: Epoch 7 of 10 Step 2863 ntokens 1032120984 Example 29100 of 138376 loss = 3.5124 nll loss = 2.1280 accu = 0.3711

Training: Epoch 7 of 10 Step 2864 ntokens 1032156384 Example 29400 of 138376 loss = 3.5117 nll loss = 2.1290 accu = 0.3708

Training: Epoch 7 of 10 Step 2865 ntokens 1032191784 Example 29700 of 138376 loss = 3.5114 nll loss = 2.1294 accu = 0.3706

Training: Epoch 7 of 10 Step 2866 ntokens 1032227184 Example 30000 of 138376 loss = 3.5102 nll loss = 2.1300 accu = 0.3704

Training: Epoch 7 of 10 Step 2867 ntokens 1032262584 Example 30300 of 138376 loss = 3.5094 nll loss = 2.1295 accu = 0.3706

Training: Epoch 7 of 10 Step 2868 ntokens 1032297984 Example 30600 of 138376 loss = 3.5102 nll loss = 2.1299 accu = 0.3705

Training: Epoch 7 of 10 Step 2869 ntokens 1032333384 Example 30900 of 138376 loss = 3.5100 nll loss = 2.1300 accu = 0.3704

Training: Epoch 7 of 10 Step 2870 ntokens 1032368784 Example 31200 of 138376 loss = 3.5094 nll loss = 2.1291 accu = 0.3707

Training: Epoch 7 of 10 Step 2871 ntokens 1032404184 Example 31500 of 138376 loss = 3.5088 nll loss = 2.1294 accu = 0.3706

Training: Epoch 7 of 10 Step 2872 ntokens 1032439584 Example 31800 of 138376 loss = 3.5092 nll loss = 2.1292 accu = 0.3707

Training: Epoch 7 of 10 Step 2873 ntokens 1032474984 Example 32100 of 138376 loss = 3.5101 nll loss = 2.1292 accu = 0.3707

Training: Epoch 7 of 10 Step 2874 ntokens 1032510384 Example 32400 of 138376 loss = 3.5097 nll loss = 2.1283 accu = 0.3710

Training: Epoch 7 of 10 Step 2875 ntokens 1032545784 Example 32700 of 138376 loss = 3.5101 nll loss = 2.1277 accu = 0.3712

Training: Epoch 7 of 10 Step 2876 ntokens 1032581184 Example 33000 of 138376 loss = 3.5101 nll loss = 2.1288 accu = 0.3709

Training: Epoch 7 of 10 Step 2877 ntokens 1032616584 Example 33300 of 138376 loss = 3.5094 nll loss = 2.1288 accu = 0.3709

Training: Epoch 7 of 10 Step 2878 ntokens 1032651984 Example 33600 of 138376 loss = 3.5089 nll loss = 2.1289 accu = 0.3709

Training: Epoch 7 of 10 Step 2879 ntokens 1032687384 Example 33900 of 138376 loss = 3.5091 nll loss = 2.1282 accu = 0.3711

Training: Epoch 7 of 10 Step 2880 ntokens 1032722784 Example 34200 of 138376 loss = 3.5094 nll loss = 2.1281 accu = 0.3712

Training: Epoch 7 of 10 Step 2881 ntokens 1032758184 Example 34500 of 138376 loss = 3.5105 nll loss = 2.1282 accu = 0.3711

Training: Epoch 7 of 10 Step 2882 ntokens 1032793584 Example 34800 of 138376 loss = 3.5116 nll loss = 2.1282 accu = 0.3711

Training: Epoch 7 of 10 Step 2883 ntokens 1032828984 Example 35100 of 138376 loss = 3.5116 nll loss = 2.1280 accu = 0.3712

Training: Epoch 7 of 10 Step 2884 ntokens 1032864384 Example 35400 of 138376 loss = 3.5103 nll loss = 2.1279 accu = 0.3713

Training: Epoch 7 of 10 Step 2885 ntokens 1032899784 Example 35700 of 138376 loss = 3.5099 nll loss = 2.1286 accu = 0.3711

Training: Epoch 7 of 10 Step 2886 ntokens 1032935184 Example 36000 of 138376 loss = 3.5098 nll loss = 2.1276 accu = 0.3714

Training: Epoch 7 of 10 Step 2887 ntokens 1032970584 Example 36300 of 138376 loss = 3.5096 nll loss = 2.1277 accu = 0.3714

Training: Epoch 7 of 10 Step 2888 ntokens 1033005984 Example 36600 of 138376 loss = 3.5107 nll loss = 2.1276 accu = 0.3714

Training: Epoch 7 of 10 Step 2889 ntokens 1033041384 Example 36900 of 138376 loss = 3.5102 nll loss = 2.1278 accu = 0.3713

Training: Epoch 7 of 10 Step 2890 ntokens 1033076784 Example 37200 of 138376 loss = 3.5100 nll loss = 2.1278 accu = 0.3714

Training: Epoch 7 of 10 Step 2891 ntokens 1033112184 Example 37500 of 138376 loss = 3.5106 nll loss = 2.1278 accu = 0.3714

Training: Epoch 7 of 10 Step 2892 ntokens 1033147584 Example 37800 of 138376 loss = 3.5101 nll loss = 2.1273 accu = 0.3716

Training: Epoch 7 of 10 Step 2893 ntokens 1033182984 Example 38100 of 138376 loss = 3.5099 nll loss = 2.1271 accu = 0.3717

Training: Epoch 7 of 10 Step 2894 ntokens 1033218384 Example 38400 of 138376 loss = 3.5087 nll loss = 2.1276 accu = 0.3715

Training: Epoch 7 of 10 Step 2895 ntokens 1033253784 Example 38700 of 138376 loss = 3.5093 nll loss = 2.1271 accu = 0.3717

Training: Epoch 7 of 10 Step 2896 ntokens 1033289184 Example 39000 of 138376 loss = 3.5101 nll loss = 2.1270 accu = 0.3717

Training: Epoch 7 of 10 Step 2897 ntokens 1033324584 Example 39300 of 138376 loss = 3.5104 nll loss = 2.1268 accu = 0.3718

Training: Epoch 7 of 10 Step 2898 ntokens 1033359984 Example 39600 of 138376 loss = 3.5102 nll loss = 2.1263 accu = 0.3720

Training: Epoch 7 of 10 Step 2899 ntokens 1033395384 Example 39900 of 138376 loss = 3.5103 nll loss = 2.1260 accu = 0.3721

Training: Epoch 7 of 10 Step 2900 ntokens 1033430784 Example 40200 of 138376 loss = 3.5108 nll loss = 2.1258 accu = 0.3722

Training: Epoch 7 of 10 Step 2901 ntokens 1033466184 Example 40500 of 138376 loss = 3.5101 nll loss = 2.1253 accu = 0.3724

Training: Epoch 7 of 10 Step 2902 ntokens 1033501584 Example 40800 of 138376 loss = 3.5108 nll loss = 2.1256 accu = 0.3722

Training: Epoch 7 of 10 Step 2903 ntokens 1033536984 Example 41100 of 138376 loss = 3.5101 nll loss = 2.1261 accu = 0.3721

Training: Epoch 7 of 10 Step 2904 ntokens 1033572384 Example 41400 of 138376 loss = 3.5098 nll loss = 2.1265 accu = 0.3719

Training: Epoch 7 of 10 Step 2905 ntokens 1033607784 Example 41700 of 138376 loss = 3.5092 nll loss = 2.1260 accu = 0.3721

Training: Epoch 7 of 10 Step 2906 ntokens 1033643184 Example 42000 of 138376 loss = 3.5090 nll loss = 2.1261 accu = 0.3721

Training: Epoch 7 of 10 Step 2907 ntokens 1033678584 Example 42300 of 138376 loss = 3.5091 nll loss = 2.1262 accu = 0.3720

Training: Epoch 7 of 10 Step 2908 ntokens 1033713984 Example 42600 of 138376 loss = 3.5087 nll loss = 2.1261 accu = 0.3721

Training: Epoch 7 of 10 Step 2909 ntokens 1033749384 Example 42900 of 138376 loss = 3.5088 nll loss = 2.1257 accu = 0.3722

Training: Epoch 7 of 10 Step 2910 ntokens 1033784784 Example 43200 of 138376 loss = 3.5091 nll loss = 2.1256 accu = 0.3722

Training: Epoch 7 of 10 Step 2911 ntokens 1033820184 Example 43500 of 138376 loss = 3.5092 nll loss = 2.1254 accu = 0.3723

Training: Epoch 7 of 10 Step 2912 ntokens 1033855584 Example 43800 of 138376 loss = 3.5091 nll loss = 2.1251 accu = 0.3724

Training: Epoch 7 of 10 Step 2913 ntokens 1033890984 Example 44100 of 138376 loss = 3.5093 nll loss = 2.1255 accu = 0.3723

Training: Epoch 7 of 10 Step 2914 ntokens 1033926384 Example 44400 of 138376 loss = 3.5094 nll loss = 2.1258 accu = 0.3722

Training: Epoch 7 of 10 Step 2915 ntokens 1033961784 Example 44700 of 138376 loss = 3.5094 nll loss = 2.1258 accu = 0.3722

Training: Epoch 7 of 10 Step 2916 ntokens 1033997184 Example 45000 of 138376 loss = 3.5088 nll loss = 2.1263 accu = 0.3720

Training: Epoch 7 of 10 Step 2917 ntokens 1034032584 Example 45300 of 138376 loss = 3.5091 nll loss = 2.1261 accu = 0.3721

Training: Epoch 7 of 10 Step 2918 ntokens 1034067984 Example 45600 of 138376 loss = 3.5088 nll loss = 2.1265 accu = 0.3719

Training: Epoch 7 of 10 Step 2919 ntokens 1034103384 Example 45900 of 138376 loss = 3.5086 nll loss = 2.1269 accu = 0.3718

Training: Epoch 7 of 10 Step 2920 ntokens 1034138784 Example 46200 of 138376 loss = 3.5082 nll loss = 2.1268 accu = 0.3718

Training: Epoch 7 of 10 Step 2921 ntokens 1034174184 Example 46500 of 138376 loss = 3.5078 nll loss = 2.1267 accu = 0.3719

Training: Epoch 7 of 10 Step 2922 ntokens 1034209584 Example 46800 of 138376 loss = 3.5084 nll loss = 2.1268 accu = 0.3718

Training: Epoch 7 of 10 Step 2923 ntokens 1034244984 Example 47100 of 138376 loss = 3.5093 nll loss = 2.1266 accu = 0.3719

Training: Epoch 7 of 10 Step 2924 ntokens 1034280384 Example 47400 of 138376 loss = 3.5090 nll loss = 2.1267 accu = 0.3719

Training: Epoch 7 of 10 Step 2925 ntokens 1034315784 Example 47700 of 138376 loss = 3.5093 nll loss = 2.1264 accu = 0.3720

Training: Epoch 7 of 10 Step 2926 ntokens 1034351184 Example 48000 of 138376 loss = 3.5087 nll loss = 2.1266 accu = 0.3720

Training: Epoch 7 of 10 Step 2927 ntokens 1034386584 Example 48300 of 138376 loss = 3.5092 nll loss = 2.1266 accu = 0.3720

Training: Epoch 7 of 10 Step 2928 ntokens 1034421984 Example 48600 of 138376 loss = 3.5094 nll loss = 2.1262 accu = 0.3721

Training: Epoch 7 of 10 Step 2929 ntokens 1034457384 Example 48900 of 138376 loss = 3.5087 nll loss = 2.1257 accu = 0.3723

Training: Epoch 7 of 10 Step 2930 ntokens 1034492784 Example 49200 of 138376 loss = 3.5087 nll loss = 2.1251 accu = 0.3725

Training: Epoch 7 of 10 Step 2931 ntokens 1034528184 Example 49500 of 138376 loss = 3.5082 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2932 ntokens 1034563584 Example 49800 of 138376 loss = 3.5081 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2933 ntokens 1034598984 Example 50100 of 138376 loss = 3.5083 nll loss = 2.1251 accu = 0.3725

Training: Epoch 7 of 10 Step 2934 ntokens 1034634384 Example 50400 of 138376 loss = 3.5088 nll loss = 2.1251 accu = 0.3725

Training: Epoch 7 of 10 Step 2935 ntokens 1034669784 Example 50700 of 138376 loss = 3.5091 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2936 ntokens 1034705184 Example 51000 of 138376 loss = 3.5095 nll loss = 2.1252 accu = 0.3725

Training: Epoch 7 of 10 Step 2937 ntokens 1034740584 Example 51300 of 138376 loss = 3.5097 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2938 ntokens 1034775984 Example 51600 of 138376 loss = 3.5103 nll loss = 2.1245 accu = 0.3727

Training: Epoch 7 of 10 Step 2939 ntokens 1034811384 Example 51900 of 138376 loss = 3.5100 nll loss = 2.1242 accu = 0.3728

Training: Epoch 7 of 10 Step 2940 ntokens 1034846784 Example 52200 of 138376 loss = 3.5102 nll loss = 2.1246 accu = 0.3727

Training: Epoch 7 of 10 Step 2941 ntokens 1034882184 Example 52500 of 138376 loss = 3.5103 nll loss = 2.1245 accu = 0.3728

Training: Epoch 7 of 10 Step 2942 ntokens 1034917584 Example 52800 of 138376 loss = 3.5107 nll loss = 2.1247 accu = 0.3727

Training: Epoch 7 of 10 Step 2943 ntokens 1034952984 Example 53100 of 138376 loss = 3.5108 nll loss = 2.1250 accu = 0.3726

Training: Epoch 7 of 10 Step 2944 ntokens 1034988384 Example 53400 of 138376 loss = 3.5104 nll loss = 2.1246 accu = 0.3727

Training: Epoch 7 of 10 Step 2945 ntokens 1035023784 Example 53700 of 138376 loss = 3.5104 nll loss = 2.1246 accu = 0.3727

Training: Epoch 7 of 10 Step 2946 ntokens 1035059184 Example 54000 of 138376 loss = 3.5106 nll loss = 2.1245 accu = 0.3727

Training: Epoch 7 of 10 Step 2947 ntokens 1035094584 Example 54300 of 138376 loss = 3.5099 nll loss = 2.1245 accu = 0.3727

Training: Epoch 7 of 10 Step 2948 ntokens 1035129984 Example 54600 of 138376 loss = 3.5100 nll loss = 2.1244 accu = 0.3727

Training: Epoch 7 of 10 Step 2949 ntokens 1035165384 Example 54900 of 138376 loss = 3.5103 nll loss = 2.1245 accu = 0.3727

Training: Epoch 7 of 10 Step 2950 ntokens 1035200784 Example 55200 of 138376 loss = 3.5103 nll loss = 2.1240 accu = 0.3728

Training: Epoch 7 of 10 Step 2951 ntokens 1035236184 Example 55500 of 138376 loss = 3.5103 nll loss = 2.1239 accu = 0.3729

Training: Epoch 7 of 10 Step 2952 ntokens 1035271584 Example 55800 of 138376 loss = 3.5105 nll loss = 2.1240 accu = 0.3729

Training: Epoch 7 of 10 Step 2953 ntokens 1035306984 Example 56100 of 138376 loss = 3.5100 nll loss = 2.1238 accu = 0.3730

Training: Epoch 7 of 10 Step 2954 ntokens 1035342384 Example 56400 of 138376 loss = 3.5101 nll loss = 2.1241 accu = 0.3728

Training: Epoch 7 of 10 Step 2955 ntokens 1035377784 Example 56700 of 138376 loss = 3.5096 nll loss = 2.1237 accu = 0.3730

Training: Epoch 7 of 10 Step 2956 ntokens 1035413184 Example 57000 of 138376 loss = 3.5089 nll loss = 2.1236 accu = 0.3730

Training: Epoch 7 of 10 Step 2957 ntokens 1035448584 Example 57300 of 138376 loss = 3.5089 nll loss = 2.1232 accu = 0.3731

Training: Epoch 7 of 10 Step 2958 ntokens 1035483984 Example 57600 of 138376 loss = 3.5092 nll loss = 2.1241 accu = 0.3728

Training: Epoch 7 of 10 Step 2959 ntokens 1035519384 Example 57900 of 138376 loss = 3.5092 nll loss = 2.1238 accu = 0.3729

Training: Epoch 7 of 10 Step 2960 ntokens 1035554784 Example 58200 of 138376 loss = 3.5092 nll loss = 2.1242 accu = 0.3728

Training: Epoch 7 of 10 Step 2961 ntokens 1035590184 Example 58500 of 138376 loss = 3.5092 nll loss = 2.1243 accu = 0.3728

Training: Epoch 7 of 10 Step 2962 ntokens 1035625584 Example 58800 of 138376 loss = 3.5092 nll loss = 2.1244 accu = 0.3727

Training: Epoch 7 of 10 Step 2963 ntokens 1035660984 Example 59100 of 138376 loss = 3.5094 nll loss = 2.1247 accu = 0.3726

Training: Epoch 7 of 10 Step 2964 ntokens 1035696384 Example 59400 of 138376 loss = 3.5094 nll loss = 2.1244 accu = 0.3727

Training: Epoch 7 of 10 Step 2965 ntokens 1035731784 Example 59700 of 138376 loss = 3.5092 nll loss = 2.1244 accu = 0.3728

Training: Epoch 7 of 10 Step 2966 ntokens 1035767184 Example 60000 of 138376 loss = 3.5093 nll loss = 2.1244 accu = 0.3727

Training: Epoch 7 of 10 Step 2967 ntokens 1035802584 Example 60300 of 138376 loss = 3.5094 nll loss = 2.1246 accu = 0.3727

Training: Epoch 7 of 10 Step 2968 ntokens 1035837984 Example 60600 of 138376 loss = 3.5093 nll loss = 2.1247 accu = 0.3726

Training: Epoch 7 of 10 Step 2969 ntokens 1035873384 Example 60900 of 138376 loss = 3.5093 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2970 ntokens 1035908784 Example 61200 of 138376 loss = 3.5090 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2971 ntokens 1035944184 Example 61500 of 138376 loss = 3.5088 nll loss = 2.1249 accu = 0.3725

Training: Epoch 7 of 10 Step 2972 ntokens 1035979584 Example 61800 of 138376 loss = 3.5088 nll loss = 2.1251 accu = 0.3724

Training: Epoch 7 of 10 Step 2973 ntokens 1036014984 Example 62100 of 138376 loss = 3.5087 nll loss = 2.1254 accu = 0.3723

Training: Epoch 7 of 10 Step 2974 ntokens 1036050384 Example 62400 of 138376 loss = 3.5083 nll loss = 2.1251 accu = 0.3725

Training: Epoch 7 of 10 Step 2975 ntokens 1036085784 Example 62700 of 138376 loss = 3.5085 nll loss = 2.1252 accu = 0.3724

Training: Epoch 7 of 10 Step 2976 ntokens 1036121184 Example 63000 of 138376 loss = 3.5090 nll loss = 2.1255 accu = 0.3724

Training: Epoch 7 of 10 Step 2977 ntokens 1036156584 Example 63300 of 138376 loss = 3.5091 nll loss = 2.1258 accu = 0.3722

Training: Epoch 7 of 10 Step 2978 ntokens 1036191984 Example 63600 of 138376 loss = 3.5098 nll loss = 2.1255 accu = 0.3723

Training: Epoch 7 of 10 Step 2979 ntokens 1036227384 Example 63900 of 138376 loss = 3.5098 nll loss = 2.1250 accu = 0.3725

Training: Epoch 7 of 10 Step 2980 ntokens 1036262784 Example 64200 of 138376 loss = 3.5099 nll loss = 2.1248 accu = 0.3726

Training: Epoch 7 of 10 Step 2981 ntokens 1036298184 Example 64500 of 138376 loss = 3.5101 nll loss = 2.1244 accu = 0.3728

Training: Epoch 7 of 10 Step 2982 ntokens 1036333584 Example 64800 of 138376 loss = 3.5103 nll loss = 2.1241 accu = 0.3729

Training: Epoch 7 of 10 Step 2983 ntokens 1036368984 Example 65100 of 138376 loss = 3.5105 nll loss = 2.1239 accu = 0.3729

Training: Epoch 7 of 10 Step 2984 ntokens 1036404384 Example 65400 of 138376 loss = 3.5100 nll loss = 2.1239 accu = 0.3730

Training: Epoch 7 of 10 Step 2985 ntokens 1036439784 Example 65700 of 138376 loss = 3.5099 nll loss = 2.1240 accu = 0.3729

Training: Epoch 7 of 10 Step 2986 ntokens 1036475184 Example 66000 of 138376 loss = 3.5097 nll loss = 2.1242 accu = 0.3729

Training: Epoch 7 of 10 Step 2987 ntokens 1036510584 Example 66300 of 138376 loss = 3.5094 nll loss = 2.1243 accu = 0.3728

Training: Epoch 7 of 10 Step 2988 ntokens 1036545984 Example 66600 of 138376 loss = 3.5091 nll loss = 2.1240 accu = 0.3729

Training: Epoch 7 of 10 Step 2989 ntokens 1036581384 Example 66900 of 138376 loss = 3.5090 nll loss = 2.1240 accu = 0.3729

Training: Epoch 7 of 10 Step 2990 ntokens 1036616784 Example 67200 of 138376 loss = 3.5088 nll loss = 2.1239 accu = 0.3730

Training: Epoch 7 of 10 Step 2991 ntokens 1036652184 Example 67500 of 138376 loss = 3.5086 nll loss = 2.1238 accu = 0.3730

Training: Epoch 7 of 10 Step 2992 ntokens 1036687584 Example 67800 of 138376 loss = 3.5086 nll loss = 2.1241 accu = 0.3729

Training: Epoch 7 of 10 Step 2993 ntokens 1036722984 Example 68100 of 138376 loss = 3.5090 nll loss = 2.1239 accu = 0.3730

Training: Epoch 7 of 10 Step 2994 ntokens 1036758384 Example 68400 of 138376 loss = 3.5090 nll loss = 2.1237 accu = 0.3730

Training: Epoch 7 of 10 Step 2995 ntokens 1036793784 Example 68700 of 138376 loss = 3.5091 nll loss = 2.1235 accu = 0.3731

Training: Epoch 7 of 10 Step 2996 ntokens 1036829184 Example 69000 of 138376 loss = 3.5093 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 2997 ntokens 1036864584 Example 69300 of 138376 loss = 3.5093 nll loss = 2.1235 accu = 0.3731

Training: Epoch 7 of 10 Step 2998 ntokens 1036899984 Example 69600 of 138376 loss = 3.5093 nll loss = 2.1233 accu = 0.3732

Training: Epoch 7 of 10 Step 2999 ntokens 1036935384 Example 69900 of 138376 loss = 3.5093 nll loss = 2.1232 accu = 0.3732

Training: Epoch 7 of 10 Step 3000 ntokens 1036970784 Example 70200 of 138376 loss = 3.5094 nll loss = 2.1234 accu = 0.3731

Training: Epoch 7 of 10 Step 3001 ntokens 1037006184 Example 70500 of 138376 loss = 3.5093 nll loss = 2.1231 accu = 0.3732

Training: Epoch 7 of 10 Step 3002 ntokens 1037041584 Example 70800 of 138376 loss = 3.5093 nll loss = 2.1232 accu = 0.3732

Training: Epoch 7 of 10 Step 3003 ntokens 1037076984 Example 71100 of 138376 loss = 3.5094 nll loss = 2.1232 accu = 0.3732

Training: Epoch 7 of 10 Step 3004 ntokens 1037112384 Example 71400 of 138376 loss = 3.5094 nll loss = 2.1231 accu = 0.3733

Training: Epoch 7 of 10 Step 3005 ntokens 1037147784 Example 71700 of 138376 loss = 3.5095 nll loss = 2.1231 accu = 0.3733

Training: Epoch 7 of 10 Step 3006 ntokens 1037183184 Example 72000 of 138376 loss = 3.5097 nll loss = 2.1232 accu = 0.3732

Training: Epoch 7 of 10 Step 3007 ntokens 1037218584 Example 72300 of 138376 loss = 3.5094 nll loss = 2.1231 accu = 0.3733

Training: Epoch 7 of 10 Step 3008 ntokens 1037253984 Example 72600 of 138376 loss = 3.5094 nll loss = 2.1229 accu = 0.3734

Training: Epoch 7 of 10 Step 3009 ntokens 1037289384 Example 72900 of 138376 loss = 3.5087 nll loss = 2.1228 accu = 0.3734

Training: Epoch 7 of 10 Step 3010 ntokens 1037324784 Example 73200 of 138376 loss = 3.5088 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3011 ntokens 1037360184 Example 73500 of 138376 loss = 3.5084 nll loss = 2.1227 accu = 0.3734

Training: Epoch 7 of 10 Step 3012 ntokens 1037395584 Example 73800 of 138376 loss = 3.5080 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3013 ntokens 1037430984 Example 74100 of 138376 loss = 3.5078 nll loss = 2.1226 accu = 0.3734

Training: Epoch 7 of 10 Step 3014 ntokens 1037466384 Example 74400 of 138376 loss = 3.5074 nll loss = 2.1226 accu = 0.3734

Training: Epoch 7 of 10 Step 3015 ntokens 1037501784 Example 74700 of 138376 loss = 3.5077 nll loss = 2.1227 accu = 0.3734

Training: Epoch 7 of 10 Step 3016 ntokens 1037537184 Example 75000 of 138376 loss = 3.5077 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3017 ntokens 1037572584 Example 75300 of 138376 loss = 3.5079 nll loss = 2.1223 accu = 0.3735

Training: Epoch 7 of 10 Step 3018 ntokens 1037607984 Example 75600 of 138376 loss = 3.5081 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3019 ntokens 1037643384 Example 75900 of 138376 loss = 3.5083 nll loss = 2.1224 accu = 0.3735

Training: Epoch 7 of 10 Step 3020 ntokens 1037678784 Example 76200 of 138376 loss = 3.5081 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3021 ntokens 1037714184 Example 76500 of 138376 loss = 3.5083 nll loss = 2.1219 accu = 0.3737

Training: Epoch 7 of 10 Step 3022 ntokens 1037749584 Example 76800 of 138376 loss = 3.5083 nll loss = 2.1219 accu = 0.3737

Training: Epoch 7 of 10 Step 3023 ntokens 1037784984 Example 77100 of 138376 loss = 3.5083 nll loss = 2.1218 accu = 0.3737

Training: Epoch 7 of 10 Step 3024 ntokens 1037820384 Example 77400 of 138376 loss = 3.5084 nll loss = 2.1219 accu = 0.3737

Training: Epoch 7 of 10 Step 3025 ntokens 1037855784 Example 77700 of 138376 loss = 3.5083 nll loss = 2.1221 accu = 0.3736

Training: Epoch 7 of 10 Step 3026 ntokens 1037891184 Example 78000 of 138376 loss = 3.5080 nll loss = 2.1220 accu = 0.3737

Training: Epoch 7 of 10 Step 3027 ntokens 1037926584 Example 78300 of 138376 loss = 3.5079 nll loss = 2.1220 accu = 0.3737

Training: Epoch 7 of 10 Step 3028 ntokens 1037961984 Example 78600 of 138376 loss = 3.5079 nll loss = 2.1219 accu = 0.3737

Training: Epoch 7 of 10 Step 3029 ntokens 1037997384 Example 78900 of 138376 loss = 3.5077 nll loss = 2.1218 accu = 0.3738

Training: Epoch 7 of 10 Step 3030 ntokens 1038032784 Example 79200 of 138376 loss = 3.5078 nll loss = 2.1217 accu = 0.3738

Training: Epoch 7 of 10 Step 3031 ntokens 1038068184 Example 79500 of 138376 loss = 3.5078 nll loss = 2.1218 accu = 0.3738

Training: Epoch 7 of 10 Step 3032 ntokens 1038103584 Example 79800 of 138376 loss = 3.5078 nll loss = 2.1217 accu = 0.3738

Training: Epoch 7 of 10 Step 3033 ntokens 1038138984 Example 80100 of 138376 loss = 3.5075 nll loss = 2.1219 accu = 0.3737

Training: Epoch 7 of 10 Step 3034 ntokens 1038174384 Example 80400 of 138376 loss = 3.5075 nll loss = 2.1220 accu = 0.3737

Training: Epoch 7 of 10 Step 3035 ntokens 1038209784 Example 80700 of 138376 loss = 3.5074 nll loss = 2.1221 accu = 0.3737

Training: Epoch 7 of 10 Step 3036 ntokens 1038245184 Example 81000 of 138376 loss = 3.5073 nll loss = 2.1221 accu = 0.3737

Training: Epoch 7 of 10 Step 3037 ntokens 1038280584 Example 81300 of 138376 loss = 3.5077 nll loss = 2.1222 accu = 0.3737

Training: Epoch 7 of 10 Step 3038 ntokens 1038315984 Example 81600 of 138376 loss = 3.5080 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3039 ntokens 1038351384 Example 81900 of 138376 loss = 3.5080 nll loss = 2.1225 accu = 0.3735

Training: Epoch 7 of 10 Step 3040 ntokens 1038386784 Example 82200 of 138376 loss = 3.5081 nll loss = 2.1225 accu = 0.3736

Training: Epoch 7 of 10 Step 3041 ntokens 1038422184 Example 82500 of 138376 loss = 3.5079 nll loss = 2.1224 accu = 0.3736

Training: Epoch 7 of 10 Step 3042 ntokens 1038457584 Example 82800 of 138376 loss = 3.5076 nll loss = 2.1223 accu = 0.3736

Training: Epoch 7 of 10 Step 3043 ntokens 1038492984 Example 83100 of 138376 loss = 3.5073 nll loss = 2.1219 accu = 0.3737

Training: Epoch 7 of 10 Step 3044 ntokens 1038528384 Example 83400 of 138376 loss = 3.5073 nll loss = 2.1220 accu = 0.3737

Training: Epoch 7 of 10 Step 3045 ntokens 1038563784 Example 83700 of 138376 loss = 3.5074 nll loss = 2.1220 accu = 0.3737

Training: Epoch 7 of 10 Step 3046 ntokens 1038599184 Example 84000 of 138376 loss = 3.5074 nll loss = 2.1222 accu = 0.3736

Training: Epoch 7 of 10 Step 3047 ntokens 1038634584 Example 84300 of 138376 loss = 3.5073 nll loss = 2.1222 accu = 0.3736

Training: Epoch 7 of 10 Step 3048 ntokens 1038669984 Example 84600 of 138376 loss = 3.5073 nll loss = 2.1227 accu = 0.3735

Training: Epoch 7 of 10 Step 3049 ntokens 1038705384 Example 84900 of 138376 loss = 3.5071 nll loss = 2.1230 accu = 0.3734

Training: Epoch 7 of 10 Step 3050 ntokens 1038740784 Example 85200 of 138376 loss = 3.5075 nll loss = 2.1230 accu = 0.3734

Training: Epoch 7 of 10 Step 3051 ntokens 1038776184 Example 85500 of 138376 loss = 3.5073 nll loss = 2.1230 accu = 0.3734

Training: Epoch 7 of 10 Step 3052 ntokens 1038811584 Example 85800 of 138376 loss = 3.5072 nll loss = 2.1230 accu = 0.3734

Training: Epoch 7 of 10 Step 3053 ntokens 1038846984 Example 86100 of 138376 loss = 3.5072 nll loss = 2.1229 accu = 0.3734

Training: Epoch 7 of 10 Step 3054 ntokens 1038882384 Example 86400 of 138376 loss = 3.5074 nll loss = 2.1230 accu = 0.3733

Training: Epoch 7 of 10 Step 3055 ntokens 1038917784 Example 86700 of 138376 loss = 3.5071 nll loss = 2.1229 accu = 0.3734

Training: Epoch 7 of 10 Step 3056 ntokens 1038953184 Example 87000 of 138376 loss = 3.5070 nll loss = 2.1229 accu = 0.3734

Training: Epoch 7 of 10 Step 3057 ntokens 1038988584 Example 87300 of 138376 loss = 3.5071 nll loss = 2.1231 accu = 0.3733

Training: Epoch 7 of 10 Step 3058 ntokens 1039023984 Example 87600 of 138376 loss = 3.5072 nll loss = 2.1230 accu = 0.3734

Training: Epoch 7 of 10 Step 3059 ntokens 1039059384 Example 87900 of 138376 loss = 3.5073 nll loss = 2.1233 accu = 0.3733

Training: Epoch 7 of 10 Step 3060 ntokens 1039094784 Example 88200 of 138376 loss = 3.5075 nll loss = 2.1233 accu = 0.3732

Training: Epoch 7 of 10 Step 3061 ntokens 1039130184 Example 88500 of 138376 loss = 3.5072 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3062 ntokens 1039165584 Example 88800 of 138376 loss = 3.5074 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3063 ntokens 1039200984 Example 89100 of 138376 loss = 3.5076 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3064 ntokens 1039236384 Example 89400 of 138376 loss = 3.5072 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3065 ntokens 1039271784 Example 89700 of 138376 loss = 3.5075 nll loss = 2.1236 accu = 0.3731

Training: Epoch 7 of 10 Step 3066 ntokens 1039307184 Example 90000 of 138376 loss = 3.5072 nll loss = 2.1237 accu = 0.3731

Training: Epoch 7 of 10 Step 3067 ntokens 1039342584 Example 90300 of 138376 loss = 3.5069 nll loss = 2.1236 accu = 0.3731

Training: Epoch 7 of 10 Step 3068 ntokens 1039377984 Example 90600 of 138376 loss = 3.5070 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3069 ntokens 1039413384 Example 90900 of 138376 loss = 3.5066 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3070 ntokens 1039448784 Example 91200 of 138376 loss = 3.5065 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3071 ntokens 1039484184 Example 91500 of 138376 loss = 3.5063 nll loss = 2.1237 accu = 0.3731

Training: Epoch 7 of 10 Step 3072 ntokens 1039519584 Example 91800 of 138376 loss = 3.5062 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3073 ntokens 1039554984 Example 92100 of 138376 loss = 3.5061 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3074 ntokens 1039590384 Example 92400 of 138376 loss = 3.5062 nll loss = 2.1233 accu = 0.3733

Training: Epoch 7 of 10 Step 3075 ntokens 1039625784 Example 92700 of 138376 loss = 3.5062 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3076 ntokens 1039661184 Example 93000 of 138376 loss = 3.5061 nll loss = 2.1237 accu = 0.3731

Training: Epoch 7 of 10 Step 3077 ntokens 1039696584 Example 93300 of 138376 loss = 3.5059 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3078 ntokens 1039731984 Example 93600 of 138376 loss = 3.5059 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3079 ntokens 1039767384 Example 93900 of 138376 loss = 3.5056 nll loss = 2.1233 accu = 0.3733

Training: Epoch 7 of 10 Step 3080 ntokens 1039802784 Example 94200 of 138376 loss = 3.5058 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3081 ntokens 1039838184 Example 94500 of 138376 loss = 3.5059 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3082 ntokens 1039873584 Example 94800 of 138376 loss = 3.5059 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3083 ntokens 1039908984 Example 95100 of 138376 loss = 3.5058 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3084 ntokens 1039944384 Example 95400 of 138376 loss = 3.5056 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3085 ntokens 1039979784 Example 95700 of 138376 loss = 3.5053 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3086 ntokens 1040015184 Example 96000 of 138376 loss = 3.5056 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3087 ntokens 1040050584 Example 96300 of 138376 loss = 3.5053 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3088 ntokens 1040085984 Example 96600 of 138376 loss = 3.5056 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3089 ntokens 1040121384 Example 96900 of 138376 loss = 3.5055 nll loss = 2.1234 accu = 0.3732

Training: Epoch 7 of 10 Step 3090 ntokens 1040156784 Example 97200 of 138376 loss = 3.5057 nll loss = 2.1232 accu = 0.3733

Training: Epoch 7 of 10 Step 3091 ntokens 1040192184 Example 97500 of 138376 loss = 3.5059 nll loss = 2.1232 accu = 0.3733

Training: Epoch 7 of 10 Step 3092 ntokens 1040227584 Example 97800 of 138376 loss = 3.5059 nll loss = 2.1233 accu = 0.3733

Training: Epoch 7 of 10 Step 3093 ntokens 1040262984 Example 98100 of 138376 loss = 3.5058 nll loss = 2.1235 accu = 0.3732

Training: Epoch 7 of 10 Step 3094 ntokens 1040298384 Example 98400 of 138376 loss = 3.5059 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3095 ntokens 1040333784 Example 98700 of 138376 loss = 3.5060 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3096 ntokens 1040369184 Example 99000 of 138376 loss = 3.5060 nll loss = 2.1236 accu = 0.3732

Training: Epoch 7 of 10 Step 3097 ntokens 1040404584 Example 99300 of 138376 loss = 3.5059 nll loss = 2.1238 accu = 0.3731

Training: Epoch 7 of 10 Step 3098 ntokens 1040439984 Example 99600 of 138376 loss = 3.5060 nll loss = 2.1238 accu = 0.3731

Training: Epoch 7 of 10 Step 3099 ntokens 1040475384 Example 99900 of 138376 loss = 3.5061 nll loss = 2.1237 accu = 0.3732

Training: Epoch 7 of 10 Step 3100 ntokens 1040510784 Example 100200 of 138376 loss = 3.5059 nll loss = 2.1239 accu = 0.3731

Training: Epoch 7 of 10 Step 3101 ntokens 1040546184 Example 100500 of 138376 loss = 3.5058 nll loss = 2.1239 accu = 0.3731

Training: Epoch 7 of 10 Step 3102 ntokens 1040581584 Example 100800 of 138376 loss = 3.5057 nll loss = 2.1240 accu = 0.3731

Training: Epoch 7 of 10 Step 3103 ntokens 1040616984 Example 101100 of 138376 loss = 3.5056 nll loss = 2.1239 accu = 0.3731

Training: Epoch 7 of 10 Step 3104 ntokens 1040652384 Example 101400 of 138376 loss = 3.5057 nll loss = 2.1240 accu = 0.3730

Training: Epoch 7 of 10 Step 3105 ntokens 1040687784 Example 101700 of 138376 loss = 3.5058 nll loss = 2.1240 accu = 0.3730

Training: Epoch 7 of 10 Step 3106 ntokens 1040723184 Example 102000 of 138376 loss = 3.5059 nll loss = 2.1243 accu = 0.3729

Training: Epoch 7 of 10 Step 3107 ntokens 1040758584 Example 102300 of 138376 loss = 3.5060 nll loss = 2.1244 accu = 0.3729

Training: Epoch 7 of 10 Step 3108 ntokens 1040793984 Example 102600 of 138376 loss = 3.5061 nll loss = 2.1244 accu = 0.3729

Training: Epoch 7 of 10 Step 3109 ntokens 1040829384 Example 102900 of 138376 loss = 3.5060 nll loss = 2.1246 accu = 0.3728

Training: Epoch 7 of 10 Step 3110 ntokens 1040864784 Example 103200 of 138376 loss = 3.5059 nll loss = 2.1248 accu = 0.3728

Training: Epoch 7 of 10 Step 3111 ntokens 1040900184 Example 103500 of 138376 loss = 3.5057 nll loss = 2.1245 accu = 0.3729

Training: Epoch 7 of 10 Step 3112 ntokens 1040935584 Example 103800 of 138376 loss = 3.5058 nll loss = 2.1246 accu = 0.3728

Training: Epoch 7 of 10 Step 3113 ntokens 1040970984 Example 104100 of 138376 loss = 3.5057 nll loss = 2.1249 accu = 0.3727

Training: Epoch 7 of 10 Step 3114 ntokens 1041006384 Example 104400 of 138376 loss = 3.5058 nll loss = 2.1247 accu = 0.3728

Training: Epoch 7 of 10 Step 3115 ntokens 1041041784 Example 104700 of 138376 loss = 3.5062 nll loss = 2.1248 accu = 0.3728

Training: Epoch 7 of 10 Step 3116 ntokens 1041077184 Example 105000 of 138376 loss = 3.5062 nll loss = 2.1249 accu = 0.3728

Training: Epoch 7 of 10 Step 3117 ntokens 1041112584 Example 105300 of 138376 loss = 3.5057 nll loss = 2.1248 accu = 0.3728

Training: Epoch 7 of 10 Step 3118 ntokens 1041147984 Example 105600 of 138376 loss = 3.5055 nll loss = 2.1249 accu = 0.3727

Training: Epoch 7 of 10 Step 3119 ntokens 1041183384 Example 105900 of 138376 loss = 3.5054 nll loss = 2.1250 accu = 0.3727

Training: Epoch 7 of 10 Step 3120 ntokens 1041218784 Example 106200 of 138376 loss = 3.5055 nll loss = 2.1249 accu = 0.3728

Training: Epoch 7 of 10 Step 3121 ntokens 1041254184 Example 106500 of 138376 loss = 3.5055 nll loss = 2.1249 accu = 0.3727

Training: Epoch 7 of 10 Step 3122 ntokens 1041289584 Example 106800 of 138376 loss = 3.5054 nll loss = 2.1250 accu = 0.3727

Training: Epoch 7 of 10 Step 3123 ntokens 1041324984 Example 107100 of 138376 loss = 3.5049 nll loss = 2.1249 accu = 0.3728

Training: Epoch 7 of 10 Step 3124 ntokens 1041360384 Example 107400 of 138376 loss = 3.5050 nll loss = 2.1249 accu = 0.3728

Training: Epoch 7 of 10 Step 3125 ntokens 1041395784 Example 107700 of 138376 loss = 3.5050 nll loss = 2.1250 accu = 0.3727

Training: Epoch 7 of 10 Step 3126 ntokens 1041431184 Example 108000 of 138376 loss = 3.5049 nll loss = 2.1250 accu = 0.3727

Training: Epoch 7 of 10 Step 3127 ntokens 1041466584 Example 108300 of 138376 loss = 3.5048 nll loss = 2.1251 accu = 0.3727

Training: Epoch 7 of 10 Step 3128 ntokens 1041501984 Example 108600 of 138376 loss = 3.5047 nll loss = 2.1252 accu = 0.3726

Training: Epoch 7 of 10 Step 3129 ntokens 1041537384 Example 108900 of 138376 loss = 3.5045 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3130 ntokens 1041572784 Example 109200 of 138376 loss = 3.5048 nll loss = 2.1252 accu = 0.3727

Training: Epoch 7 of 10 Step 3131 ntokens 1041608184 Example 109500 of 138376 loss = 3.5050 nll loss = 2.1252 accu = 0.3727

Training: Epoch 7 of 10 Step 3132 ntokens 1041643584 Example 109800 of 138376 loss = 3.5056 nll loss = 2.1251 accu = 0.3727

Training: Epoch 7 of 10 Step 3133 ntokens 1041678984 Example 110100 of 138376 loss = 3.5055 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3134 ntokens 1041714384 Example 110400 of 138376 loss = 3.5055 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3135 ntokens 1041749784 Example 110700 of 138376 loss = 3.5052 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3136 ntokens 1041785184 Example 111000 of 138376 loss = 3.5053 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3137 ntokens 1041820584 Example 111300 of 138376 loss = 3.5049 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3138 ntokens 1041855984 Example 111600 of 138376 loss = 3.5051 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3139 ntokens 1041891384 Example 111900 of 138376 loss = 3.5052 nll loss = 2.1255 accu = 0.3725

Training: Epoch 7 of 10 Step 3140 ntokens 1041926784 Example 112200 of 138376 loss = 3.5051 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3141 ntokens 1041962184 Example 112500 of 138376 loss = 3.5049 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3142 ntokens 1041997584 Example 112800 of 138376 loss = 3.5048 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3143 ntokens 1042032984 Example 113100 of 138376 loss = 3.5046 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3144 ntokens 1042068384 Example 113400 of 138376 loss = 3.5047 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3145 ntokens 1042103784 Example 113700 of 138376 loss = 3.5047 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3146 ntokens 1042139184 Example 114000 of 138376 loss = 3.5047 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3147 ntokens 1042174584 Example 114300 of 138376 loss = 3.5049 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3148 ntokens 1042209984 Example 114600 of 138376 loss = 3.5047 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3149 ntokens 1042245384 Example 114900 of 138376 loss = 3.5046 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3150 ntokens 1042280784 Example 115200 of 138376 loss = 3.5044 nll loss = 2.1255 accu = 0.3725

Training: Epoch 7 of 10 Step 3151 ntokens 1042316184 Example 115500 of 138376 loss = 3.5046 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3152 ntokens 1042351584 Example 115800 of 138376 loss = 3.5045 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3153 ntokens 1042386984 Example 116100 of 138376 loss = 3.5046 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3154 ntokens 1042422384 Example 116400 of 138376 loss = 3.5044 nll loss = 2.1252 accu = 0.3727

Training: Epoch 7 of 10 Step 3155 ntokens 1042457784 Example 116700 of 138376 loss = 3.5043 nll loss = 2.1251 accu = 0.3727

Training: Epoch 7 of 10 Step 3156 ntokens 1042493184 Example 117000 of 138376 loss = 3.5043 nll loss = 2.1252 accu = 0.3726

Training: Epoch 7 of 10 Step 3157 ntokens 1042528584 Example 117300 of 138376 loss = 3.5042 nll loss = 2.1250 accu = 0.3727

Training: Epoch 7 of 10 Step 3158 ntokens 1042563984 Example 117600 of 138376 loss = 3.5040 nll loss = 2.1252 accu = 0.3727

Training: Epoch 7 of 10 Step 3159 ntokens 1042599384 Example 117900 of 138376 loss = 3.5040 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3160 ntokens 1042634784 Example 118200 of 138376 loss = 3.5044 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3161 ntokens 1042670184 Example 118500 of 138376 loss = 3.5043 nll loss = 2.1252 accu = 0.3726

Training: Epoch 7 of 10 Step 3162 ntokens 1042705584 Example 118800 of 138376 loss = 3.5042 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3163 ntokens 1042740984 Example 119100 of 138376 loss = 3.5043 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3164 ntokens 1042776384 Example 119400 of 138376 loss = 3.5044 nll loss = 2.1251 accu = 0.3727

Training: Epoch 7 of 10 Step 3165 ntokens 1042811784 Example 119700 of 138376 loss = 3.5045 nll loss = 2.1252 accu = 0.3726

Training: Epoch 7 of 10 Step 3166 ntokens 1042847184 Example 120000 of 138376 loss = 3.5046 nll loss = 2.1252 accu = 0.3727

Training: Epoch 7 of 10 Step 3167 ntokens 1042882584 Example 120300 of 138376 loss = 3.5045 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3168 ntokens 1042917984 Example 120600 of 138376 loss = 3.5046 nll loss = 2.1252 accu = 0.3727

Training: Epoch 7 of 10 Step 3169 ntokens 1042953384 Example 120900 of 138376 loss = 3.5043 nll loss = 2.1253 accu = 0.3726

Training: Epoch 7 of 10 Step 3170 ntokens 1042988784 Example 121200 of 138376 loss = 3.5043 nll loss = 2.1252 accu = 0.3726

Training: Epoch 7 of 10 Step 3171 ntokens 1043024184 Example 121500 of 138376 loss = 3.5043 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3172 ntokens 1043059584 Example 121800 of 138376 loss = 3.5044 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3173 ntokens 1043094984 Example 122100 of 138376 loss = 3.5047 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3174 ntokens 1043130384 Example 122400 of 138376 loss = 3.5048 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3175 ntokens 1043165784 Example 122700 of 138376 loss = 3.5048 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3176 ntokens 1043201184 Example 123000 of 138376 loss = 3.5048 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3177 ntokens 1043236584 Example 123300 of 138376 loss = 3.5049 nll loss = 2.1255 accu = 0.3726

Training: Epoch 7 of 10 Step 3178 ntokens 1043271984 Example 123600 of 138376 loss = 3.5049 nll loss = 2.1255 accu = 0.3725

Training: Epoch 7 of 10 Step 3179 ntokens 1043307384 Example 123900 of 138376 loss = 3.5049 nll loss = 2.1258 accu = 0.3725

Training: Epoch 7 of 10 Step 3180 ntokens 1043342784 Example 124200 of 138376 loss = 3.5050 nll loss = 2.1258 accu = 0.3725

Training: Epoch 7 of 10 Step 3181 ntokens 1043378184 Example 124500 of 138376 loss = 3.5050 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3182 ntokens 1043413584 Example 124800 of 138376 loss = 3.5049 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3183 ntokens 1043448984 Example 125100 of 138376 loss = 3.5048 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3184 ntokens 1043484384 Example 125400 of 138376 loss = 3.5049 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3185 ntokens 1043519784 Example 125700 of 138376 loss = 3.5048 nll loss = 2.1258 accu = 0.3725

Training: Epoch 7 of 10 Step 3186 ntokens 1043555184 Example 126000 of 138376 loss = 3.5048 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3187 ntokens 1043590584 Example 126300 of 138376 loss = 3.5050 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3188 ntokens 1043625984 Example 126600 of 138376 loss = 3.5048 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3189 ntokens 1043661384 Example 126900 of 138376 loss = 3.5046 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3190 ntokens 1043696784 Example 127200 of 138376 loss = 3.5047 nll loss = 2.1258 accu = 0.3725

Training: Epoch 7 of 10 Step 3191 ntokens 1043732184 Example 127500 of 138376 loss = 3.5043 nll loss = 2.1258 accu = 0.3725

Training: Epoch 7 of 10 Step 3192 ntokens 1043767584 Example 127800 of 138376 loss = 3.5041 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3193 ntokens 1043802984 Example 128100 of 138376 loss = 3.5039 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3194 ntokens 1043838384 Example 128400 of 138376 loss = 3.5040 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3195 ntokens 1043873784 Example 128700 of 138376 loss = 3.5039 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3196 ntokens 1043909184 Example 129000 of 138376 loss = 3.5039 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3197 ntokens 1043944584 Example 129300 of 138376 loss = 3.5037 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3198 ntokens 1043979984 Example 129600 of 138376 loss = 3.5035 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3199 ntokens 1044015384 Example 129900 of 138376 loss = 3.5036 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3200 ntokens 1044050784 Example 130200 of 138376 loss = 3.5037 nll loss = 2.1255 accu = 0.3725

Training: Epoch 7 of 10 Step 3201 ntokens 1044086184 Example 130500 of 138376 loss = 3.5039 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3202 ntokens 1044121584 Example 130800 of 138376 loss = 3.5039 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3203 ntokens 1044156984 Example 131100 of 138376 loss = 3.5042 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3204 ntokens 1044192384 Example 131400 of 138376 loss = 3.5043 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3205 ntokens 1044227784 Example 131700 of 138376 loss = 3.5045 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3206 ntokens 1044263184 Example 132000 of 138376 loss = 3.5043 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3207 ntokens 1044298584 Example 132300 of 138376 loss = 3.5045 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3208 ntokens 1044333984 Example 132600 of 138376 loss = 3.5044 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3209 ntokens 1044369384 Example 132900 of 138376 loss = 3.5044 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3210 ntokens 1044404784 Example 133200 of 138376 loss = 3.5044 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3211 ntokens 1044440184 Example 133500 of 138376 loss = 3.5044 nll loss = 2.1260 accu = 0.3724

Training: Epoch 7 of 10 Step 3212 ntokens 1044475584 Example 133800 of 138376 loss = 3.5043 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3213 ntokens 1044510984 Example 134100 of 138376 loss = 3.5042 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3214 ntokens 1044546384 Example 134400 of 138376 loss = 3.5040 nll loss = 2.1257 accu = 0.3724

Training: Epoch 7 of 10 Step 3215 ntokens 1044581784 Example 134700 of 138376 loss = 3.5041 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3216 ntokens 1044617184 Example 135000 of 138376 loss = 3.5041 nll loss = 2.1259 accu = 0.3724

Training: Epoch 7 of 10 Step 3217 ntokens 1044652584 Example 135300 of 138376 loss = 3.5043 nll loss = 2.1258 accu = 0.3725

Training: Epoch 7 of 10 Step 3218 ntokens 1044687984 Example 135600 of 138376 loss = 3.5044 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3219 ntokens 1044723384 Example 135900 of 138376 loss = 3.5042 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3220 ntokens 1044758784 Example 136200 of 138376 loss = 3.5043 nll loss = 2.1258 accu = 0.3724

Training: Epoch 7 of 10 Step 3221 ntokens 1044794184 Example 136500 of 138376 loss = 3.5044 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3222 ntokens 1044829584 Example 136800 of 138376 loss = 3.5045 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3223 ntokens 1044864984 Example 137100 of 138376 loss = 3.5043 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3224 ntokens 1044900384 Example 137400 of 138376 loss = 3.5044 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3225 ntokens 1044935784 Example 137700 of 138376 loss = 3.5048 nll loss = 2.1254 accu = 0.3726

Training: Epoch 7 of 10 Step 3226 ntokens 1044971184 Example 138000 of 138376 loss = 3.5047 nll loss = 2.1256 accu = 0.3725

Training: Epoch 7 of 10 Step 3227 ntokens 1045006584 Example 138300 of 138376 loss = 3.5046 nll loss = 2.1257 accu = 0.3725

Training: Epoch 7 of 10 Step 3228 ntokens 1045015552 Example 138376 of 138376 loss = 3.5044 nll loss = 2.1257 accu = 0.3725

Writing to checkpoint at 2024-05-28 17:05:34.111331
Validating: Epoch 7 of 10 Step 0 ntokens 1045015552 Example 300 of 34323 loss = 3.6261 nll loss = 2.1102 accu = 0.3757

Validating: Epoch 7 of 10 Step 1 ntokens 1045015552 Example 600 of 34323 loss = 3.5920 nll loss = 2.1538 accu = 0.3616

Validating: Epoch 7 of 10 Step 2 ntokens 1045015552 Example 900 of 34323 loss = 3.5700 nll loss = 2.1225 accu = 0.3731

Validating: Epoch 7 of 10 Step 3 ntokens 1045015552 Example 1200 of 34323 loss = 3.5457 nll loss = 2.1207 accu = 0.3738

Validating: Epoch 7 of 10 Step 4 ntokens 1045015552 Example 1500 of 34323 loss = 3.5618 nll loss = 2.1277 accu = 0.3725

Validating: Epoch 7 of 10 Step 5 ntokens 1045015552 Example 1800 of 34323 loss = 3.5622 nll loss = 2.1375 accu = 0.3689

Validating: Epoch 7 of 10 Step 6 ntokens 1045015552 Example 2100 of 34323 loss = 3.5686 nll loss = 2.1444 accu = 0.3659

Validating: Epoch 7 of 10 Step 7 ntokens 1045015552 Example 2400 of 34323 loss = 3.5563 nll loss = 2.1396 accu = 0.3670

Validating: Epoch 7 of 10 Step 8 ntokens 1045015552 Example 2700 of 34323 loss = 3.5527 nll loss = 2.1508 accu = 0.3634

Validating: Epoch 7 of 10 Step 9 ntokens 1045015552 Example 3000 of 34323 loss = 3.5477 nll loss = 2.1504 accu = 0.3632

Validating: Epoch 7 of 10 Step 10 ntokens 1045015552 Example 3300 of 34323 loss = 3.5366 nll loss = 2.1456 accu = 0.3649

Validating: Epoch 7 of 10 Step 11 ntokens 1045015552 Example 3600 of 34323 loss = 3.5305 nll loss = 2.1434 accu = 0.3657

Validating: Epoch 7 of 10 Step 12 ntokens 1045015552 Example 3900 of 34323 loss = 3.5252 nll loss = 2.1446 accu = 0.3653

Validating: Epoch 7 of 10 Step 13 ntokens 1045015552 Example 4200 of 34323 loss = 3.5235 nll loss = 2.1459 accu = 0.3649

Validating: Epoch 7 of 10 Step 14 ntokens 1045015552 Example 4500 of 34323 loss = 3.5170 nll loss = 2.1419 accu = 0.3662

Validating: Epoch 7 of 10 Step 15 ntokens 1045015552 Example 4800 of 34323 loss = 3.5161 nll loss = 2.1384 accu = 0.3677

Validating: Epoch 7 of 10 Step 16 ntokens 1045015552 Example 5100 of 34323 loss = 3.5130 nll loss = 2.1363 accu = 0.3685

Validating: Epoch 7 of 10 Step 17 ntokens 1045015552 Example 5400 of 34323 loss = 3.5125 nll loss = 2.1360 accu = 0.3686

Validating: Epoch 7 of 10 Step 18 ntokens 1045015552 Example 5700 of 34323 loss = 3.5153 nll loss = 2.1360 accu = 0.3688

Validating: Epoch 7 of 10 Step 19 ntokens 1045015552 Example 6000 of 34323 loss = 3.5128 nll loss = 2.1334 accu = 0.3696

Validating: Epoch 7 of 10 Step 20 ntokens 1045015552 Example 6300 of 34323 loss = 3.5097 nll loss = 2.1301 accu = 0.3705

Validating: Epoch 7 of 10 Step 21 ntokens 1045015552 Example 6600 of 34323 loss = 3.5107 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 7 of 10 Step 22 ntokens 1045015552 Example 6900 of 34323 loss = 3.5097 nll loss = 2.1218 accu = 0.3733

Validating: Epoch 7 of 10 Step 23 ntokens 1045015552 Example 7200 of 34323 loss = 3.5096 nll loss = 2.1278 accu = 0.3712

Validating: Epoch 7 of 10 Step 24 ntokens 1045015552 Example 7500 of 34323 loss = 3.5081 nll loss = 2.1299 accu = 0.3704

Validating: Epoch 7 of 10 Step 25 ntokens 1045015552 Example 7800 of 34323 loss = 3.5129 nll loss = 2.1292 accu = 0.3708

Validating: Epoch 7 of 10 Step 26 ntokens 1045015552 Example 8100 of 34323 loss = 3.5137 nll loss = 2.1304 accu = 0.3703

Validating: Epoch 7 of 10 Step 27 ntokens 1045015552 Example 8400 of 34323 loss = 3.5115 nll loss = 2.1296 accu = 0.3706

Validating: Epoch 7 of 10 Step 28 ntokens 1045015552 Example 8700 of 34323 loss = 3.5103 nll loss = 2.1262 accu = 0.3716

Validating: Epoch 7 of 10 Step 29 ntokens 1045015552 Example 9000 of 34323 loss = 3.5111 nll loss = 2.1264 accu = 0.3716

Validating: Epoch 7 of 10 Step 30 ntokens 1045015552 Example 9300 of 34323 loss = 3.5127 nll loss = 2.1251 accu = 0.3720

Validating: Epoch 7 of 10 Step 31 ntokens 1045015552 Example 9600 of 34323 loss = 3.5101 nll loss = 2.1237 accu = 0.3725

Validating: Epoch 7 of 10 Step 32 ntokens 1045015552 Example 9900 of 34323 loss = 3.5073 nll loss = 2.1226 accu = 0.3729

Validating: Epoch 7 of 10 Step 33 ntokens 1045015552 Example 10200 of 34323 loss = 3.5075 nll loss = 2.1233 accu = 0.3727

Validating: Epoch 7 of 10 Step 34 ntokens 1045015552 Example 10500 of 34323 loss = 3.5048 nll loss = 2.1223 accu = 0.3731

Validating: Epoch 7 of 10 Step 35 ntokens 1045015552 Example 10800 of 34323 loss = 3.5063 nll loss = 2.1215 accu = 0.3733

Validating: Epoch 7 of 10 Step 36 ntokens 1045015552 Example 11100 of 34323 loss = 3.5071 nll loss = 2.1191 accu = 0.3741

Validating: Epoch 7 of 10 Step 37 ntokens 1045015552 Example 11400 of 34323 loss = 3.5085 nll loss = 2.1165 accu = 0.3751

Validating: Epoch 7 of 10 Step 38 ntokens 1045015552 Example 11700 of 34323 loss = 3.5075 nll loss = 2.1185 accu = 0.3744

Validating: Epoch 7 of 10 Step 39 ntokens 1045015552 Example 12000 of 34323 loss = 3.5059 nll loss = 2.1183 accu = 0.3745

Validating: Epoch 7 of 10 Step 40 ntokens 1045015552 Example 12300 of 34323 loss = 3.5070 nll loss = 2.1188 accu = 0.3743

Validating: Epoch 7 of 10 Step 41 ntokens 1045015552 Example 12600 of 34323 loss = 3.5064 nll loss = 2.1205 accu = 0.3736

Validating: Epoch 7 of 10 Step 42 ntokens 1045015552 Example 12900 of 34323 loss = 3.5034 nll loss = 2.1198 accu = 0.3738

Validating: Epoch 7 of 10 Step 43 ntokens 1045015552 Example 13200 of 34323 loss = 3.5055 nll loss = 2.1207 accu = 0.3735

Validating: Epoch 7 of 10 Step 44 ntokens 1045015552 Example 13500 of 34323 loss = 3.5040 nll loss = 2.1208 accu = 0.3735

Validating: Epoch 7 of 10 Step 45 ntokens 1045015552 Example 13800 of 34323 loss = 3.5031 nll loss = 2.1224 accu = 0.3729

Validating: Epoch 7 of 10 Step 46 ntokens 1045015552 Example 14100 of 34323 loss = 3.5018 nll loss = 2.1216 accu = 0.3733

Validating: Epoch 7 of 10 Step 47 ntokens 1045015552 Example 14400 of 34323 loss = 3.5016 nll loss = 2.1223 accu = 0.3730

Validating: Epoch 7 of 10 Step 48 ntokens 1045015552 Example 14700 of 34323 loss = 3.5020 nll loss = 2.1217 accu = 0.3733

Validating: Epoch 7 of 10 Step 49 ntokens 1045015552 Example 15000 of 34323 loss = 3.5019 nll loss = 2.1221 accu = 0.3732

Validating: Epoch 7 of 10 Step 50 ntokens 1045015552 Example 15300 of 34323 loss = 3.5020 nll loss = 2.1219 accu = 0.3734

Validating: Epoch 7 of 10 Step 51 ntokens 1045015552 Example 15600 of 34323 loss = 3.5006 nll loss = 2.1221 accu = 0.3733

Validating: Epoch 7 of 10 Step 52 ntokens 1045015552 Example 15900 of 34323 loss = 3.4999 nll loss = 2.1214 accu = 0.3735

Validating: Epoch 7 of 10 Step 53 ntokens 1045015552 Example 16200 of 34323 loss = 3.4981 nll loss = 2.1218 accu = 0.3734

Validating: Epoch 7 of 10 Step 54 ntokens 1045015552 Example 16500 of 34323 loss = 3.4978 nll loss = 2.1213 accu = 0.3736

Validating: Epoch 7 of 10 Step 55 ntokens 1045015552 Example 16800 of 34323 loss = 3.4978 nll loss = 2.1210 accu = 0.3737

Validating: Epoch 7 of 10 Step 56 ntokens 1045015552 Example 17100 of 34323 loss = 3.4959 nll loss = 2.1207 accu = 0.3737

Validating: Epoch 7 of 10 Step 57 ntokens 1045015552 Example 17400 of 34323 loss = 3.4934 nll loss = 2.1225 accu = 0.3731

Validating: Epoch 7 of 10 Step 58 ntokens 1045015552 Example 17700 of 34323 loss = 3.4927 nll loss = 2.1217 accu = 0.3734

Validating: Epoch 7 of 10 Step 59 ntokens 1045015552 Example 18000 of 34323 loss = 3.4916 nll loss = 2.1212 accu = 0.3736

Validating: Epoch 7 of 10 Step 60 ntokens 1045015552 Example 18300 of 34323 loss = 3.4912 nll loss = 2.1219 accu = 0.3734

Validating: Epoch 7 of 10 Step 61 ntokens 1045015552 Example 18600 of 34323 loss = 3.4911 nll loss = 2.1206 accu = 0.3738

Validating: Epoch 7 of 10 Step 62 ntokens 1045015552 Example 18900 of 34323 loss = 3.4921 nll loss = 2.1206 accu = 0.3738

Validating: Epoch 7 of 10 Step 63 ntokens 1045015552 Example 19200 of 34323 loss = 3.4910 nll loss = 2.1206 accu = 0.3737

Validating: Epoch 7 of 10 Step 64 ntokens 1045015552 Example 19500 of 34323 loss = 3.4933 nll loss = 2.1208 accu = 0.3736

Validating: Epoch 7 of 10 Step 65 ntokens 1045015552 Example 19800 of 34323 loss = 3.4942 nll loss = 2.1223 accu = 0.3731

Validating: Epoch 7 of 10 Step 66 ntokens 1045015552 Example 20100 of 34323 loss = 3.4941 nll loss = 2.1227 accu = 0.3730

Validating: Epoch 7 of 10 Step 67 ntokens 1045015552 Example 20400 of 34323 loss = 3.4940 nll loss = 2.1222 accu = 0.3731

Validating: Epoch 7 of 10 Step 68 ntokens 1045015552 Example 20700 of 34323 loss = 3.4940 nll loss = 2.1219 accu = 0.3732

Validating: Epoch 7 of 10 Step 69 ntokens 1045015552 Example 21000 of 34323 loss = 3.4940 nll loss = 2.1221 accu = 0.3731

Validating: Epoch 7 of 10 Step 70 ntokens 1045015552 Example 21300 of 34323 loss = 3.4951 nll loss = 2.1238 accu = 0.3726

Validating: Epoch 7 of 10 Step 71 ntokens 1045015552 Example 21600 of 34323 loss = 3.4932 nll loss = 2.1225 accu = 0.3730

Validating: Epoch 7 of 10 Step 72 ntokens 1045015552 Example 21900 of 34323 loss = 3.4930 nll loss = 2.1228 accu = 0.3729

Validating: Epoch 7 of 10 Step 73 ntokens 1045015552 Example 22200 of 34323 loss = 3.4928 nll loss = 2.1230 accu = 0.3728

Validating: Epoch 7 of 10 Step 74 ntokens 1045015552 Example 22500 of 34323 loss = 3.4933 nll loss = 2.1224 accu = 0.3730

Validating: Epoch 7 of 10 Step 75 ntokens 1045015552 Example 22800 of 34323 loss = 3.4950 nll loss = 2.1233 accu = 0.3727

Validating: Epoch 7 of 10 Step 76 ntokens 1045015552 Example 23100 of 34323 loss = 3.4958 nll loss = 2.1229 accu = 0.3728

Validating: Epoch 7 of 10 Step 77 ntokens 1045015552 Example 23400 of 34323 loss = 3.4951 nll loss = 2.1237 accu = 0.3726

Validating: Epoch 7 of 10 Step 78 ntokens 1045015552 Example 23700 of 34323 loss = 3.4943 nll loss = 2.1239 accu = 0.3725

Validating: Epoch 7 of 10 Step 79 ntokens 1045015552 Example 24000 of 34323 loss = 3.4965 nll loss = 2.1232 accu = 0.3728

Validating: Epoch 7 of 10 Step 80 ntokens 1045015552 Example 24300 of 34323 loss = 3.4960 nll loss = 2.1232 accu = 0.3728

Validating: Epoch 7 of 10 Step 81 ntokens 1045015552 Example 24600 of 34323 loss = 3.4951 nll loss = 2.1227 accu = 0.3730

Validating: Epoch 7 of 10 Step 82 ntokens 1045015552 Example 24900 of 34323 loss = 3.4939 nll loss = 2.1226 accu = 0.3730

Validating: Epoch 7 of 10 Step 83 ntokens 1045015552 Example 25200 of 34323 loss = 3.4925 nll loss = 2.1222 accu = 0.3732

Validating: Epoch 7 of 10 Step 84 ntokens 1045015552 Example 25500 of 34323 loss = 3.4925 nll loss = 2.1220 accu = 0.3732

Validating: Epoch 7 of 10 Step 85 ntokens 1045015552 Example 25800 of 34323 loss = 3.4921 nll loss = 2.1226 accu = 0.3730

Validating: Epoch 7 of 10 Step 86 ntokens 1045015552 Example 26100 of 34323 loss = 3.4925 nll loss = 2.1231 accu = 0.3728

Validating: Epoch 7 of 10 Step 87 ntokens 1045015552 Example 26400 of 34323 loss = 3.4922 nll loss = 2.1237 accu = 0.3726

Validating: Epoch 7 of 10 Step 88 ntokens 1045015552 Example 26700 of 34323 loss = 3.4925 nll loss = 2.1239 accu = 0.3726

Validating: Epoch 7 of 10 Step 89 ntokens 1045015552 Example 27000 of 34323 loss = 3.4918 nll loss = 2.1252 accu = 0.3721

Validating: Epoch 7 of 10 Step 90 ntokens 1045015552 Example 27300 of 34323 loss = 3.4919 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 7 of 10 Step 91 ntokens 1045015552 Example 27600 of 34323 loss = 3.4918 nll loss = 2.1243 accu = 0.3724

Validating: Epoch 7 of 10 Step 92 ntokens 1045015552 Example 27900 of 34323 loss = 3.4921 nll loss = 2.1247 accu = 0.3723

Validating: Epoch 7 of 10 Step 93 ntokens 1045015552 Example 28200 of 34323 loss = 3.4909 nll loss = 2.1248 accu = 0.3722

Validating: Epoch 7 of 10 Step 94 ntokens 1045015552 Example 28500 of 34323 loss = 3.4910 nll loss = 2.1248 accu = 0.3722

Validating: Epoch 7 of 10 Step 95 ntokens 1045015552 Example 28800 of 34323 loss = 3.4919 nll loss = 2.1260 accu = 0.3718

Validating: Epoch 7 of 10 Step 96 ntokens 1045015552 Example 29100 of 34323 loss = 3.4915 nll loss = 2.1266 accu = 0.3716

Validating: Epoch 7 of 10 Step 97 ntokens 1045015552 Example 29400 of 34323 loss = 3.4915 nll loss = 2.1268 accu = 0.3715

Validating: Epoch 7 of 10 Step 98 ntokens 1045015552 Example 29700 of 34323 loss = 3.4915 nll loss = 2.1265 accu = 0.3716

Validating: Epoch 7 of 10 Step 99 ntokens 1045015552 Example 30000 of 34323 loss = 3.4922 nll loss = 2.1257 accu = 0.3719

Validating: Epoch 7 of 10 Step 100 ntokens 1045015552 Example 30300 of 34323 loss = 3.4909 nll loss = 2.1257 accu = 0.3719

Validating: Epoch 7 of 10 Step 101 ntokens 1045015552 Example 30600 of 34323 loss = 3.4902 nll loss = 2.1258 accu = 0.3718

Validating: Epoch 7 of 10 Step 102 ntokens 1045015552 Example 30900 of 34323 loss = 3.4892 nll loss = 2.1254 accu = 0.3720

Validating: Epoch 7 of 10 Step 103 ntokens 1045015552 Example 31200 of 34323 loss = 3.4890 nll loss = 2.1246 accu = 0.3723

Validating: Epoch 7 of 10 Step 104 ntokens 1045015552 Example 31500 of 34323 loss = 3.4891 nll loss = 2.1251 accu = 0.3721

Validating: Epoch 7 of 10 Step 105 ntokens 1045015552 Example 31800 of 34323 loss = 3.4878 nll loss = 2.1250 accu = 0.3721

Validating: Epoch 7 of 10 Step 106 ntokens 1045015552 Example 32100 of 34323 loss = 3.4881 nll loss = 2.1255 accu = 0.3719

Validating: Epoch 7 of 10 Step 107 ntokens 1045015552 Example 32400 of 34323 loss = 3.4881 nll loss = 2.1259 accu = 0.3718

Validating: Epoch 7 of 10 Step 108 ntokens 1045015552 Example 32700 of 34323 loss = 3.4890 nll loss = 2.1265 accu = 0.3716

Validating: Epoch 7 of 10 Step 109 ntokens 1045015552 Example 33000 of 34323 loss = 3.4898 nll loss = 2.1266 accu = 0.3715

Validating: Epoch 7 of 10 Step 110 ntokens 1045015552 Example 33300 of 34323 loss = 3.4897 nll loss = 2.1266 accu = 0.3715

Validating: Epoch 7 of 10 Step 111 ntokens 1045015552 Example 33600 of 34323 loss = 3.4891 nll loss = 2.1271 accu = 0.3713

Validating: Epoch 7 of 10 Step 112 ntokens 1045015552 Example 33900 of 34323 loss = 3.4884 nll loss = 2.1275 accu = 0.3712

Validating: Epoch 7 of 10 Step 113 ntokens 1045015552 Example 34200 of 34323 loss = 3.4886 nll loss = 2.1276 accu = 0.3712

Validating: Epoch 7 of 10 Step 114 ntokens 1045015552 Example 34323 of 34323 loss = 3.4885 nll loss = 2.1274 accu = 0.3712

Validation complete in 0:00:15.057347
Epoch complete in 0:02:30.335781
Training: Epoch 8 of 10 Step 3228 ntokens 2073738136 Example 300 of 138376 loss = 3.4649 nll loss = 2.1426 accu = 0.3693

Training: Epoch 8 of 10 Step 3229 ntokens 2073773536 Example 600 of 138376 loss = 3.4810 nll loss = 2.1185 accu = 0.3757

Training: Epoch 8 of 10 Step 3230 ntokens 2073808936 Example 900 of 138376 loss = 3.4614 nll loss = 2.1165 accu = 0.3754

Training: Epoch 8 of 10 Step 3231 ntokens 2073844336 Example 1200 of 138376 loss = 3.4695 nll loss = 2.1135 accu = 0.3763

Training: Epoch 8 of 10 Step 3232 ntokens 2073879736 Example 1500 of 138376 loss = 3.4806 nll loss = 2.1117 accu = 0.3774

Training: Epoch 8 of 10 Step 3233 ntokens 2073915136 Example 1800 of 138376 loss = 3.4976 nll loss = 2.1263 accu = 0.3724

Training: Epoch 8 of 10 Step 3234 ntokens 2073950536 Example 2100 of 138376 loss = 3.4964 nll loss = 2.1160 accu = 0.3758

Training: Epoch 8 of 10 Step 3235 ntokens 2073985936 Example 2400 of 138376 loss = 3.4872 nll loss = 2.1179 accu = 0.3750

Training: Epoch 8 of 10 Step 3236 ntokens 2074021336 Example 2700 of 138376 loss = 3.4964 nll loss = 2.1068 accu = 0.3789

Training: Epoch 8 of 10 Step 3237 ntokens 2074056736 Example 3000 of 138376 loss = 3.5055 nll loss = 2.1108 accu = 0.3771

Training: Epoch 8 of 10 Step 3238 ntokens 2074092136 Example 3300 of 138376 loss = 3.5109 nll loss = 2.1133 accu = 0.3762

Training: Epoch 8 of 10 Step 3239 ntokens 2074127536 Example 3600 of 138376 loss = 3.5156 nll loss = 2.1142 accu = 0.3755

Training: Epoch 8 of 10 Step 3240 ntokens 2074162936 Example 3900 of 138376 loss = 3.5193 nll loss = 2.1118 accu = 0.3765

Training: Epoch 8 of 10 Step 3241 ntokens 2074198336 Example 4200 of 138376 loss = 3.5190 nll loss = 2.1114 accu = 0.3769

Training: Epoch 8 of 10 Step 3242 ntokens 2074233736 Example 4500 of 138376 loss = 3.5211 nll loss = 2.1138 accu = 0.3764

Training: Epoch 8 of 10 Step 3243 ntokens 2074269136 Example 4800 of 138376 loss = 3.5163 nll loss = 2.1184 accu = 0.3749

Training: Epoch 8 of 10 Step 3244 ntokens 2074304536 Example 5100 of 138376 loss = 3.5153 nll loss = 2.1172 accu = 0.3754

Training: Epoch 8 of 10 Step 3245 ntokens 2074339936 Example 5400 of 138376 loss = 3.5160 nll loss = 2.1172 accu = 0.3755

Training: Epoch 8 of 10 Step 3246 ntokens 2074375336 Example 5700 of 138376 loss = 3.5150 nll loss = 2.1191 accu = 0.3749

Training: Epoch 8 of 10 Step 3247 ntokens 2074410736 Example 6000 of 138376 loss = 3.5134 nll loss = 2.1179 accu = 0.3754

Training: Epoch 8 of 10 Step 3248 ntokens 2074446136 Example 6300 of 138376 loss = 3.5128 nll loss = 2.1196 accu = 0.3746

Training: Epoch 8 of 10 Step 3249 ntokens 2074481536 Example 6600 of 138376 loss = 3.5121 nll loss = 2.1152 accu = 0.3762

Training: Epoch 8 of 10 Step 3250 ntokens 2074516936 Example 6900 of 138376 loss = 3.5079 nll loss = 2.1167 accu = 0.3756

Training: Epoch 8 of 10 Step 3251 ntokens 2074552336 Example 7200 of 138376 loss = 3.5072 nll loss = 2.1133 accu = 0.3768

Training: Epoch 8 of 10 Step 3252 ntokens 2074587736 Example 7500 of 138376 loss = 3.5005 nll loss = 2.1127 accu = 0.3769

Training: Epoch 8 of 10 Step 3253 ntokens 2074623136 Example 7800 of 138376 loss = 3.5026 nll loss = 2.1135 accu = 0.3765

Training: Epoch 8 of 10 Step 3254 ntokens 2074658536 Example 8100 of 138376 loss = 3.5003 nll loss = 2.1146 accu = 0.3763

Training: Epoch 8 of 10 Step 3255 ntokens 2074693936 Example 8400 of 138376 loss = 3.5016 nll loss = 2.1181 accu = 0.3750

Training: Epoch 8 of 10 Step 3256 ntokens 2074729336 Example 8700 of 138376 loss = 3.4988 nll loss = 2.1169 accu = 0.3755

Training: Epoch 8 of 10 Step 3257 ntokens 2074764736 Example 9000 of 138376 loss = 3.4986 nll loss = 2.1165 accu = 0.3756

Training: Epoch 8 of 10 Step 3258 ntokens 2074800136 Example 9300 of 138376 loss = 3.4971 nll loss = 2.1164 accu = 0.3755

Training: Epoch 8 of 10 Step 3259 ntokens 2074835536 Example 9600 of 138376 loss = 3.4961 nll loss = 2.1183 accu = 0.3748

Training: Epoch 8 of 10 Step 3260 ntokens 2074870936 Example 9900 of 138376 loss = 3.4964 nll loss = 2.1197 accu = 0.3744

Training: Epoch 8 of 10 Step 3261 ntokens 2074906336 Example 10200 of 138376 loss = 3.4960 nll loss = 2.1184 accu = 0.3748

Training: Epoch 8 of 10 Step 3262 ntokens 2074941736 Example 10500 of 138376 loss = 3.4998 nll loss = 2.1179 accu = 0.3750

Training: Epoch 8 of 10 Step 3263 ntokens 2074977136 Example 10800 of 138376 loss = 3.4993 nll loss = 2.1179 accu = 0.3750

Training: Epoch 8 of 10 Step 3264 ntokens 2075012536 Example 11100 of 138376 loss = 3.5000 nll loss = 2.1191 accu = 0.3746

Training: Epoch 8 of 10 Step 3265 ntokens 2075047936 Example 11400 of 138376 loss = 3.5008 nll loss = 2.1184 accu = 0.3748

Training: Epoch 8 of 10 Step 3266 ntokens 2075083336 Example 11700 of 138376 loss = 3.4989 nll loss = 2.1180 accu = 0.3749

Training: Epoch 8 of 10 Step 3267 ntokens 2075118736 Example 12000 of 138376 loss = 3.4997 nll loss = 2.1196 accu = 0.3744

Training: Epoch 8 of 10 Step 3268 ntokens 2075154136 Example 12300 of 138376 loss = 3.5016 nll loss = 2.1208 accu = 0.3739

Training: Epoch 8 of 10 Step 3269 ntokens 2075189536 Example 12600 of 138376 loss = 3.5021 nll loss = 2.1216 accu = 0.3737

Training: Epoch 8 of 10 Step 3270 ntokens 2075224936 Example 12900 of 138376 loss = 3.5021 nll loss = 2.1213 accu = 0.3738

Training: Epoch 8 of 10 Step 3271 ntokens 2075260336 Example 13200 of 138376 loss = 3.5008 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3272 ntokens 2075295736 Example 13500 of 138376 loss = 3.5001 nll loss = 2.1230 accu = 0.3732

Training: Epoch 8 of 10 Step 3273 ntokens 2075331136 Example 13800 of 138376 loss = 3.5020 nll loss = 2.1225 accu = 0.3733

Training: Epoch 8 of 10 Step 3274 ntokens 2075366536 Example 14100 of 138376 loss = 3.5003 nll loss = 2.1218 accu = 0.3736

Training: Epoch 8 of 10 Step 3275 ntokens 2075401936 Example 14400 of 138376 loss = 3.5008 nll loss = 2.1220 accu = 0.3735

Training: Epoch 8 of 10 Step 3276 ntokens 2075437336 Example 14700 of 138376 loss = 3.5025 nll loss = 2.1232 accu = 0.3731

Training: Epoch 8 of 10 Step 3277 ntokens 2075472736 Example 15000 of 138376 loss = 3.5036 nll loss = 2.1237 accu = 0.3729

Training: Epoch 8 of 10 Step 3278 ntokens 2075508136 Example 15300 of 138376 loss = 3.5043 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3279 ntokens 2075543536 Example 15600 of 138376 loss = 3.5062 nll loss = 2.1246 accu = 0.3728

Training: Epoch 8 of 10 Step 3280 ntokens 2075578936 Example 15900 of 138376 loss = 3.5060 nll loss = 2.1247 accu = 0.3728

Training: Epoch 8 of 10 Step 3281 ntokens 2075614336 Example 16200 of 138376 loss = 3.5063 nll loss = 2.1252 accu = 0.3726

Training: Epoch 8 of 10 Step 3282 ntokens 2075649736 Example 16500 of 138376 loss = 3.5075 nll loss = 2.1251 accu = 0.3727

Training: Epoch 8 of 10 Step 3283 ntokens 2075685136 Example 16800 of 138376 loss = 3.5059 nll loss = 2.1257 accu = 0.3724

Training: Epoch 8 of 10 Step 3284 ntokens 2075720536 Example 17100 of 138376 loss = 3.5050 nll loss = 2.1246 accu = 0.3728

Training: Epoch 8 of 10 Step 3285 ntokens 2075755936 Example 17400 of 138376 loss = 3.5048 nll loss = 2.1253 accu = 0.3726

Training: Epoch 8 of 10 Step 3286 ntokens 2075791336 Example 17700 of 138376 loss = 3.5050 nll loss = 2.1253 accu = 0.3726

Training: Epoch 8 of 10 Step 3287 ntokens 2075826736 Example 18000 of 138376 loss = 3.5044 nll loss = 2.1243 accu = 0.3730

Training: Epoch 8 of 10 Step 3288 ntokens 2075862136 Example 18300 of 138376 loss = 3.5027 nll loss = 2.1250 accu = 0.3727

Training: Epoch 8 of 10 Step 3289 ntokens 2075897536 Example 18600 of 138376 loss = 3.5027 nll loss = 2.1252 accu = 0.3726

Training: Epoch 8 of 10 Step 3290 ntokens 2075932936 Example 18900 of 138376 loss = 3.5031 nll loss = 2.1240 accu = 0.3730

Training: Epoch 8 of 10 Step 3291 ntokens 2075968336 Example 19200 of 138376 loss = 3.5023 nll loss = 2.1247 accu = 0.3727

Training: Epoch 8 of 10 Step 3292 ntokens 2076003736 Example 19500 of 138376 loss = 3.5013 nll loss = 2.1242 accu = 0.3729

Training: Epoch 8 of 10 Step 3293 ntokens 2076039136 Example 19800 of 138376 loss = 3.5007 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3294 ntokens 2076074536 Example 20100 of 138376 loss = 3.5010 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3295 ntokens 2076109936 Example 20400 of 138376 loss = 3.5002 nll loss = 2.1225 accu = 0.3735

Training: Epoch 8 of 10 Step 3296 ntokens 2076145336 Example 20700 of 138376 loss = 3.5004 nll loss = 2.1223 accu = 0.3735

Training: Epoch 8 of 10 Step 3297 ntokens 2076180736 Example 21000 of 138376 loss = 3.5002 nll loss = 2.1222 accu = 0.3736

Training: Epoch 8 of 10 Step 3298 ntokens 2076216136 Example 21300 of 138376 loss = 3.4990 nll loss = 2.1228 accu = 0.3733

Training: Epoch 8 of 10 Step 3299 ntokens 2076251536 Example 21600 of 138376 loss = 3.4994 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3300 ntokens 2076286936 Example 21900 of 138376 loss = 3.4995 nll loss = 2.1234 accu = 0.3731

Training: Epoch 8 of 10 Step 3301 ntokens 2076322336 Example 22200 of 138376 loss = 3.4974 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3302 ntokens 2076357736 Example 22500 of 138376 loss = 3.4975 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3303 ntokens 2076393136 Example 22800 of 138376 loss = 3.4964 nll loss = 2.1231 accu = 0.3732

Training: Epoch 8 of 10 Step 3304 ntokens 2076428536 Example 23100 of 138376 loss = 3.4965 nll loss = 2.1230 accu = 0.3732

Training: Epoch 8 of 10 Step 3305 ntokens 2076463936 Example 23400 of 138376 loss = 3.4972 nll loss = 2.1230 accu = 0.3732

Training: Epoch 8 of 10 Step 3306 ntokens 2076499336 Example 23700 of 138376 loss = 3.4962 nll loss = 2.1223 accu = 0.3734

Training: Epoch 8 of 10 Step 3307 ntokens 2076534736 Example 24000 of 138376 loss = 3.4955 nll loss = 2.1230 accu = 0.3732

Training: Epoch 8 of 10 Step 3308 ntokens 2076570136 Example 24300 of 138376 loss = 3.4959 nll loss = 2.1230 accu = 0.3732

Training: Epoch 8 of 10 Step 3309 ntokens 2076605536 Example 24600 of 138376 loss = 3.4963 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3310 ntokens 2076640936 Example 24900 of 138376 loss = 3.4960 nll loss = 2.1246 accu = 0.3726

Training: Epoch 8 of 10 Step 3311 ntokens 2076676336 Example 25200 of 138376 loss = 3.4977 nll loss = 2.1250 accu = 0.3724

Training: Epoch 8 of 10 Step 3312 ntokens 2076711736 Example 25500 of 138376 loss = 3.4987 nll loss = 2.1255 accu = 0.3723

Training: Epoch 8 of 10 Step 3313 ntokens 2076747136 Example 25800 of 138376 loss = 3.4996 nll loss = 2.1270 accu = 0.3718

Training: Epoch 8 of 10 Step 3314 ntokens 2076782536 Example 26100 of 138376 loss = 3.4984 nll loss = 2.1266 accu = 0.3719

Training: Epoch 8 of 10 Step 3315 ntokens 2076817936 Example 26400 of 138376 loss = 3.4995 nll loss = 2.1276 accu = 0.3715

Training: Epoch 8 of 10 Step 3316 ntokens 2076853336 Example 26700 of 138376 loss = 3.4994 nll loss = 2.1281 accu = 0.3714

Training: Epoch 8 of 10 Step 3317 ntokens 2076888736 Example 27000 of 138376 loss = 3.4994 nll loss = 2.1273 accu = 0.3716

Training: Epoch 8 of 10 Step 3318 ntokens 2076924136 Example 27300 of 138376 loss = 3.4984 nll loss = 2.1273 accu = 0.3716

Training: Epoch 8 of 10 Step 3319 ntokens 2076959536 Example 27600 of 138376 loss = 3.4993 nll loss = 2.1277 accu = 0.3715

Training: Epoch 8 of 10 Step 3320 ntokens 2076994936 Example 27900 of 138376 loss = 3.4990 nll loss = 2.1270 accu = 0.3718

Training: Epoch 8 of 10 Step 3321 ntokens 2077030336 Example 28200 of 138376 loss = 3.4986 nll loss = 2.1260 accu = 0.3722

Training: Epoch 8 of 10 Step 3322 ntokens 2077065736 Example 28500 of 138376 loss = 3.4978 nll loss = 2.1259 accu = 0.3722

Training: Epoch 8 of 10 Step 3323 ntokens 2077101136 Example 28800 of 138376 loss = 3.4972 nll loss = 2.1257 accu = 0.3722

Training: Epoch 8 of 10 Step 3324 ntokens 2077136536 Example 29100 of 138376 loss = 3.4962 nll loss = 2.1263 accu = 0.3720

Training: Epoch 8 of 10 Step 3325 ntokens 2077171936 Example 29400 of 138376 loss = 3.4960 nll loss = 2.1259 accu = 0.3722

Training: Epoch 8 of 10 Step 3326 ntokens 2077207336 Example 29700 of 138376 loss = 3.4966 nll loss = 2.1253 accu = 0.3724

Training: Epoch 8 of 10 Step 3327 ntokens 2077242736 Example 30000 of 138376 loss = 3.4970 nll loss = 2.1257 accu = 0.3722

Training: Epoch 8 of 10 Step 3328 ntokens 2077278136 Example 30300 of 138376 loss = 3.4961 nll loss = 2.1256 accu = 0.3723

Training: Epoch 8 of 10 Step 3329 ntokens 2077313536 Example 30600 of 138376 loss = 3.4948 nll loss = 2.1258 accu = 0.3722

Training: Epoch 8 of 10 Step 3330 ntokens 2077348936 Example 30900 of 138376 loss = 3.4958 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3331 ntokens 2077384336 Example 31200 of 138376 loss = 3.4958 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3332 ntokens 2077419736 Example 31500 of 138376 loss = 3.4965 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3333 ntokens 2077455136 Example 31800 of 138376 loss = 3.4962 nll loss = 2.1244 accu = 0.3727

Training: Epoch 8 of 10 Step 3334 ntokens 2077490536 Example 32100 of 138376 loss = 3.4970 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3335 ntokens 2077525936 Example 32400 of 138376 loss = 3.4975 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3336 ntokens 2077561336 Example 32700 of 138376 loss = 3.4971 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3337 ntokens 2077596736 Example 33000 of 138376 loss = 3.4968 nll loss = 2.1247 accu = 0.3726

Training: Epoch 8 of 10 Step 3338 ntokens 2077632136 Example 33300 of 138376 loss = 3.4966 nll loss = 2.1250 accu = 0.3725

Training: Epoch 8 of 10 Step 3339 ntokens 2077667536 Example 33600 of 138376 loss = 3.4976 nll loss = 2.1252 accu = 0.3725

Training: Epoch 8 of 10 Step 3340 ntokens 2077702936 Example 33900 of 138376 loss = 3.4975 nll loss = 2.1250 accu = 0.3725

Training: Epoch 8 of 10 Step 3341 ntokens 2077738336 Example 34200 of 138376 loss = 3.4974 nll loss = 2.1255 accu = 0.3724

Training: Epoch 8 of 10 Step 3342 ntokens 2077773736 Example 34500 of 138376 loss = 3.4964 nll loss = 2.1254 accu = 0.3724

Training: Epoch 8 of 10 Step 3343 ntokens 2077809136 Example 34800 of 138376 loss = 3.4958 nll loss = 2.1257 accu = 0.3723

Training: Epoch 8 of 10 Step 3344 ntokens 2077844536 Example 35100 of 138376 loss = 3.4956 nll loss = 2.1261 accu = 0.3721

Training: Epoch 8 of 10 Step 3345 ntokens 2077879936 Example 35400 of 138376 loss = 3.4958 nll loss = 2.1264 accu = 0.3721

Training: Epoch 8 of 10 Step 3346 ntokens 2077915336 Example 35700 of 138376 loss = 3.4953 nll loss = 2.1256 accu = 0.3723

Training: Epoch 8 of 10 Step 3347 ntokens 2077950736 Example 36000 of 138376 loss = 3.4951 nll loss = 2.1247 accu = 0.3726

Training: Epoch 8 of 10 Step 3348 ntokens 2077986136 Example 36300 of 138376 loss = 3.4951 nll loss = 2.1247 accu = 0.3726

Training: Epoch 8 of 10 Step 3349 ntokens 2078021536 Example 36600 of 138376 loss = 3.4953 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3350 ntokens 2078056936 Example 36900 of 138376 loss = 3.4947 nll loss = 2.1244 accu = 0.3728

Training: Epoch 8 of 10 Step 3351 ntokens 2078092336 Example 37200 of 138376 loss = 3.4942 nll loss = 2.1247 accu = 0.3727

Training: Epoch 8 of 10 Step 3352 ntokens 2078127736 Example 37500 of 138376 loss = 3.4945 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3353 ntokens 2078163136 Example 37800 of 138376 loss = 3.4942 nll loss = 2.1247 accu = 0.3727

Training: Epoch 8 of 10 Step 3354 ntokens 2078198536 Example 38100 of 138376 loss = 3.4941 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3355 ntokens 2078233936 Example 38400 of 138376 loss = 3.4941 nll loss = 2.1251 accu = 0.3725

Training: Epoch 8 of 10 Step 3356 ntokens 2078269336 Example 38700 of 138376 loss = 3.4947 nll loss = 2.1255 accu = 0.3724

Training: Epoch 8 of 10 Step 3357 ntokens 2078304736 Example 39000 of 138376 loss = 3.4941 nll loss = 2.1258 accu = 0.3723

Training: Epoch 8 of 10 Step 3358 ntokens 2078340136 Example 39300 of 138376 loss = 3.4951 nll loss = 2.1258 accu = 0.3723

Training: Epoch 8 of 10 Step 3359 ntokens 2078375536 Example 39600 of 138376 loss = 3.4946 nll loss = 2.1262 accu = 0.3722

Training: Epoch 8 of 10 Step 3360 ntokens 2078410936 Example 39900 of 138376 loss = 3.4952 nll loss = 2.1265 accu = 0.3721

Training: Epoch 8 of 10 Step 3361 ntokens 2078446336 Example 40200 of 138376 loss = 3.4942 nll loss = 2.1263 accu = 0.3722

Training: Epoch 8 of 10 Step 3362 ntokens 2078481736 Example 40500 of 138376 loss = 3.4944 nll loss = 2.1261 accu = 0.3722

Training: Epoch 8 of 10 Step 3363 ntokens 2078517136 Example 40800 of 138376 loss = 3.4951 nll loss = 2.1264 accu = 0.3721

Training: Epoch 8 of 10 Step 3364 ntokens 2078552536 Example 41100 of 138376 loss = 3.4952 nll loss = 2.1261 accu = 0.3722

Training: Epoch 8 of 10 Step 3365 ntokens 2078587936 Example 41400 of 138376 loss = 3.4945 nll loss = 2.1255 accu = 0.3724

Training: Epoch 8 of 10 Step 3366 ntokens 2078623336 Example 41700 of 138376 loss = 3.4943 nll loss = 2.1252 accu = 0.3725

Training: Epoch 8 of 10 Step 3367 ntokens 2078658736 Example 42000 of 138376 loss = 3.4940 nll loss = 2.1248 accu = 0.3727

Training: Epoch 8 of 10 Step 3368 ntokens 2078694136 Example 42300 of 138376 loss = 3.4933 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3369 ntokens 2078729536 Example 42600 of 138376 loss = 3.4940 nll loss = 2.1243 accu = 0.3729

Training: Epoch 8 of 10 Step 3370 ntokens 2078764936 Example 42900 of 138376 loss = 3.4948 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3371 ntokens 2078800336 Example 43200 of 138376 loss = 3.4954 nll loss = 2.1245 accu = 0.3728

Training: Epoch 8 of 10 Step 3372 ntokens 2078835736 Example 43500 of 138376 loss = 3.4949 nll loss = 2.1245 accu = 0.3728

Training: Epoch 8 of 10 Step 3373 ntokens 2078871136 Example 43800 of 138376 loss = 3.4954 nll loss = 2.1243 accu = 0.3729

Training: Epoch 8 of 10 Step 3374 ntokens 2078906536 Example 44100 of 138376 loss = 3.4946 nll loss = 2.1243 accu = 0.3729

Training: Epoch 8 of 10 Step 3375 ntokens 2078941936 Example 44400 of 138376 loss = 3.4947 nll loss = 2.1240 accu = 0.3730

Training: Epoch 8 of 10 Step 3376 ntokens 2078977336 Example 44700 of 138376 loss = 3.4949 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3377 ntokens 2079012736 Example 45000 of 138376 loss = 3.4949 nll loss = 2.1238 accu = 0.3731

Training: Epoch 8 of 10 Step 3378 ntokens 2079048136 Example 45300 of 138376 loss = 3.4953 nll loss = 2.1238 accu = 0.3731

Training: Epoch 8 of 10 Step 3379 ntokens 2079083536 Example 45600 of 138376 loss = 3.4953 nll loss = 2.1239 accu = 0.3730

Training: Epoch 8 of 10 Step 3380 ntokens 2079118936 Example 45900 of 138376 loss = 3.4949 nll loss = 2.1242 accu = 0.3729

Training: Epoch 8 of 10 Step 3381 ntokens 2079154336 Example 46200 of 138376 loss = 3.4946 nll loss = 2.1238 accu = 0.3731

Training: Epoch 8 of 10 Step 3382 ntokens 2079189736 Example 46500 of 138376 loss = 3.4943 nll loss = 2.1237 accu = 0.3731

Training: Epoch 8 of 10 Step 3383 ntokens 2079225136 Example 46800 of 138376 loss = 3.4938 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3384 ntokens 2079260536 Example 47100 of 138376 loss = 3.4937 nll loss = 2.1236 accu = 0.3732

Training: Epoch 8 of 10 Step 3385 ntokens 2079295936 Example 47400 of 138376 loss = 3.4938 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3386 ntokens 2079331336 Example 47700 of 138376 loss = 3.4931 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3387 ntokens 2079366736 Example 48000 of 138376 loss = 3.4929 nll loss = 2.1235 accu = 0.3732

Training: Epoch 8 of 10 Step 3388 ntokens 2079402136 Example 48300 of 138376 loss = 3.4930 nll loss = 2.1236 accu = 0.3732

Training: Epoch 8 of 10 Step 3389 ntokens 2079437536 Example 48600 of 138376 loss = 3.4931 nll loss = 2.1237 accu = 0.3731

Training: Epoch 8 of 10 Step 3390 ntokens 2079472936 Example 48900 of 138376 loss = 3.4934 nll loss = 2.1238 accu = 0.3731

Training: Epoch 8 of 10 Step 3391 ntokens 2079508336 Example 49200 of 138376 loss = 3.4936 nll loss = 2.1237 accu = 0.3731

Training: Epoch 8 of 10 Step 3392 ntokens 2079543736 Example 49500 of 138376 loss = 3.4944 nll loss = 2.1237 accu = 0.3731

Training: Epoch 8 of 10 Step 3393 ntokens 2079579136 Example 49800 of 138376 loss = 3.4951 nll loss = 2.1239 accu = 0.3730

Training: Epoch 8 of 10 Step 3394 ntokens 2079614536 Example 50100 of 138376 loss = 3.4959 nll loss = 2.1233 accu = 0.3732

Training: Epoch 8 of 10 Step 3395 ntokens 2079649936 Example 50400 of 138376 loss = 3.4968 nll loss = 2.1232 accu = 0.3733

Training: Epoch 8 of 10 Step 3396 ntokens 2079685336 Example 50700 of 138376 loss = 3.4964 nll loss = 2.1230 accu = 0.3734

Training: Epoch 8 of 10 Step 3397 ntokens 2079720736 Example 51000 of 138376 loss = 3.4962 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3398 ntokens 2079756136 Example 51300 of 138376 loss = 3.4961 nll loss = 2.1228 accu = 0.3734

Training: Epoch 8 of 10 Step 3399 ntokens 2079791536 Example 51600 of 138376 loss = 3.4963 nll loss = 2.1228 accu = 0.3734

Training: Epoch 8 of 10 Step 3400 ntokens 2079826936 Example 51900 of 138376 loss = 3.4965 nll loss = 2.1224 accu = 0.3736

Training: Epoch 8 of 10 Step 3401 ntokens 2079862336 Example 52200 of 138376 loss = 3.4967 nll loss = 2.1226 accu = 0.3735

Training: Epoch 8 of 10 Step 3402 ntokens 2079897736 Example 52500 of 138376 loss = 3.4973 nll loss = 2.1224 accu = 0.3736

Training: Epoch 8 of 10 Step 3403 ntokens 2079933136 Example 52800 of 138376 loss = 3.4977 nll loss = 2.1229 accu = 0.3734

Training: Epoch 8 of 10 Step 3404 ntokens 2079968536 Example 53100 of 138376 loss = 3.4979 nll loss = 2.1231 accu = 0.3734

Training: Epoch 8 of 10 Step 3405 ntokens 2080003936 Example 53400 of 138376 loss = 3.4979 nll loss = 2.1226 accu = 0.3735

Training: Epoch 8 of 10 Step 3406 ntokens 2080039336 Example 53700 of 138376 loss = 3.4975 nll loss = 2.1224 accu = 0.3736

Training: Epoch 8 of 10 Step 3407 ntokens 2080074736 Example 54000 of 138376 loss = 3.4977 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3408 ntokens 2080110136 Example 54300 of 138376 loss = 3.4980 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3409 ntokens 2080145536 Example 54600 of 138376 loss = 3.4984 nll loss = 2.1224 accu = 0.3736

Training: Epoch 8 of 10 Step 3410 ntokens 2080180936 Example 54900 of 138376 loss = 3.4986 nll loss = 2.1225 accu = 0.3735

Training: Epoch 8 of 10 Step 3411 ntokens 2080216336 Example 55200 of 138376 loss = 3.4983 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3412 ntokens 2080251736 Example 55500 of 138376 loss = 3.4986 nll loss = 2.1225 accu = 0.3735

Training: Epoch 8 of 10 Step 3413 ntokens 2080287136 Example 55800 of 138376 loss = 3.4988 nll loss = 2.1228 accu = 0.3734

Training: Epoch 8 of 10 Step 3414 ntokens 2080322536 Example 56100 of 138376 loss = 3.4987 nll loss = 2.1224 accu = 0.3736

Training: Epoch 8 of 10 Step 3415 ntokens 2080357936 Example 56400 of 138376 loss = 3.4991 nll loss = 2.1222 accu = 0.3736

Training: Epoch 8 of 10 Step 3416 ntokens 2080393336 Example 56700 of 138376 loss = 3.4988 nll loss = 2.1224 accu = 0.3735

Training: Epoch 8 of 10 Step 3417 ntokens 2080428736 Example 57000 of 138376 loss = 3.4999 nll loss = 2.1227 accu = 0.3735

Training: Epoch 8 of 10 Step 3418 ntokens 2080464136 Example 57300 of 138376 loss = 3.4996 nll loss = 2.1227 accu = 0.3735

Training: Epoch 8 of 10 Step 3419 ntokens 2080499536 Example 57600 of 138376 loss = 3.4994 nll loss = 2.1228 accu = 0.3734

Training: Epoch 8 of 10 Step 3420 ntokens 2080534936 Example 57900 of 138376 loss = 3.4995 nll loss = 2.1229 accu = 0.3734

Training: Epoch 8 of 10 Step 3421 ntokens 2080570336 Example 58200 of 138376 loss = 3.5000 nll loss = 2.1231 accu = 0.3734

Training: Epoch 8 of 10 Step 3422 ntokens 2080605736 Example 58500 of 138376 loss = 3.5001 nll loss = 2.1229 accu = 0.3734

Training: Epoch 8 of 10 Step 3423 ntokens 2080641136 Example 58800 of 138376 loss = 3.5001 nll loss = 2.1229 accu = 0.3734

Training: Epoch 8 of 10 Step 3424 ntokens 2080676536 Example 59100 of 138376 loss = 3.4996 nll loss = 2.1234 accu = 0.3732

Training: Epoch 8 of 10 Step 3425 ntokens 2080711936 Example 59400 of 138376 loss = 3.4992 nll loss = 2.1237 accu = 0.3731

Training: Epoch 8 of 10 Step 3426 ntokens 2080747336 Example 59700 of 138376 loss = 3.4993 nll loss = 2.1239 accu = 0.3730

Training: Epoch 8 of 10 Step 3427 ntokens 2080782736 Example 60000 of 138376 loss = 3.5000 nll loss = 2.1238 accu = 0.3731

Training: Epoch 8 of 10 Step 3428 ntokens 2080818136 Example 60300 of 138376 loss = 3.4998 nll loss = 2.1242 accu = 0.3729

Training: Epoch 8 of 10 Step 3429 ntokens 2080853536 Example 60600 of 138376 loss = 3.4995 nll loss = 2.1244 accu = 0.3729

Training: Epoch 8 of 10 Step 3430 ntokens 2080888936 Example 60900 of 138376 loss = 3.4998 nll loss = 2.1240 accu = 0.3730

Training: Epoch 8 of 10 Step 3431 ntokens 2080924336 Example 61200 of 138376 loss = 3.4999 nll loss = 2.1242 accu = 0.3729

Training: Epoch 8 of 10 Step 3432 ntokens 2080959736 Example 61500 of 138376 loss = 3.5001 nll loss = 2.1241 accu = 0.3730

Training: Epoch 8 of 10 Step 3433 ntokens 2080995136 Example 61800 of 138376 loss = 3.4996 nll loss = 2.1241 accu = 0.3730

Training: Epoch 8 of 10 Step 3434 ntokens 2081030536 Example 62100 of 138376 loss = 3.4989 nll loss = 2.1238 accu = 0.3731

Training: Epoch 8 of 10 Step 3435 ntokens 2081065936 Example 62400 of 138376 loss = 3.4988 nll loss = 2.1235 accu = 0.3732

Training: Epoch 8 of 10 Step 3436 ntokens 2081101336 Example 62700 of 138376 loss = 3.4988 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3437 ntokens 2081136736 Example 63000 of 138376 loss = 3.4987 nll loss = 2.1234 accu = 0.3732

Training: Epoch 8 of 10 Step 3438 ntokens 2081172136 Example 63300 of 138376 loss = 3.4990 nll loss = 2.1232 accu = 0.3732

Training: Epoch 8 of 10 Step 3439 ntokens 2081207536 Example 63600 of 138376 loss = 3.4994 nll loss = 2.1233 accu = 0.3732

Training: Epoch 8 of 10 Step 3440 ntokens 2081242936 Example 63900 of 138376 loss = 3.4993 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3441 ntokens 2081278336 Example 64200 of 138376 loss = 3.4996 nll loss = 2.1233 accu = 0.3732

Training: Epoch 8 of 10 Step 3442 ntokens 2081313736 Example 64500 of 138376 loss = 3.4991 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3443 ntokens 2081349136 Example 64800 of 138376 loss = 3.4989 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3444 ntokens 2081384536 Example 65100 of 138376 loss = 3.4983 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3445 ntokens 2081419936 Example 65400 of 138376 loss = 3.4982 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3446 ntokens 2081455336 Example 65700 of 138376 loss = 3.4984 nll loss = 2.1226 accu = 0.3735

Training: Epoch 8 of 10 Step 3447 ntokens 2081490736 Example 66000 of 138376 loss = 3.4983 nll loss = 2.1226 accu = 0.3735

Training: Epoch 8 of 10 Step 3448 ntokens 2081526136 Example 66300 of 138376 loss = 3.4986 nll loss = 2.1224 accu = 0.3735

Training: Epoch 8 of 10 Step 3449 ntokens 2081561536 Example 66600 of 138376 loss = 3.4983 nll loss = 2.1221 accu = 0.3737

Training: Epoch 8 of 10 Step 3450 ntokens 2081596936 Example 66900 of 138376 loss = 3.4981 nll loss = 2.1221 accu = 0.3737

Training: Epoch 8 of 10 Step 3451 ntokens 2081632336 Example 67200 of 138376 loss = 3.4982 nll loss = 2.1220 accu = 0.3737

Training: Epoch 8 of 10 Step 3452 ntokens 2081667736 Example 67500 of 138376 loss = 3.4975 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3453 ntokens 2081703136 Example 67800 of 138376 loss = 3.4979 nll loss = 2.1220 accu = 0.3737

Training: Epoch 8 of 10 Step 3454 ntokens 2081738536 Example 68100 of 138376 loss = 3.4979 nll loss = 2.1226 accu = 0.3735

Training: Epoch 8 of 10 Step 3455 ntokens 2081773936 Example 68400 of 138376 loss = 3.4978 nll loss = 2.1224 accu = 0.3735

Training: Epoch 8 of 10 Step 3456 ntokens 2081809336 Example 68700 of 138376 loss = 3.4977 nll loss = 2.1225 accu = 0.3736

Training: Epoch 8 of 10 Step 3457 ntokens 2081844736 Example 69000 of 138376 loss = 3.4972 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3458 ntokens 2081880136 Example 69300 of 138376 loss = 3.4970 nll loss = 2.1224 accu = 0.3735

Training: Epoch 8 of 10 Step 3459 ntokens 2081915536 Example 69600 of 138376 loss = 3.4969 nll loss = 2.1224 accu = 0.3735

Training: Epoch 8 of 10 Step 3460 ntokens 2081950936 Example 69900 of 138376 loss = 3.4973 nll loss = 2.1222 accu = 0.3736

Training: Epoch 8 of 10 Step 3461 ntokens 2081986336 Example 70200 of 138376 loss = 3.4974 nll loss = 2.1223 accu = 0.3735

Training: Epoch 8 of 10 Step 3462 ntokens 2082021736 Example 70500 of 138376 loss = 3.4970 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3463 ntokens 2082057136 Example 70800 of 138376 loss = 3.4969 nll loss = 2.1220 accu = 0.3737

Training: Epoch 8 of 10 Step 3464 ntokens 2082092536 Example 71100 of 138376 loss = 3.4971 nll loss = 2.1218 accu = 0.3737

Training: Epoch 8 of 10 Step 3465 ntokens 2082127936 Example 71400 of 138376 loss = 3.4973 nll loss = 2.1217 accu = 0.3738

Training: Epoch 8 of 10 Step 3466 ntokens 2082163336 Example 71700 of 138376 loss = 3.4976 nll loss = 2.1217 accu = 0.3738

Training: Epoch 8 of 10 Step 3467 ntokens 2082198736 Example 72000 of 138376 loss = 3.4980 nll loss = 2.1212 accu = 0.3739

Training: Epoch 8 of 10 Step 3468 ntokens 2082234136 Example 72300 of 138376 loss = 3.4981 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3469 ntokens 2082269536 Example 72600 of 138376 loss = 3.4984 nll loss = 2.1219 accu = 0.3737

Training: Epoch 8 of 10 Step 3470 ntokens 2082304936 Example 72900 of 138376 loss = 3.4988 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3471 ntokens 2082340336 Example 73200 of 138376 loss = 3.4984 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3472 ntokens 2082375736 Example 73500 of 138376 loss = 3.4987 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3473 ntokens 2082411136 Example 73800 of 138376 loss = 3.4983 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3474 ntokens 2082446536 Example 74100 of 138376 loss = 3.4985 nll loss = 2.1214 accu = 0.3739

Training: Epoch 8 of 10 Step 3475 ntokens 2082481936 Example 74400 of 138376 loss = 3.4985 nll loss = 2.1217 accu = 0.3738

Training: Epoch 8 of 10 Step 3476 ntokens 2082517336 Example 74700 of 138376 loss = 3.4989 nll loss = 2.1217 accu = 0.3738

Training: Epoch 8 of 10 Step 3477 ntokens 2082552736 Example 75000 of 138376 loss = 3.4993 nll loss = 2.1217 accu = 0.3738

Training: Epoch 8 of 10 Step 3478 ntokens 2082588136 Example 75300 of 138376 loss = 3.4990 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3479 ntokens 2082623536 Example 75600 of 138376 loss = 3.4991 nll loss = 2.1219 accu = 0.3737

Training: Epoch 8 of 10 Step 3480 ntokens 2082658936 Example 75900 of 138376 loss = 3.4993 nll loss = 2.1215 accu = 0.3739

Training: Epoch 8 of 10 Step 3481 ntokens 2082694336 Example 76200 of 138376 loss = 3.4993 nll loss = 2.1216 accu = 0.3738

Training: Epoch 8 of 10 Step 3482 ntokens 2082729736 Example 76500 of 138376 loss = 3.4993 nll loss = 2.1218 accu = 0.3738

Training: Epoch 8 of 10 Step 3483 ntokens 2082765136 Example 76800 of 138376 loss = 3.4993 nll loss = 2.1220 accu = 0.3737

Training: Epoch 8 of 10 Step 3484 ntokens 2082800536 Example 77100 of 138376 loss = 3.4990 nll loss = 2.1220 accu = 0.3737

Training: Epoch 8 of 10 Step 3485 ntokens 2082835936 Example 77400 of 138376 loss = 3.4991 nll loss = 2.1222 accu = 0.3736

Training: Epoch 8 of 10 Step 3486 ntokens 2082871336 Example 77700 of 138376 loss = 3.4988 nll loss = 2.1223 accu = 0.3736

Training: Epoch 8 of 10 Step 3487 ntokens 2082906736 Example 78000 of 138376 loss = 3.4990 nll loss = 2.1225 accu = 0.3735

Training: Epoch 8 of 10 Step 3488 ntokens 2082942136 Example 78300 of 138376 loss = 3.4994 nll loss = 2.1226 accu = 0.3734

Training: Epoch 8 of 10 Step 3489 ntokens 2082977536 Example 78600 of 138376 loss = 3.4995 nll loss = 2.1228 accu = 0.3734

Training: Epoch 8 of 10 Step 3490 ntokens 2083012936 Example 78900 of 138376 loss = 3.4992 nll loss = 2.1232 accu = 0.3733

Training: Epoch 8 of 10 Step 3491 ntokens 2083048336 Example 79200 of 138376 loss = 3.4994 nll loss = 2.1229 accu = 0.3734

Training: Epoch 8 of 10 Step 3492 ntokens 2083083736 Example 79500 of 138376 loss = 3.4989 nll loss = 2.1230 accu = 0.3733

Training: Epoch 8 of 10 Step 3493 ntokens 2083119136 Example 79800 of 138376 loss = 3.4988 nll loss = 2.1230 accu = 0.3733

Training: Epoch 8 of 10 Step 3494 ntokens 2083154536 Example 80100 of 138376 loss = 3.4988 nll loss = 2.1230 accu = 0.3733

Training: Epoch 8 of 10 Step 3495 ntokens 2083189936 Example 80400 of 138376 loss = 3.4989 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3496 ntokens 2083225336 Example 80700 of 138376 loss = 3.4985 nll loss = 2.1231 accu = 0.3733

Training: Epoch 8 of 10 Step 3497 ntokens 2083260736 Example 81000 of 138376 loss = 3.4983 nll loss = 2.1233 accu = 0.3732

Training: Epoch 8 of 10 Step 3498 ntokens 2083296136 Example 81300 of 138376 loss = 3.4981 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3499 ntokens 2083331536 Example 81600 of 138376 loss = 3.4984 nll loss = 2.1232 accu = 0.3732

Training: Epoch 8 of 10 Step 3500 ntokens 2083366936 Example 81900 of 138376 loss = 3.4981 nll loss = 2.1233 accu = 0.3732

Training: Epoch 8 of 10 Step 3501 ntokens 2083402336 Example 82200 of 138376 loss = 3.4981 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3502 ntokens 2083437736 Example 82500 of 138376 loss = 3.4982 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3503 ntokens 2083473136 Example 82800 of 138376 loss = 3.4987 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3504 ntokens 2083508536 Example 83100 of 138376 loss = 3.4982 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3505 ntokens 2083543936 Example 83400 of 138376 loss = 3.4986 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3506 ntokens 2083579336 Example 83700 of 138376 loss = 3.4985 nll loss = 2.1237 accu = 0.3731

Training: Epoch 8 of 10 Step 3507 ntokens 2083614736 Example 84000 of 138376 loss = 3.4985 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3508 ntokens 2083650136 Example 84300 of 138376 loss = 3.4985 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3509 ntokens 2083685536 Example 84600 of 138376 loss = 3.4984 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3510 ntokens 2083720936 Example 84900 of 138376 loss = 3.4983 nll loss = 2.1236 accu = 0.3731

Training: Epoch 8 of 10 Step 3511 ntokens 2083756336 Example 85200 of 138376 loss = 3.4981 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3512 ntokens 2083791736 Example 85500 of 138376 loss = 3.4980 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3513 ntokens 2083827136 Example 85800 of 138376 loss = 3.4976 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3514 ntokens 2083862536 Example 86100 of 138376 loss = 3.4978 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3515 ntokens 2083897936 Example 86400 of 138376 loss = 3.4979 nll loss = 2.1244 accu = 0.3728

Training: Epoch 8 of 10 Step 3516 ntokens 2083933336 Example 86700 of 138376 loss = 3.4977 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3517 ntokens 2083968736 Example 87000 of 138376 loss = 3.4974 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3518 ntokens 2084004136 Example 87300 of 138376 loss = 3.4976 nll loss = 2.1239 accu = 0.3730

Training: Epoch 8 of 10 Step 3519 ntokens 2084039536 Example 87600 of 138376 loss = 3.4979 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3520 ntokens 2084074936 Example 87900 of 138376 loss = 3.4982 nll loss = 2.1239 accu = 0.3730

Training: Epoch 8 of 10 Step 3521 ntokens 2084110336 Example 88200 of 138376 loss = 3.4982 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3522 ntokens 2084145736 Example 88500 of 138376 loss = 3.4984 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3523 ntokens 2084181136 Example 88800 of 138376 loss = 3.4980 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3524 ntokens 2084216536 Example 89100 of 138376 loss = 3.4976 nll loss = 2.1233 accu = 0.3731

Training: Epoch 8 of 10 Step 3525 ntokens 2084251936 Example 89400 of 138376 loss = 3.4978 nll loss = 2.1231 accu = 0.3732

Training: Epoch 8 of 10 Step 3526 ntokens 2084287336 Example 89700 of 138376 loss = 3.4978 nll loss = 2.1228 accu = 0.3733

Training: Epoch 8 of 10 Step 3527 ntokens 2084322736 Example 90000 of 138376 loss = 3.4977 nll loss = 2.1231 accu = 0.3732

Training: Epoch 8 of 10 Step 3528 ntokens 2084358136 Example 90300 of 138376 loss = 3.4973 nll loss = 2.1231 accu = 0.3732

Training: Epoch 8 of 10 Step 3529 ntokens 2084393536 Example 90600 of 138376 loss = 3.4967 nll loss = 2.1232 accu = 0.3732

Training: Epoch 8 of 10 Step 3530 ntokens 2084428936 Example 90900 of 138376 loss = 3.4969 nll loss = 2.1228 accu = 0.3733

Training: Epoch 8 of 10 Step 3531 ntokens 2084464336 Example 91200 of 138376 loss = 3.4969 nll loss = 2.1227 accu = 0.3734

Training: Epoch 8 of 10 Step 3532 ntokens 2084499736 Example 91500 of 138376 loss = 3.4969 nll loss = 2.1229 accu = 0.3733

Training: Epoch 8 of 10 Step 3533 ntokens 2084535136 Example 91800 of 138376 loss = 3.4970 nll loss = 2.1228 accu = 0.3733

Training: Epoch 8 of 10 Step 3534 ntokens 2084570536 Example 92100 of 138376 loss = 3.4971 nll loss = 2.1226 accu = 0.3734

Training: Epoch 8 of 10 Step 3535 ntokens 2084605936 Example 92400 of 138376 loss = 3.4972 nll loss = 2.1225 accu = 0.3734

Training: Epoch 8 of 10 Step 3536 ntokens 2084641336 Example 92700 of 138376 loss = 3.4971 nll loss = 2.1227 accu = 0.3734

Training: Epoch 8 of 10 Step 3537 ntokens 2084676736 Example 93000 of 138376 loss = 3.4971 nll loss = 2.1225 accu = 0.3734

Training: Epoch 8 of 10 Step 3538 ntokens 2084712136 Example 93300 of 138376 loss = 3.4966 nll loss = 2.1226 accu = 0.3734

Training: Epoch 8 of 10 Step 3539 ntokens 2084747536 Example 93600 of 138376 loss = 3.4966 nll loss = 2.1225 accu = 0.3734

Training: Epoch 8 of 10 Step 3540 ntokens 2084782936 Example 93900 of 138376 loss = 3.4968 nll loss = 2.1223 accu = 0.3735

Training: Epoch 8 of 10 Step 3541 ntokens 2084818336 Example 94200 of 138376 loss = 3.4967 nll loss = 2.1223 accu = 0.3735

Training: Epoch 8 of 10 Step 3542 ntokens 2084853736 Example 94500 of 138376 loss = 3.4967 nll loss = 2.1224 accu = 0.3734

Training: Epoch 8 of 10 Step 3543 ntokens 2084889136 Example 94800 of 138376 loss = 3.4969 nll loss = 2.1224 accu = 0.3734

Training: Epoch 8 of 10 Step 3544 ntokens 2084924536 Example 95100 of 138376 loss = 3.4972 nll loss = 2.1225 accu = 0.3734

Training: Epoch 8 of 10 Step 3545 ntokens 2084959936 Example 95400 of 138376 loss = 3.4973 nll loss = 2.1223 accu = 0.3735

Training: Epoch 8 of 10 Step 3546 ntokens 2084995336 Example 95700 of 138376 loss = 3.4976 nll loss = 2.1224 accu = 0.3734

Training: Epoch 8 of 10 Step 3547 ntokens 2085030736 Example 96000 of 138376 loss = 3.4974 nll loss = 2.1224 accu = 0.3735

Training: Epoch 8 of 10 Step 3548 ntokens 2085066136 Example 96300 of 138376 loss = 3.4974 nll loss = 2.1223 accu = 0.3735

Training: Epoch 8 of 10 Step 3549 ntokens 2085101536 Example 96600 of 138376 loss = 3.4975 nll loss = 2.1226 accu = 0.3734

Training: Epoch 8 of 10 Step 3550 ntokens 2085136936 Example 96900 of 138376 loss = 3.4977 nll loss = 2.1226 accu = 0.3734

Training: Epoch 8 of 10 Step 3551 ntokens 2085172336 Example 97200 of 138376 loss = 3.4975 nll loss = 2.1225 accu = 0.3734

Training: Epoch 8 of 10 Step 3552 ntokens 2085207736 Example 97500 of 138376 loss = 3.4974 nll loss = 2.1224 accu = 0.3734

Training: Epoch 8 of 10 Step 3553 ntokens 2085243136 Example 97800 of 138376 loss = 3.4974 nll loss = 2.1223 accu = 0.3734

Training: Epoch 8 of 10 Step 3554 ntokens 2085278536 Example 98100 of 138376 loss = 3.4974 nll loss = 2.1226 accu = 0.3733

Training: Epoch 8 of 10 Step 3555 ntokens 2085313936 Example 98400 of 138376 loss = 3.4972 nll loss = 2.1229 accu = 0.3733

Training: Epoch 8 of 10 Step 3556 ntokens 2085349336 Example 98700 of 138376 loss = 3.4976 nll loss = 2.1228 accu = 0.3733

Training: Epoch 8 of 10 Step 3557 ntokens 2085384736 Example 99000 of 138376 loss = 3.4974 nll loss = 2.1227 accu = 0.3733

Training: Epoch 8 of 10 Step 3558 ntokens 2085420136 Example 99300 of 138376 loss = 3.4974 nll loss = 2.1229 accu = 0.3733

Training: Epoch 8 of 10 Step 3559 ntokens 2085455536 Example 99600 of 138376 loss = 3.4974 nll loss = 2.1231 accu = 0.3732

Training: Epoch 8 of 10 Step 3560 ntokens 2085490936 Example 99900 of 138376 loss = 3.4973 nll loss = 2.1230 accu = 0.3732

Training: Epoch 8 of 10 Step 3561 ntokens 2085526336 Example 100200 of 138376 loss = 3.4972 nll loss = 2.1231 accu = 0.3732

Training: Epoch 8 of 10 Step 3562 ntokens 2085561736 Example 100500 of 138376 loss = 3.4970 nll loss = 2.1232 accu = 0.3732

Training: Epoch 8 of 10 Step 3563 ntokens 2085597136 Example 100800 of 138376 loss = 3.4973 nll loss = 2.1233 accu = 0.3731

Training: Epoch 8 of 10 Step 3564 ntokens 2085632536 Example 101100 of 138376 loss = 3.4970 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3565 ntokens 2085667936 Example 101400 of 138376 loss = 3.4970 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3566 ntokens 2085703336 Example 101700 of 138376 loss = 3.4968 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3567 ntokens 2085738736 Example 102000 of 138376 loss = 3.4965 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3568 ntokens 2085774136 Example 102300 of 138376 loss = 3.4966 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3569 ntokens 2085809536 Example 102600 of 138376 loss = 3.4964 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3570 ntokens 2085844936 Example 102900 of 138376 loss = 3.4966 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3571 ntokens 2085880336 Example 103200 of 138376 loss = 3.4963 nll loss = 2.1238 accu = 0.3729

Training: Epoch 8 of 10 Step 3572 ntokens 2085915736 Example 103500 of 138376 loss = 3.4963 nll loss = 2.1239 accu = 0.3729

Training: Epoch 8 of 10 Step 3573 ntokens 2085951136 Example 103800 of 138376 loss = 3.4963 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3574 ntokens 2085986536 Example 104100 of 138376 loss = 3.4961 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3575 ntokens 2086021936 Example 104400 of 138376 loss = 3.4964 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3576 ntokens 2086057336 Example 104700 of 138376 loss = 3.4965 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3577 ntokens 2086092736 Example 105000 of 138376 loss = 3.4964 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3578 ntokens 2086128136 Example 105300 of 138376 loss = 3.4963 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3579 ntokens 2086163536 Example 105600 of 138376 loss = 3.4961 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3580 ntokens 2086198936 Example 105900 of 138376 loss = 3.4958 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3581 ntokens 2086234336 Example 106200 of 138376 loss = 3.4961 nll loss = 2.1244 accu = 0.3727

Training: Epoch 8 of 10 Step 3582 ntokens 2086269736 Example 106500 of 138376 loss = 3.4963 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3583 ntokens 2086305136 Example 106800 of 138376 loss = 3.4963 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3584 ntokens 2086340536 Example 107100 of 138376 loss = 3.4964 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3585 ntokens 2086375936 Example 107400 of 138376 loss = 3.4963 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3586 ntokens 2086411336 Example 107700 of 138376 loss = 3.4965 nll loss = 2.1246 accu = 0.3726

Training: Epoch 8 of 10 Step 3587 ntokens 2086446736 Example 108000 of 138376 loss = 3.4963 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3588 ntokens 2086482136 Example 108300 of 138376 loss = 3.4962 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3589 ntokens 2086517536 Example 108600 of 138376 loss = 3.4963 nll loss = 2.1250 accu = 0.3725

Training: Epoch 8 of 10 Step 3590 ntokens 2086552936 Example 108900 of 138376 loss = 3.4964 nll loss = 2.1250 accu = 0.3725

Training: Epoch 8 of 10 Step 3591 ntokens 2086588336 Example 109200 of 138376 loss = 3.4965 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3592 ntokens 2086623736 Example 109500 of 138376 loss = 3.4966 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3593 ntokens 2086659136 Example 109800 of 138376 loss = 3.4965 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3594 ntokens 2086694536 Example 110100 of 138376 loss = 3.4967 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3595 ntokens 2086729936 Example 110400 of 138376 loss = 3.4965 nll loss = 2.1250 accu = 0.3725

Training: Epoch 8 of 10 Step 3596 ntokens 2086765336 Example 110700 of 138376 loss = 3.4966 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3597 ntokens 2086800736 Example 111000 of 138376 loss = 3.4966 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3598 ntokens 2086836136 Example 111300 of 138376 loss = 3.4965 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3599 ntokens 2086871536 Example 111600 of 138376 loss = 3.4970 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3600 ntokens 2086906936 Example 111900 of 138376 loss = 3.4969 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3601 ntokens 2086942336 Example 112200 of 138376 loss = 3.4970 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3602 ntokens 2086977736 Example 112500 of 138376 loss = 3.4974 nll loss = 2.1249 accu = 0.3726

Training: Epoch 8 of 10 Step 3603 ntokens 2087013136 Example 112800 of 138376 loss = 3.4974 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3604 ntokens 2087048536 Example 113100 of 138376 loss = 3.4975 nll loss = 2.1247 accu = 0.3726

Training: Epoch 8 of 10 Step 3605 ntokens 2087083936 Example 113400 of 138376 loss = 3.4974 nll loss = 2.1247 accu = 0.3727

Training: Epoch 8 of 10 Step 3606 ntokens 2087119336 Example 113700 of 138376 loss = 3.4974 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3607 ntokens 2087154736 Example 114000 of 138376 loss = 3.4975 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3608 ntokens 2087190136 Example 114300 of 138376 loss = 3.4975 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3609 ntokens 2087225536 Example 114600 of 138376 loss = 3.4978 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3610 ntokens 2087260936 Example 114900 of 138376 loss = 3.4978 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3611 ntokens 2087296336 Example 115200 of 138376 loss = 3.4979 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3612 ntokens 2087331736 Example 115500 of 138376 loss = 3.4981 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3613 ntokens 2087367136 Example 115800 of 138376 loss = 3.4981 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3614 ntokens 2087402536 Example 116100 of 138376 loss = 3.4981 nll loss = 2.1247 accu = 0.3727

Training: Epoch 8 of 10 Step 3615 ntokens 2087437936 Example 116400 of 138376 loss = 3.4978 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3616 ntokens 2087473336 Example 116700 of 138376 loss = 3.4975 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3617 ntokens 2087508736 Example 117000 of 138376 loss = 3.4977 nll loss = 2.1247 accu = 0.3726

Training: Epoch 8 of 10 Step 3618 ntokens 2087544136 Example 117300 of 138376 loss = 3.4976 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3619 ntokens 2087579536 Example 117600 of 138376 loss = 3.4979 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3620 ntokens 2087614936 Example 117900 of 138376 loss = 3.4983 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3621 ntokens 2087650336 Example 118200 of 138376 loss = 3.4982 nll loss = 2.1248 accu = 0.3726

Training: Epoch 8 of 10 Step 3622 ntokens 2087685736 Example 118500 of 138376 loss = 3.4981 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3623 ntokens 2087721136 Example 118800 of 138376 loss = 3.4980 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3624 ntokens 2087756536 Example 119100 of 138376 loss = 3.4978 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3625 ntokens 2087791936 Example 119400 of 138376 loss = 3.4978 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3626 ntokens 2087827336 Example 119700 of 138376 loss = 3.4977 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3627 ntokens 2087862736 Example 120000 of 138376 loss = 3.4979 nll loss = 2.1246 accu = 0.3727

Training: Epoch 8 of 10 Step 3628 ntokens 2087898136 Example 120300 of 138376 loss = 3.4981 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3629 ntokens 2087933536 Example 120600 of 138376 loss = 3.4981 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3630 ntokens 2087968936 Example 120900 of 138376 loss = 3.4981 nll loss = 2.1244 accu = 0.3727

Training: Epoch 8 of 10 Step 3631 ntokens 2088004336 Example 121200 of 138376 loss = 3.4981 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3632 ntokens 2088039736 Example 121500 of 138376 loss = 3.4981 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3633 ntokens 2088075136 Example 121800 of 138376 loss = 3.4980 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3634 ntokens 2088110536 Example 122100 of 138376 loss = 3.4982 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3635 ntokens 2088145936 Example 122400 of 138376 loss = 3.4980 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3636 ntokens 2088181336 Example 122700 of 138376 loss = 3.4980 nll loss = 2.1241 accu = 0.3729

Training: Epoch 8 of 10 Step 3637 ntokens 2088216736 Example 123000 of 138376 loss = 3.4978 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3638 ntokens 2088252136 Example 123300 of 138376 loss = 3.4974 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3639 ntokens 2088287536 Example 123600 of 138376 loss = 3.4973 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3640 ntokens 2088322936 Example 123900 of 138376 loss = 3.4975 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3641 ntokens 2088358336 Example 124200 of 138376 loss = 3.4975 nll loss = 2.1241 accu = 0.3728

Training: Epoch 8 of 10 Step 3642 ntokens 2088393736 Example 124500 of 138376 loss = 3.4973 nll loss = 2.1241 accu = 0.3728

Training: Epoch 8 of 10 Step 3643 ntokens 2088429136 Example 124800 of 138376 loss = 3.4973 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3644 ntokens 2088464536 Example 125100 of 138376 loss = 3.4973 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3645 ntokens 2088499936 Example 125400 of 138376 loss = 3.4975 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3646 ntokens 2088535336 Example 125700 of 138376 loss = 3.4975 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3647 ntokens 2088570736 Example 126000 of 138376 loss = 3.4973 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3648 ntokens 2088606136 Example 126300 of 138376 loss = 3.4974 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3649 ntokens 2088641536 Example 126600 of 138376 loss = 3.4973 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3650 ntokens 2088676936 Example 126900 of 138376 loss = 3.4975 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3651 ntokens 2088712336 Example 127200 of 138376 loss = 3.4976 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3652 ntokens 2088747736 Example 127500 of 138376 loss = 3.4975 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3653 ntokens 2088783136 Example 127800 of 138376 loss = 3.4975 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3654 ntokens 2088818536 Example 128100 of 138376 loss = 3.4974 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3655 ntokens 2088853936 Example 128400 of 138376 loss = 3.4973 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3656 ntokens 2088889336 Example 128700 of 138376 loss = 3.4974 nll loss = 2.1241 accu = 0.3728

Training: Epoch 8 of 10 Step 3657 ntokens 2088924736 Example 129000 of 138376 loss = 3.4976 nll loss = 2.1241 accu = 0.3728

Training: Epoch 8 of 10 Step 3658 ntokens 2088960136 Example 129300 of 138376 loss = 3.4973 nll loss = 2.1242 accu = 0.3728

Training: Epoch 8 of 10 Step 3659 ntokens 2088995536 Example 129600 of 138376 loss = 3.4974 nll loss = 2.1244 accu = 0.3727

Training: Epoch 8 of 10 Step 3660 ntokens 2089030936 Example 129900 of 138376 loss = 3.4974 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3661 ntokens 2089066336 Example 130200 of 138376 loss = 3.4974 nll loss = 2.1245 accu = 0.3727

Training: Epoch 8 of 10 Step 3662 ntokens 2089101736 Example 130500 of 138376 loss = 3.4973 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3663 ntokens 2089137136 Example 130800 of 138376 loss = 3.4974 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3664 ntokens 2089172536 Example 131100 of 138376 loss = 3.4975 nll loss = 2.1244 accu = 0.3728

Training: Epoch 8 of 10 Step 3665 ntokens 2089207936 Example 131400 of 138376 loss = 3.4976 nll loss = 2.1243 accu = 0.3728

Training: Epoch 8 of 10 Step 3666 ntokens 2089243336 Example 131700 of 138376 loss = 3.4978 nll loss = 2.1244 accu = 0.3727

Training: Epoch 8 of 10 Step 3667 ntokens 2089278736 Example 132000 of 138376 loss = 3.4977 nll loss = 2.1244 accu = 0.3727

Training: Epoch 8 of 10 Step 3668 ntokens 2089314136 Example 132300 of 138376 loss = 3.4975 nll loss = 2.1244 accu = 0.3728

Training: Epoch 8 of 10 Step 3669 ntokens 2089349536 Example 132600 of 138376 loss = 3.4973 nll loss = 2.1241 accu = 0.3728

Training: Epoch 8 of 10 Step 3670 ntokens 2089384936 Example 132900 of 138376 loss = 3.4973 nll loss = 2.1241 accu = 0.3728

Training: Epoch 8 of 10 Step 3671 ntokens 2089420336 Example 133200 of 138376 loss = 3.4972 nll loss = 2.1240 accu = 0.3729

Training: Epoch 8 of 10 Step 3672 ntokens 2089455736 Example 133500 of 138376 loss = 3.4972 nll loss = 2.1238 accu = 0.3729

Training: Epoch 8 of 10 Step 3673 ntokens 2089491136 Example 133800 of 138376 loss = 3.4973 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3674 ntokens 2089526536 Example 134100 of 138376 loss = 3.4975 nll loss = 2.1235 accu = 0.3731

Training: Epoch 8 of 10 Step 3675 ntokens 2089561936 Example 134400 of 138376 loss = 3.4974 nll loss = 2.1235 accu = 0.3730

Training: Epoch 8 of 10 Step 3676 ntokens 2089597336 Example 134700 of 138376 loss = 3.4976 nll loss = 2.1236 accu = 0.3730

Training: Epoch 8 of 10 Step 3677 ntokens 2089632736 Example 135000 of 138376 loss = 3.4978 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3678 ntokens 2089668136 Example 135300 of 138376 loss = 3.4977 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3679 ntokens 2089703536 Example 135600 of 138376 loss = 3.4980 nll loss = 2.1238 accu = 0.3729

Training: Epoch 8 of 10 Step 3680 ntokens 2089738936 Example 135900 of 138376 loss = 3.4979 nll loss = 2.1239 accu = 0.3729

Training: Epoch 8 of 10 Step 3681 ntokens 2089774336 Example 136200 of 138376 loss = 3.4979 nll loss = 2.1238 accu = 0.3730

Training: Epoch 8 of 10 Step 3682 ntokens 2089809736 Example 136500 of 138376 loss = 3.4981 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3683 ntokens 2089845136 Example 136800 of 138376 loss = 3.4981 nll loss = 2.1238 accu = 0.3729

Training: Epoch 8 of 10 Step 3684 ntokens 2089880536 Example 137100 of 138376 loss = 3.4981 nll loss = 2.1239 accu = 0.3729

Training: Epoch 8 of 10 Step 3685 ntokens 2089915936 Example 137400 of 138376 loss = 3.4982 nll loss = 2.1238 accu = 0.3729

Training: Epoch 8 of 10 Step 3686 ntokens 2089951336 Example 137700 of 138376 loss = 3.4984 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3687 ntokens 2089986736 Example 138000 of 138376 loss = 3.4985 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3688 ntokens 2090022136 Example 138300 of 138376 loss = 3.4988 nll loss = 2.1237 accu = 0.3730

Training: Epoch 8 of 10 Step 3689 ntokens 2090031104 Example 138376 of 138376 loss = 3.4988 nll loss = 2.1237 accu = 0.3730

Writing to checkpoint at 2024-05-28 17:08:04.447434
Validating: Epoch 8 of 10 Step 0 ntokens 2090031104 Example 300 of 34323 loss = 3.4269 nll loss = 2.0869 accu = 0.3843

Validating: Epoch 8 of 10 Step 1 ntokens 2090031104 Example 600 of 34323 loss = 3.4454 nll loss = 2.1042 accu = 0.3800

Validating: Epoch 8 of 10 Step 2 ntokens 2090031104 Example 900 of 34323 loss = 3.5038 nll loss = 2.1187 accu = 0.3754

Validating: Epoch 8 of 10 Step 3 ntokens 2090031104 Example 1200 of 34323 loss = 3.5154 nll loss = 2.1194 accu = 0.3757

Validating: Epoch 8 of 10 Step 4 ntokens 2090031104 Example 1500 of 34323 loss = 3.5086 nll loss = 2.1238 accu = 0.3742

Validating: Epoch 8 of 10 Step 5 ntokens 2090031104 Example 1800 of 34323 loss = 3.5151 nll loss = 2.1205 accu = 0.3752

Validating: Epoch 8 of 10 Step 6 ntokens 2090031104 Example 2100 of 34323 loss = 3.4932 nll loss = 2.1276 accu = 0.3721

Validating: Epoch 8 of 10 Step 7 ntokens 2090031104 Example 2400 of 34323 loss = 3.4980 nll loss = 2.1253 accu = 0.3732

Validating: Epoch 8 of 10 Step 8 ntokens 2090031104 Example 2700 of 34323 loss = 3.4983 nll loss = 2.1252 accu = 0.3730

Validating: Epoch 8 of 10 Step 9 ntokens 2090031104 Example 3000 of 34323 loss = 3.4899 nll loss = 2.1196 accu = 0.3749

Validating: Epoch 8 of 10 Step 10 ntokens 2090031104 Example 3300 of 34323 loss = 3.4853 nll loss = 2.1164 accu = 0.3757

Validating: Epoch 8 of 10 Step 11 ntokens 2090031104 Example 3600 of 34323 loss = 3.4874 nll loss = 2.1222 accu = 0.3736

Validating: Epoch 8 of 10 Step 12 ntokens 2090031104 Example 3900 of 34323 loss = 3.4875 nll loss = 2.1210 accu = 0.3740

Validating: Epoch 8 of 10 Step 13 ntokens 2090031104 Example 4200 of 34323 loss = 3.4972 nll loss = 2.1203 accu = 0.3743

Validating: Epoch 8 of 10 Step 14 ntokens 2090031104 Example 4500 of 34323 loss = 3.4964 nll loss = 2.1167 accu = 0.3754

Validating: Epoch 8 of 10 Step 15 ntokens 2090031104 Example 4800 of 34323 loss = 3.5031 nll loss = 2.1145 accu = 0.3763

Validating: Epoch 8 of 10 Step 16 ntokens 2090031104 Example 5100 of 34323 loss = 3.5050 nll loss = 2.1140 accu = 0.3766

Validating: Epoch 8 of 10 Step 17 ntokens 2090031104 Example 5400 of 34323 loss = 3.5124 nll loss = 2.1171 accu = 0.3753

Validating: Epoch 8 of 10 Step 18 ntokens 2090031104 Example 5700 of 34323 loss = 3.5114 nll loss = 2.1206 accu = 0.3741

Validating: Epoch 8 of 10 Step 19 ntokens 2090031104 Example 6000 of 34323 loss = 3.5095 nll loss = 2.1202 accu = 0.3744

Validating: Epoch 8 of 10 Step 20 ntokens 2090031104 Example 6300 of 34323 loss = 3.5150 nll loss = 2.1195 accu = 0.3746

Validating: Epoch 8 of 10 Step 21 ntokens 2090031104 Example 6600 of 34323 loss = 3.5184 nll loss = 2.1191 accu = 0.3747

Validating: Epoch 8 of 10 Step 22 ntokens 2090031104 Example 6900 of 34323 loss = 3.5117 nll loss = 2.1224 accu = 0.3736

Validating: Epoch 8 of 10 Step 23 ntokens 2090031104 Example 7200 of 34323 loss = 3.5129 nll loss = 2.1249 accu = 0.3726

Validating: Epoch 8 of 10 Step 24 ntokens 2090031104 Example 7500 of 34323 loss = 3.5120 nll loss = 2.1244 accu = 0.3730

Validating: Epoch 8 of 10 Step 25 ntokens 2090031104 Example 7800 of 34323 loss = 3.5072 nll loss = 2.1227 accu = 0.3735

Validating: Epoch 8 of 10 Step 26 ntokens 2090031104 Example 8100 of 34323 loss = 3.5069 nll loss = 2.1207 accu = 0.3741

Validating: Epoch 8 of 10 Step 27 ntokens 2090031104 Example 8400 of 34323 loss = 3.5069 nll loss = 2.1214 accu = 0.3738

Validating: Epoch 8 of 10 Step 28 ntokens 2090031104 Example 8700 of 34323 loss = 3.5083 nll loss = 2.1219 accu = 0.3737

Validating: Epoch 8 of 10 Step 29 ntokens 2090031104 Example 9000 of 34323 loss = 3.5104 nll loss = 2.1210 accu = 0.3740

Validating: Epoch 8 of 10 Step 30 ntokens 2090031104 Example 9300 of 34323 loss = 3.5087 nll loss = 2.1230 accu = 0.3733

Validating: Epoch 8 of 10 Step 31 ntokens 2090031104 Example 9600 of 34323 loss = 3.5065 nll loss = 2.1213 accu = 0.3739

Validating: Epoch 8 of 10 Step 32 ntokens 2090031104 Example 9900 of 34323 loss = 3.5066 nll loss = 2.1226 accu = 0.3735

Validating: Epoch 8 of 10 Step 33 ntokens 2090031104 Example 10200 of 34323 loss = 3.5064 nll loss = 2.1223 accu = 0.3736

Validating: Epoch 8 of 10 Step 34 ntokens 2090031104 Example 10500 of 34323 loss = 3.5038 nll loss = 2.1223 accu = 0.3736

Validating: Epoch 8 of 10 Step 35 ntokens 2090031104 Example 10800 of 34323 loss = 3.5049 nll loss = 2.1228 accu = 0.3734

Validating: Epoch 8 of 10 Step 36 ntokens 2090031104 Example 11100 of 34323 loss = 3.5044 nll loss = 2.1211 accu = 0.3739

Validating: Epoch 8 of 10 Step 37 ntokens 2090031104 Example 11400 of 34323 loss = 3.5066 nll loss = 2.1220 accu = 0.3735

Validating: Epoch 8 of 10 Step 38 ntokens 2090031104 Example 11700 of 34323 loss = 3.5104 nll loss = 2.1201 accu = 0.3743

Validating: Epoch 8 of 10 Step 39 ntokens 2090031104 Example 12000 of 34323 loss = 3.5072 nll loss = 2.1196 accu = 0.3744

Validating: Epoch 8 of 10 Step 40 ntokens 2090031104 Example 12300 of 34323 loss = 3.5099 nll loss = 2.1181 accu = 0.3750

Validating: Epoch 8 of 10 Step 41 ntokens 2090031104 Example 12600 of 34323 loss = 3.5121 nll loss = 2.1186 accu = 0.3749

Validating: Epoch 8 of 10 Step 42 ntokens 2090031104 Example 12900 of 34323 loss = 3.5157 nll loss = 2.1205 accu = 0.3743

Validating: Epoch 8 of 10 Step 43 ntokens 2090031104 Example 13200 of 34323 loss = 3.5152 nll loss = 2.1200 accu = 0.3745

Validating: Epoch 8 of 10 Step 44 ntokens 2090031104 Example 13500 of 34323 loss = 3.5146 nll loss = 2.1212 accu = 0.3740

Validating: Epoch 8 of 10 Step 45 ntokens 2090031104 Example 13800 of 34323 loss = 3.5139 nll loss = 2.1213 accu = 0.3740

Validating: Epoch 8 of 10 Step 46 ntokens 2090031104 Example 14100 of 34323 loss = 3.5158 nll loss = 2.1196 accu = 0.3745

Validating: Epoch 8 of 10 Step 47 ntokens 2090031104 Example 14400 of 34323 loss = 3.5160 nll loss = 2.1208 accu = 0.3741

Validating: Epoch 8 of 10 Step 48 ntokens 2090031104 Example 14700 of 34323 loss = 3.5149 nll loss = 2.1202 accu = 0.3743

Validating: Epoch 8 of 10 Step 49 ntokens 2090031104 Example 15000 of 34323 loss = 3.5145 nll loss = 2.1213 accu = 0.3740

Validating: Epoch 8 of 10 Step 50 ntokens 2090031104 Example 15300 of 34323 loss = 3.5145 nll loss = 2.1220 accu = 0.3737

Validating: Epoch 8 of 10 Step 51 ntokens 2090031104 Example 15600 of 34323 loss = 3.5130 nll loss = 2.1230 accu = 0.3734

Validating: Epoch 8 of 10 Step 52 ntokens 2090031104 Example 15900 of 34323 loss = 3.5135 nll loss = 2.1242 accu = 0.3731

Validating: Epoch 8 of 10 Step 53 ntokens 2090031104 Example 16200 of 34323 loss = 3.5115 nll loss = 2.1241 accu = 0.3732

Validating: Epoch 8 of 10 Step 54 ntokens 2090031104 Example 16500 of 34323 loss = 3.5120 nll loss = 2.1245 accu = 0.3731

Validating: Epoch 8 of 10 Step 55 ntokens 2090031104 Example 16800 of 34323 loss = 3.5128 nll loss = 2.1247 accu = 0.3730

Validating: Epoch 8 of 10 Step 56 ntokens 2090031104 Example 17100 of 34323 loss = 3.5126 nll loss = 2.1230 accu = 0.3736

Validating: Epoch 8 of 10 Step 57 ntokens 2090031104 Example 17400 of 34323 loss = 3.5139 nll loss = 2.1227 accu = 0.3737

Validating: Epoch 8 of 10 Step 58 ntokens 2090031104 Example 17700 of 34323 loss = 3.5120 nll loss = 2.1231 accu = 0.3736

Validating: Epoch 8 of 10 Step 59 ntokens 2090031104 Example 18000 of 34323 loss = 3.5109 nll loss = 2.1231 accu = 0.3736

Validating: Epoch 8 of 10 Step 60 ntokens 2090031104 Example 18300 of 34323 loss = 3.5099 nll loss = 2.1232 accu = 0.3735

Validating: Epoch 8 of 10 Step 61 ntokens 2090031104 Example 18600 of 34323 loss = 3.5093 nll loss = 2.1221 accu = 0.3738

Validating: Epoch 8 of 10 Step 62 ntokens 2090031104 Example 18900 of 34323 loss = 3.5104 nll loss = 2.1224 accu = 0.3738

Validating: Epoch 8 of 10 Step 63 ntokens 2090031104 Example 19200 of 34323 loss = 3.5092 nll loss = 2.1223 accu = 0.3738

Validating: Epoch 8 of 10 Step 64 ntokens 2090031104 Example 19500 of 34323 loss = 3.5092 nll loss = 2.1236 accu = 0.3734

Validating: Epoch 8 of 10 Step 65 ntokens 2090031104 Example 19800 of 34323 loss = 3.5091 nll loss = 2.1233 accu = 0.3735

Validating: Epoch 8 of 10 Step 66 ntokens 2090031104 Example 20100 of 34323 loss = 3.5081 nll loss = 2.1233 accu = 0.3735

Validating: Epoch 8 of 10 Step 67 ntokens 2090031104 Example 20400 of 34323 loss = 3.5091 nll loss = 2.1234 accu = 0.3734

Validating: Epoch 8 of 10 Step 68 ntokens 2090031104 Example 20700 of 34323 loss = 3.5086 nll loss = 2.1232 accu = 0.3734

Validating: Epoch 8 of 10 Step 69 ntokens 2090031104 Example 21000 of 34323 loss = 3.5081 nll loss = 2.1222 accu = 0.3738

Validating: Epoch 8 of 10 Step 70 ntokens 2090031104 Example 21300 of 34323 loss = 3.5070 nll loss = 2.1220 accu = 0.3738

Validating: Epoch 8 of 10 Step 71 ntokens 2090031104 Example 21600 of 34323 loss = 3.5062 nll loss = 2.1216 accu = 0.3739

Validating: Epoch 8 of 10 Step 72 ntokens 2090031104 Example 21900 of 34323 loss = 3.5086 nll loss = 2.1233 accu = 0.3734

Validating: Epoch 8 of 10 Step 73 ntokens 2090031104 Example 22200 of 34323 loss = 3.5079 nll loss = 2.1228 accu = 0.3735

Validating: Epoch 8 of 10 Step 74 ntokens 2090031104 Example 22500 of 34323 loss = 3.5079 nll loss = 2.1229 accu = 0.3734

Validating: Epoch 8 of 10 Step 75 ntokens 2090031104 Example 22800 of 34323 loss = 3.5086 nll loss = 2.1235 accu = 0.3732

Validating: Epoch 8 of 10 Step 76 ntokens 2090031104 Example 23100 of 34323 loss = 3.5099 nll loss = 2.1235 accu = 0.3732

Validating: Epoch 8 of 10 Step 77 ntokens 2090031104 Example 23400 of 34323 loss = 3.5102 nll loss = 2.1239 accu = 0.3731

Validating: Epoch 8 of 10 Step 78 ntokens 2090031104 Example 23700 of 34323 loss = 3.5097 nll loss = 2.1245 accu = 0.3729

Validating: Epoch 8 of 10 Step 79 ntokens 2090031104 Example 24000 of 34323 loss = 3.5101 nll loss = 2.1238 accu = 0.3731

Validating: Epoch 8 of 10 Step 80 ntokens 2090031104 Example 24300 of 34323 loss = 3.5099 nll loss = 2.1237 accu = 0.3731

Validating: Epoch 8 of 10 Step 81 ntokens 2090031104 Example 24600 of 34323 loss = 3.5105 nll loss = 2.1242 accu = 0.3729

Validating: Epoch 8 of 10 Step 82 ntokens 2090031104 Example 24900 of 34323 loss = 3.5103 nll loss = 2.1242 accu = 0.3729

Validating: Epoch 8 of 10 Step 83 ntokens 2090031104 Example 25200 of 34323 loss = 3.5101 nll loss = 2.1241 accu = 0.3729

Validating: Epoch 8 of 10 Step 84 ntokens 2090031104 Example 25500 of 34323 loss = 3.5103 nll loss = 2.1244 accu = 0.3728

Validating: Epoch 8 of 10 Step 85 ntokens 2090031104 Example 25800 of 34323 loss = 3.5102 nll loss = 2.1238 accu = 0.3730

Validating: Epoch 8 of 10 Step 86 ntokens 2090031104 Example 26100 of 34323 loss = 3.5105 nll loss = 2.1235 accu = 0.3731

Validating: Epoch 8 of 10 Step 87 ntokens 2090031104 Example 26400 of 34323 loss = 3.5106 nll loss = 2.1241 accu = 0.3729

Validating: Epoch 8 of 10 Step 88 ntokens 2090031104 Example 26700 of 34323 loss = 3.5097 nll loss = 2.1238 accu = 0.3730

Validating: Epoch 8 of 10 Step 89 ntokens 2090031104 Example 27000 of 34323 loss = 3.5089 nll loss = 2.1237 accu = 0.3730

Validating: Epoch 8 of 10 Step 90 ntokens 2090031104 Example 27300 of 34323 loss = 3.5108 nll loss = 2.1230 accu = 0.3732

Validating: Epoch 8 of 10 Step 91 ntokens 2090031104 Example 27600 of 34323 loss = 3.5104 nll loss = 2.1233 accu = 0.3731

Validating: Epoch 8 of 10 Step 92 ntokens 2090031104 Example 27900 of 34323 loss = 3.5115 nll loss = 2.1233 accu = 0.3731

Validating: Epoch 8 of 10 Step 93 ntokens 2090031104 Example 28200 of 34323 loss = 3.5117 nll loss = 2.1244 accu = 0.3727

Validating: Epoch 8 of 10 Step 94 ntokens 2090031104 Example 28500 of 34323 loss = 3.5130 nll loss = 2.1252 accu = 0.3724

Validating: Epoch 8 of 10 Step 95 ntokens 2090031104 Example 28800 of 34323 loss = 3.5141 nll loss = 2.1259 accu = 0.3722

Validating: Epoch 8 of 10 Step 96 ntokens 2090031104 Example 29100 of 34323 loss = 3.5135 nll loss = 2.1265 accu = 0.3720

Validating: Epoch 8 of 10 Step 97 ntokens 2090031104 Example 29400 of 34323 loss = 3.5134 nll loss = 2.1266 accu = 0.3719

Validating: Epoch 8 of 10 Step 98 ntokens 2090031104 Example 29700 of 34323 loss = 3.5135 nll loss = 2.1267 accu = 0.3719

Validating: Epoch 8 of 10 Step 99 ntokens 2090031104 Example 30000 of 34323 loss = 3.5118 nll loss = 2.1260 accu = 0.3721

Validating: Epoch 8 of 10 Step 100 ntokens 2090031104 Example 30300 of 34323 loss = 3.5121 nll loss = 2.1263 accu = 0.3720

Validating: Epoch 8 of 10 Step 101 ntokens 2090031104 Example 30600 of 34323 loss = 3.5123 nll loss = 2.1268 accu = 0.3718

Validating: Epoch 8 of 10 Step 102 ntokens 2090031104 Example 30900 of 34323 loss = 3.5127 nll loss = 2.1269 accu = 0.3717

Validating: Epoch 8 of 10 Step 103 ntokens 2090031104 Example 31200 of 34323 loss = 3.5133 nll loss = 2.1266 accu = 0.3719

Validating: Epoch 8 of 10 Step 104 ntokens 2090031104 Example 31500 of 34323 loss = 3.5139 nll loss = 2.1261 accu = 0.3720

Validating: Epoch 8 of 10 Step 105 ntokens 2090031104 Example 31800 of 34323 loss = 3.5135 nll loss = 2.1267 accu = 0.3718

Validating: Epoch 8 of 10 Step 106 ntokens 2090031104 Example 32100 of 34323 loss = 3.5126 nll loss = 2.1260 accu = 0.3720

Validating: Epoch 8 of 10 Step 107 ntokens 2090031104 Example 32400 of 34323 loss = 3.5121 nll loss = 2.1256 accu = 0.3721

Validating: Epoch 8 of 10 Step 108 ntokens 2090031104 Example 32700 of 34323 loss = 3.5123 nll loss = 2.1258 accu = 0.3721

Validating: Epoch 8 of 10 Step 109 ntokens 2090031104 Example 33000 of 34323 loss = 3.5111 nll loss = 2.1253 accu = 0.3722

Validating: Epoch 8 of 10 Step 110 ntokens 2090031104 Example 33300 of 34323 loss = 3.5116 nll loss = 2.1251 accu = 0.3723

Validating: Epoch 8 of 10 Step 111 ntokens 2090031104 Example 33600 of 34323 loss = 3.5106 nll loss = 2.1258 accu = 0.3720

Validating: Epoch 8 of 10 Step 112 ntokens 2090031104 Example 33900 of 34323 loss = 3.5113 nll loss = 2.1263 accu = 0.3718

Validating: Epoch 8 of 10 Step 113 ntokens 2090031104 Example 34200 of 34323 loss = 3.5111 nll loss = 2.1268 accu = 0.3716

Validating: Epoch 8 of 10 Step 114 ntokens 2090031104 Example 34323 of 34323 loss = 3.5116 nll loss = 2.1264 accu = 0.3717

Validation complete in 0:00:15.050142
Epoch complete in 0:02:30.180267
Training: Epoch 9 of 10 Step 3689 ntokens 4163769240 Example 300 of 138376 loss = 3.4926 nll loss = 2.0660 accu = 0.3914

Training: Epoch 9 of 10 Step 3690 ntokens 4163804640 Example 600 of 138376 loss = 3.4774 nll loss = 2.0776 accu = 0.3887

Training: Epoch 9 of 10 Step 3691 ntokens 4163840040 Example 900 of 138376 loss = 3.4930 nll loss = 2.0889 accu = 0.3846

Training: Epoch 9 of 10 Step 3692 ntokens 4163875440 Example 1200 of 138376 loss = 3.4794 nll loss = 2.0854 accu = 0.3858

Training: Epoch 9 of 10 Step 3693 ntokens 4163910840 Example 1500 of 138376 loss = 3.4715 nll loss = 2.0959 accu = 0.3829

Training: Epoch 9 of 10 Step 3694 ntokens 4163946240 Example 1800 of 138376 loss = 3.4813 nll loss = 2.1019 accu = 0.3806

Training: Epoch 9 of 10 Step 3695 ntokens 4163981640 Example 2100 of 138376 loss = 3.4722 nll loss = 2.1052 accu = 0.3792

Training: Epoch 9 of 10 Step 3696 ntokens 4164017040 Example 2400 of 138376 loss = 3.4737 nll loss = 2.1007 accu = 0.3806

Training: Epoch 9 of 10 Step 3697 ntokens 4164052440 Example 2700 of 138376 loss = 3.4849 nll loss = 2.0981 accu = 0.3817

Training: Epoch 9 of 10 Step 3698 ntokens 4164087840 Example 3000 of 138376 loss = 3.4865 nll loss = 2.1039 accu = 0.3795

Training: Epoch 9 of 10 Step 3699 ntokens 4164123240 Example 3300 of 138376 loss = 3.4862 nll loss = 2.1054 accu = 0.3792

Training: Epoch 9 of 10 Step 3700 ntokens 4164158640 Example 3600 of 138376 loss = 3.4900 nll loss = 2.1056 accu = 0.3787

Training: Epoch 9 of 10 Step 3701 ntokens 4164194040 Example 3900 of 138376 loss = 3.4896 nll loss = 2.1097 accu = 0.3772

Training: Epoch 9 of 10 Step 3702 ntokens 4164229440 Example 4200 of 138376 loss = 3.4942 nll loss = 2.1118 accu = 0.3768

Training: Epoch 9 of 10 Step 3703 ntokens 4164264840 Example 4500 of 138376 loss = 3.4892 nll loss = 2.1076 accu = 0.3784

Training: Epoch 9 of 10 Step 3704 ntokens 4164300240 Example 4800 of 138376 loss = 3.4931 nll loss = 2.1104 accu = 0.3773

Training: Epoch 9 of 10 Step 3705 ntokens 4164335640 Example 5100 of 138376 loss = 3.4910 nll loss = 2.1138 accu = 0.3760

Training: Epoch 9 of 10 Step 3706 ntokens 4164371040 Example 5400 of 138376 loss = 3.4930 nll loss = 2.1168 accu = 0.3751

Training: Epoch 9 of 10 Step 3707 ntokens 4164406440 Example 5700 of 138376 loss = 3.4918 nll loss = 2.1171 accu = 0.3750

Training: Epoch 9 of 10 Step 3708 ntokens 4164441840 Example 6000 of 138376 loss = 3.4941 nll loss = 2.1219 accu = 0.3734

Training: Epoch 9 of 10 Step 3709 ntokens 4164477240 Example 6300 of 138376 loss = 3.4986 nll loss = 2.1218 accu = 0.3734

Training: Epoch 9 of 10 Step 3710 ntokens 4164512640 Example 6600 of 138376 loss = 3.5007 nll loss = 2.1224 accu = 0.3732

Training: Epoch 9 of 10 Step 3711 ntokens 4164548040 Example 6900 of 138376 loss = 3.5031 nll loss = 2.1204 accu = 0.3740

Training: Epoch 9 of 10 Step 3712 ntokens 4164583440 Example 7200 of 138376 loss = 3.5027 nll loss = 2.1201 accu = 0.3740

Training: Epoch 9 of 10 Step 3713 ntokens 4164618840 Example 7500 of 138376 loss = 3.5066 nll loss = 2.1249 accu = 0.3723

Training: Epoch 9 of 10 Step 3714 ntokens 4164654240 Example 7800 of 138376 loss = 3.5010 nll loss = 2.1270 accu = 0.3715

Training: Epoch 9 of 10 Step 3715 ntokens 4164689640 Example 8100 of 138376 loss = 3.5021 nll loss = 2.1264 accu = 0.3718

Training: Epoch 9 of 10 Step 3716 ntokens 4164725040 Example 8400 of 138376 loss = 3.5024 nll loss = 2.1286 accu = 0.3710

Training: Epoch 9 of 10 Step 3717 ntokens 4164760440 Example 8700 of 138376 loss = 3.5031 nll loss = 2.1296 accu = 0.3707

Training: Epoch 9 of 10 Step 3718 ntokens 4164795840 Example 9000 of 138376 loss = 3.5004 nll loss = 2.1297 accu = 0.3707

Training: Epoch 9 of 10 Step 3719 ntokens 4164831240 Example 9300 of 138376 loss = 3.5011 nll loss = 2.1297 accu = 0.3707

Training: Epoch 9 of 10 Step 3720 ntokens 4164866640 Example 9600 of 138376 loss = 3.5003 nll loss = 2.1301 accu = 0.3707

Training: Epoch 9 of 10 Step 3721 ntokens 4164902040 Example 9900 of 138376 loss = 3.4990 nll loss = 2.1294 accu = 0.3708

Training: Epoch 9 of 10 Step 3722 ntokens 4164937440 Example 10200 of 138376 loss = 3.4997 nll loss = 2.1278 accu = 0.3714

Training: Epoch 9 of 10 Step 3723 ntokens 4164972840 Example 10500 of 138376 loss = 3.4997 nll loss = 2.1277 accu = 0.3714

Training: Epoch 9 of 10 Step 3724 ntokens 4165008240 Example 10800 of 138376 loss = 3.4985 nll loss = 2.1302 accu = 0.3706

Training: Epoch 9 of 10 Step 3725 ntokens 4165043640 Example 11100 of 138376 loss = 3.4981 nll loss = 2.1307 accu = 0.3704

Training: Epoch 9 of 10 Step 3726 ntokens 4165079040 Example 11400 of 138376 loss = 3.4994 nll loss = 2.1313 accu = 0.3701

Training: Epoch 9 of 10 Step 3727 ntokens 4165114440 Example 11700 of 138376 loss = 3.4983 nll loss = 2.1308 accu = 0.3703

Training: Epoch 9 of 10 Step 3728 ntokens 4165149840 Example 12000 of 138376 loss = 3.4997 nll loss = 2.1313 accu = 0.3702

Training: Epoch 9 of 10 Step 3729 ntokens 4165185240 Example 12300 of 138376 loss = 3.5011 nll loss = 2.1298 accu = 0.3707

Training: Epoch 9 of 10 Step 3730 ntokens 4165220640 Example 12600 of 138376 loss = 3.5019 nll loss = 2.1292 accu = 0.3710

Training: Epoch 9 of 10 Step 3731 ntokens 4165256040 Example 12900 of 138376 loss = 3.4999 nll loss = 2.1291 accu = 0.3710

Training: Epoch 9 of 10 Step 3732 ntokens 4165291440 Example 13200 of 138376 loss = 3.5008 nll loss = 2.1299 accu = 0.3708

Training: Epoch 9 of 10 Step 3733 ntokens 4165326840 Example 13500 of 138376 loss = 3.4999 nll loss = 2.1283 accu = 0.3713

Training: Epoch 9 of 10 Step 3734 ntokens 4165362240 Example 13800 of 138376 loss = 3.4993 nll loss = 2.1278 accu = 0.3714

Training: Epoch 9 of 10 Step 3735 ntokens 4165397640 Example 14100 of 138376 loss = 3.5019 nll loss = 2.1291 accu = 0.3710

Training: Epoch 9 of 10 Step 3736 ntokens 4165433040 Example 14400 of 138376 loss = 3.5020 nll loss = 2.1289 accu = 0.3711

Training: Epoch 9 of 10 Step 3737 ntokens 4165468440 Example 14700 of 138376 loss = 3.5008 nll loss = 2.1286 accu = 0.3712

Training: Epoch 9 of 10 Step 3738 ntokens 4165503840 Example 15000 of 138376 loss = 3.5021 nll loss = 2.1297 accu = 0.3708

Training: Epoch 9 of 10 Step 3739 ntokens 4165539240 Example 15300 of 138376 loss = 3.5013 nll loss = 2.1301 accu = 0.3707

Training: Epoch 9 of 10 Step 3740 ntokens 4165574640 Example 15600 of 138376 loss = 3.5030 nll loss = 2.1308 accu = 0.3704

Training: Epoch 9 of 10 Step 3741 ntokens 4165610040 Example 15900 of 138376 loss = 3.5046 nll loss = 2.1298 accu = 0.3707

Training: Epoch 9 of 10 Step 3742 ntokens 4165645440 Example 16200 of 138376 loss = 3.5042 nll loss = 2.1309 accu = 0.3704

Training: Epoch 9 of 10 Step 3743 ntokens 4165680840 Example 16500 of 138376 loss = 3.5057 nll loss = 2.1300 accu = 0.3707

Training: Epoch 9 of 10 Step 3744 ntokens 4165716240 Example 16800 of 138376 loss = 3.5068 nll loss = 2.1302 accu = 0.3706

Training: Epoch 9 of 10 Step 3745 ntokens 4165751640 Example 17100 of 138376 loss = 3.5097 nll loss = 2.1298 accu = 0.3707

Training: Epoch 9 of 10 Step 3746 ntokens 4165787040 Example 17400 of 138376 loss = 3.5105 nll loss = 2.1304 accu = 0.3705

Training: Epoch 9 of 10 Step 3747 ntokens 4165822440 Example 17700 of 138376 loss = 3.5108 nll loss = 2.1297 accu = 0.3708

Training: Epoch 9 of 10 Step 3748 ntokens 4165857840 Example 18000 of 138376 loss = 3.5110 nll loss = 2.1298 accu = 0.3708

Training: Epoch 9 of 10 Step 3749 ntokens 4165893240 Example 18300 of 138376 loss = 3.5132 nll loss = 2.1301 accu = 0.3707

Training: Epoch 9 of 10 Step 3750 ntokens 4165928640 Example 18600 of 138376 loss = 3.5160 nll loss = 2.1311 accu = 0.3703

Training: Epoch 9 of 10 Step 3751 ntokens 4165964040 Example 18900 of 138376 loss = 3.5135 nll loss = 2.1312 accu = 0.3702

Training: Epoch 9 of 10 Step 3752 ntokens 4165999440 Example 19200 of 138376 loss = 3.5138 nll loss = 2.1312 accu = 0.3702

Training: Epoch 9 of 10 Step 3753 ntokens 4166034840 Example 19500 of 138376 loss = 3.5154 nll loss = 2.1314 accu = 0.3701

Training: Epoch 9 of 10 Step 3754 ntokens 4166070240 Example 19800 of 138376 loss = 3.5158 nll loss = 2.1323 accu = 0.3698

Training: Epoch 9 of 10 Step 3755 ntokens 4166105640 Example 20100 of 138376 loss = 3.5148 nll loss = 2.1315 accu = 0.3701

Training: Epoch 9 of 10 Step 3756 ntokens 4166141040 Example 20400 of 138376 loss = 3.5152 nll loss = 2.1311 accu = 0.3703

Training: Epoch 9 of 10 Step 3757 ntokens 4166176440 Example 20700 of 138376 loss = 3.5172 nll loss = 2.1309 accu = 0.3704

Training: Epoch 9 of 10 Step 3758 ntokens 4166211840 Example 21000 of 138376 loss = 3.5178 nll loss = 2.1309 accu = 0.3705

Training: Epoch 9 of 10 Step 3759 ntokens 4166247240 Example 21300 of 138376 loss = 3.5161 nll loss = 2.1301 accu = 0.3707

Training: Epoch 9 of 10 Step 3760 ntokens 4166282640 Example 21600 of 138376 loss = 3.5160 nll loss = 2.1310 accu = 0.3704

Training: Epoch 9 of 10 Step 3761 ntokens 4166318040 Example 21900 of 138376 loss = 3.5152 nll loss = 2.1311 accu = 0.3705

Training: Epoch 9 of 10 Step 3762 ntokens 4166353440 Example 22200 of 138376 loss = 3.5166 nll loss = 2.1305 accu = 0.3706

Training: Epoch 9 of 10 Step 3763 ntokens 4166388840 Example 22500 of 138376 loss = 3.5164 nll loss = 2.1306 accu = 0.3706

Training: Epoch 9 of 10 Step 3764 ntokens 4166424240 Example 22800 of 138376 loss = 3.5155 nll loss = 2.1310 accu = 0.3705

Training: Epoch 9 of 10 Step 3765 ntokens 4166459640 Example 23100 of 138376 loss = 3.5154 nll loss = 2.1310 accu = 0.3705

Training: Epoch 9 of 10 Step 3766 ntokens 4166495040 Example 23400 of 138376 loss = 3.5151 nll loss = 2.1312 accu = 0.3704

Training: Epoch 9 of 10 Step 3767 ntokens 4166530440 Example 23700 of 138376 loss = 3.5155 nll loss = 2.1313 accu = 0.3704

Training: Epoch 9 of 10 Step 3768 ntokens 4166565840 Example 24000 of 138376 loss = 3.5149 nll loss = 2.1318 accu = 0.3703

Training: Epoch 9 of 10 Step 3769 ntokens 4166601240 Example 24300 of 138376 loss = 3.5148 nll loss = 2.1313 accu = 0.3705

Training: Epoch 9 of 10 Step 3770 ntokens 4166636640 Example 24600 of 138376 loss = 3.5150 nll loss = 2.1303 accu = 0.3708

Training: Epoch 9 of 10 Step 3771 ntokens 4166672040 Example 24900 of 138376 loss = 3.5143 nll loss = 2.1301 accu = 0.3709

Training: Epoch 9 of 10 Step 3772 ntokens 4166707440 Example 25200 of 138376 loss = 3.5164 nll loss = 2.1310 accu = 0.3706

Training: Epoch 9 of 10 Step 3773 ntokens 4166742840 Example 25500 of 138376 loss = 3.5156 nll loss = 2.1307 accu = 0.3707

Training: Epoch 9 of 10 Step 3774 ntokens 4166778240 Example 25800 of 138376 loss = 3.5157 nll loss = 2.1298 accu = 0.3711

Training: Epoch 9 of 10 Step 3775 ntokens 4166813640 Example 26100 of 138376 loss = 3.5147 nll loss = 2.1306 accu = 0.3708

Training: Epoch 9 of 10 Step 3776 ntokens 4166849040 Example 26400 of 138376 loss = 3.5146 nll loss = 2.1308 accu = 0.3707

Training: Epoch 9 of 10 Step 3777 ntokens 4166884440 Example 26700 of 138376 loss = 3.5147 nll loss = 2.1311 accu = 0.3706

Training: Epoch 9 of 10 Step 3778 ntokens 4166919840 Example 27000 of 138376 loss = 3.5140 nll loss = 2.1304 accu = 0.3708

Training: Epoch 9 of 10 Step 3779 ntokens 4166955240 Example 27300 of 138376 loss = 3.5136 nll loss = 2.1298 accu = 0.3710

Training: Epoch 9 of 10 Step 3780 ntokens 4166990640 Example 27600 of 138376 loss = 3.5141 nll loss = 2.1295 accu = 0.3711

Training: Epoch 9 of 10 Step 3781 ntokens 4167026040 Example 27900 of 138376 loss = 3.5133 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 3782 ntokens 4167061440 Example 28200 of 138376 loss = 3.5130 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 3783 ntokens 4167096840 Example 28500 of 138376 loss = 3.5143 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 3784 ntokens 4167132240 Example 28800 of 138376 loss = 3.5142 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 3785 ntokens 4167167640 Example 29100 of 138376 loss = 3.5127 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 3786 ntokens 4167203040 Example 29400 of 138376 loss = 3.5131 nll loss = 2.1297 accu = 0.3710

Training: Epoch 9 of 10 Step 3787 ntokens 4167238440 Example 29700 of 138376 loss = 3.5131 nll loss = 2.1296 accu = 0.3710

Training: Epoch 9 of 10 Step 3788 ntokens 4167273840 Example 30000 of 138376 loss = 3.5119 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 3789 ntokens 4167309240 Example 30300 of 138376 loss = 3.5124 nll loss = 2.1296 accu = 0.3710

Training: Epoch 9 of 10 Step 3790 ntokens 4167344640 Example 30600 of 138376 loss = 3.5121 nll loss = 2.1298 accu = 0.3709

Training: Epoch 9 of 10 Step 3791 ntokens 4167380040 Example 30900 of 138376 loss = 3.5105 nll loss = 2.1300 accu = 0.3709

Training: Epoch 9 of 10 Step 3792 ntokens 4167415440 Example 31200 of 138376 loss = 3.5102 nll loss = 2.1308 accu = 0.3706

Training: Epoch 9 of 10 Step 3793 ntokens 4167450840 Example 31500 of 138376 loss = 3.5095 nll loss = 2.1309 accu = 0.3705

Training: Epoch 9 of 10 Step 3794 ntokens 4167486240 Example 31800 of 138376 loss = 3.5088 nll loss = 2.1317 accu = 0.3702

Training: Epoch 9 of 10 Step 3795 ntokens 4167521640 Example 32100 of 138376 loss = 3.5100 nll loss = 2.1313 accu = 0.3704

Training: Epoch 9 of 10 Step 3796 ntokens 4167557040 Example 32400 of 138376 loss = 3.5088 nll loss = 2.1321 accu = 0.3701

Training: Epoch 9 of 10 Step 3797 ntokens 4167592440 Example 32700 of 138376 loss = 3.5089 nll loss = 2.1319 accu = 0.3702

Training: Epoch 9 of 10 Step 3798 ntokens 4167627840 Example 33000 of 138376 loss = 3.5090 nll loss = 2.1318 accu = 0.3702

Training: Epoch 9 of 10 Step 3799 ntokens 4167663240 Example 33300 of 138376 loss = 3.5082 nll loss = 2.1316 accu = 0.3703

Training: Epoch 9 of 10 Step 3800 ntokens 4167698640 Example 33600 of 138376 loss = 3.5073 nll loss = 2.1318 accu = 0.3703

Training: Epoch 9 of 10 Step 3801 ntokens 4167734040 Example 33900 of 138376 loss = 3.5074 nll loss = 2.1318 accu = 0.3703

Training: Epoch 9 of 10 Step 3802 ntokens 4167769440 Example 34200 of 138376 loss = 3.5066 nll loss = 2.1316 accu = 0.3703

Training: Epoch 9 of 10 Step 3803 ntokens 4167804840 Example 34500 of 138376 loss = 3.5071 nll loss = 2.1313 accu = 0.3704

Training: Epoch 9 of 10 Step 3804 ntokens 4167840240 Example 34800 of 138376 loss = 3.5072 nll loss = 2.1309 accu = 0.3706

Training: Epoch 9 of 10 Step 3805 ntokens 4167875640 Example 35100 of 138376 loss = 3.5076 nll loss = 2.1308 accu = 0.3706

Training: Epoch 9 of 10 Step 3806 ntokens 4167911040 Example 35400 of 138376 loss = 3.5068 nll loss = 2.1312 accu = 0.3704

Training: Epoch 9 of 10 Step 3807 ntokens 4167946440 Example 35700 of 138376 loss = 3.5069 nll loss = 2.1319 accu = 0.3702

Training: Epoch 9 of 10 Step 3808 ntokens 4167981840 Example 36000 of 138376 loss = 3.5069 nll loss = 2.1319 accu = 0.3702

Training: Epoch 9 of 10 Step 3809 ntokens 4168017240 Example 36300 of 138376 loss = 3.5076 nll loss = 2.1316 accu = 0.3703

Training: Epoch 9 of 10 Step 3810 ntokens 4168052640 Example 36600 of 138376 loss = 3.5078 nll loss = 2.1315 accu = 0.3704

Training: Epoch 9 of 10 Step 3811 ntokens 4168088040 Example 36900 of 138376 loss = 3.5073 nll loss = 2.1314 accu = 0.3704

Training: Epoch 9 of 10 Step 3812 ntokens 4168123440 Example 37200 of 138376 loss = 3.5072 nll loss = 2.1313 accu = 0.3704

Training: Epoch 9 of 10 Step 3813 ntokens 4168158840 Example 37500 of 138376 loss = 3.5072 nll loss = 2.1306 accu = 0.3706

Training: Epoch 9 of 10 Step 3814 ntokens 4168194240 Example 37800 of 138376 loss = 3.5077 nll loss = 2.1310 accu = 0.3705

Training: Epoch 9 of 10 Step 3815 ntokens 4168229640 Example 38100 of 138376 loss = 3.5086 nll loss = 2.1314 accu = 0.3703

Training: Epoch 9 of 10 Step 3816 ntokens 4168265040 Example 38400 of 138376 loss = 3.5078 nll loss = 2.1319 accu = 0.3702

Training: Epoch 9 of 10 Step 3817 ntokens 4168300440 Example 38700 of 138376 loss = 3.5082 nll loss = 2.1313 accu = 0.3703

Training: Epoch 9 of 10 Step 3818 ntokens 4168335840 Example 39000 of 138376 loss = 3.5074 nll loss = 2.1313 accu = 0.3703

Training: Epoch 9 of 10 Step 3819 ntokens 4168371240 Example 39300 of 138376 loss = 3.5076 nll loss = 2.1314 accu = 0.3703

Training: Epoch 9 of 10 Step 3820 ntokens 4168406640 Example 39600 of 138376 loss = 3.5082 nll loss = 2.1313 accu = 0.3703

Training: Epoch 9 of 10 Step 3821 ntokens 4168442040 Example 39900 of 138376 loss = 3.5080 nll loss = 2.1317 accu = 0.3702

Training: Epoch 9 of 10 Step 3822 ntokens 4168477440 Example 40200 of 138376 loss = 3.5076 nll loss = 2.1313 accu = 0.3703

Training: Epoch 9 of 10 Step 3823 ntokens 4168512840 Example 40500 of 138376 loss = 3.5072 nll loss = 2.1307 accu = 0.3705

Training: Epoch 9 of 10 Step 3824 ntokens 4168548240 Example 40800 of 138376 loss = 3.5070 nll loss = 2.1308 accu = 0.3705

Training: Epoch 9 of 10 Step 3825 ntokens 4168583640 Example 41100 of 138376 loss = 3.5068 nll loss = 2.1311 accu = 0.3704

Training: Epoch 9 of 10 Step 3826 ntokens 4168619040 Example 41400 of 138376 loss = 3.5075 nll loss = 2.1307 accu = 0.3705

Training: Epoch 9 of 10 Step 3827 ntokens 4168654440 Example 41700 of 138376 loss = 3.5072 nll loss = 2.1302 accu = 0.3707

Training: Epoch 9 of 10 Step 3828 ntokens 4168689840 Example 42000 of 138376 loss = 3.5065 nll loss = 2.1303 accu = 0.3706

Training: Epoch 9 of 10 Step 3829 ntokens 4168725240 Example 42300 of 138376 loss = 3.5067 nll loss = 2.1304 accu = 0.3706

Training: Epoch 9 of 10 Step 3830 ntokens 4168760640 Example 42600 of 138376 loss = 3.5061 nll loss = 2.1303 accu = 0.3707

Training: Epoch 9 of 10 Step 3831 ntokens 4168796040 Example 42900 of 138376 loss = 3.5067 nll loss = 2.1295 accu = 0.3710

Training: Epoch 9 of 10 Step 3832 ntokens 4168831440 Example 43200 of 138376 loss = 3.5064 nll loss = 2.1297 accu = 0.3709

Training: Epoch 9 of 10 Step 3833 ntokens 4168866840 Example 43500 of 138376 loss = 3.5061 nll loss = 2.1291 accu = 0.3711

Training: Epoch 9 of 10 Step 3834 ntokens 4168902240 Example 43800 of 138376 loss = 3.5062 nll loss = 2.1294 accu = 0.3710

Training: Epoch 9 of 10 Step 3835 ntokens 4168937640 Example 44100 of 138376 loss = 3.5060 nll loss = 2.1294 accu = 0.3710

Training: Epoch 9 of 10 Step 3836 ntokens 4168973040 Example 44400 of 138376 loss = 3.5060 nll loss = 2.1293 accu = 0.3710

Training: Epoch 9 of 10 Step 3837 ntokens 4169008440 Example 44700 of 138376 loss = 3.5060 nll loss = 2.1296 accu = 0.3709

Training: Epoch 9 of 10 Step 3838 ntokens 4169043840 Example 45000 of 138376 loss = 3.5058 nll loss = 2.1300 accu = 0.3708

Training: Epoch 9 of 10 Step 3839 ntokens 4169079240 Example 45300 of 138376 loss = 3.5058 nll loss = 2.1300 accu = 0.3708

Training: Epoch 9 of 10 Step 3840 ntokens 4169114640 Example 45600 of 138376 loss = 3.5058 nll loss = 2.1300 accu = 0.3708

Training: Epoch 9 of 10 Step 3841 ntokens 4169150040 Example 45900 of 138376 loss = 3.5058 nll loss = 2.1301 accu = 0.3708

Training: Epoch 9 of 10 Step 3842 ntokens 4169185440 Example 46200 of 138376 loss = 3.5057 nll loss = 2.1298 accu = 0.3708

Training: Epoch 9 of 10 Step 3843 ntokens 4169220840 Example 46500 of 138376 loss = 3.5061 nll loss = 2.1296 accu = 0.3709

Training: Epoch 9 of 10 Step 3844 ntokens 4169256240 Example 46800 of 138376 loss = 3.5064 nll loss = 2.1291 accu = 0.3711

Training: Epoch 9 of 10 Step 3845 ntokens 4169291640 Example 47100 of 138376 loss = 3.5067 nll loss = 2.1293 accu = 0.3711

Training: Epoch 9 of 10 Step 3846 ntokens 4169327040 Example 47400 of 138376 loss = 3.5064 nll loss = 2.1287 accu = 0.3712

Training: Epoch 9 of 10 Step 3847 ntokens 4169362440 Example 47700 of 138376 loss = 3.5062 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3848 ntokens 4169397840 Example 48000 of 138376 loss = 3.5055 nll loss = 2.1280 accu = 0.3714

Training: Epoch 9 of 10 Step 3849 ntokens 4169433240 Example 48300 of 138376 loss = 3.5059 nll loss = 2.1282 accu = 0.3714

Training: Epoch 9 of 10 Step 3850 ntokens 4169468640 Example 48600 of 138376 loss = 3.5057 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3851 ntokens 4169504040 Example 48900 of 138376 loss = 3.5051 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3852 ntokens 4169539440 Example 49200 of 138376 loss = 3.5059 nll loss = 2.1278 accu = 0.3715

Training: Epoch 9 of 10 Step 3853 ntokens 4169574840 Example 49500 of 138376 loss = 3.5062 nll loss = 2.1275 accu = 0.3716

Training: Epoch 9 of 10 Step 3854 ntokens 4169610240 Example 49800 of 138376 loss = 3.5065 nll loss = 2.1276 accu = 0.3716

Training: Epoch 9 of 10 Step 3855 ntokens 4169645640 Example 50100 of 138376 loss = 3.5070 nll loss = 2.1278 accu = 0.3715

Training: Epoch 9 of 10 Step 3856 ntokens 4169681040 Example 50400 of 138376 loss = 3.5070 nll loss = 2.1277 accu = 0.3716

Training: Epoch 9 of 10 Step 3857 ntokens 4169716440 Example 50700 of 138376 loss = 3.5075 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3858 ntokens 4169751840 Example 51000 of 138376 loss = 3.5075 nll loss = 2.1281 accu = 0.3715

Training: Epoch 9 of 10 Step 3859 ntokens 4169787240 Example 51300 of 138376 loss = 3.5077 nll loss = 2.1278 accu = 0.3716

Training: Epoch 9 of 10 Step 3860 ntokens 4169822640 Example 51600 of 138376 loss = 3.5078 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3861 ntokens 4169858040 Example 51900 of 138376 loss = 3.5079 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3862 ntokens 4169893440 Example 52200 of 138376 loss = 3.5082 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3863 ntokens 4169928840 Example 52500 of 138376 loss = 3.5080 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3864 ntokens 4169964240 Example 52800 of 138376 loss = 3.5081 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3865 ntokens 4169999640 Example 53100 of 138376 loss = 3.5076 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3866 ntokens 4170035040 Example 53400 of 138376 loss = 3.5072 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3867 ntokens 4170070440 Example 53700 of 138376 loss = 3.5070 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3868 ntokens 4170105840 Example 54000 of 138376 loss = 3.5061 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3869 ntokens 4170141240 Example 54300 of 138376 loss = 3.5052 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3870 ntokens 4170176640 Example 54600 of 138376 loss = 3.5048 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3871 ntokens 4170212040 Example 54900 of 138376 loss = 3.5053 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3872 ntokens 4170247440 Example 55200 of 138376 loss = 3.5059 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3873 ntokens 4170282840 Example 55500 of 138376 loss = 3.5050 nll loss = 2.1278 accu = 0.3716

Training: Epoch 9 of 10 Step 3874 ntokens 4170318240 Example 55800 of 138376 loss = 3.5049 nll loss = 2.1279 accu = 0.3716

Training: Epoch 9 of 10 Step 3875 ntokens 4170353640 Example 56100 of 138376 loss = 3.5042 nll loss = 2.1281 accu = 0.3715

Training: Epoch 9 of 10 Step 3876 ntokens 4170389040 Example 56400 of 138376 loss = 3.5040 nll loss = 2.1280 accu = 0.3716

Training: Epoch 9 of 10 Step 3877 ntokens 4170424440 Example 56700 of 138376 loss = 3.5040 nll loss = 2.1279 accu = 0.3716

Training: Epoch 9 of 10 Step 3878 ntokens 4170459840 Example 57000 of 138376 loss = 3.5043 nll loss = 2.1279 accu = 0.3716

Training: Epoch 9 of 10 Step 3879 ntokens 4170495240 Example 57300 of 138376 loss = 3.5040 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3880 ntokens 4170530640 Example 57600 of 138376 loss = 3.5036 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3881 ntokens 4170566040 Example 57900 of 138376 loss = 3.5037 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3882 ntokens 4170601440 Example 58200 of 138376 loss = 3.5033 nll loss = 2.1288 accu = 0.3713

Training: Epoch 9 of 10 Step 3883 ntokens 4170636840 Example 58500 of 138376 loss = 3.5037 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3884 ntokens 4170672240 Example 58800 of 138376 loss = 3.5034 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3885 ntokens 4170707640 Example 59100 of 138376 loss = 3.5030 nll loss = 2.1282 accu = 0.3714

Training: Epoch 9 of 10 Step 3886 ntokens 4170743040 Example 59400 of 138376 loss = 3.5033 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3887 ntokens 4170778440 Example 59700 of 138376 loss = 3.5031 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3888 ntokens 4170813840 Example 60000 of 138376 loss = 3.5026 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3889 ntokens 4170849240 Example 60300 of 138376 loss = 3.5031 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3890 ntokens 4170884640 Example 60600 of 138376 loss = 3.5030 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3891 ntokens 4170920040 Example 60900 of 138376 loss = 3.5028 nll loss = 2.1289 accu = 0.3712

Training: Epoch 9 of 10 Step 3892 ntokens 4170955440 Example 61200 of 138376 loss = 3.5026 nll loss = 2.1290 accu = 0.3712

Training: Epoch 9 of 10 Step 3893 ntokens 4170990840 Example 61500 of 138376 loss = 3.5023 nll loss = 2.1290 accu = 0.3711

Training: Epoch 9 of 10 Step 3894 ntokens 4171026240 Example 61800 of 138376 loss = 3.5021 nll loss = 2.1289 accu = 0.3712

Training: Epoch 9 of 10 Step 3895 ntokens 4171061640 Example 62100 of 138376 loss = 3.5016 nll loss = 2.1287 accu = 0.3712

Training: Epoch 9 of 10 Step 3896 ntokens 4171097040 Example 62400 of 138376 loss = 3.5012 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3897 ntokens 4171132440 Example 62700 of 138376 loss = 3.5015 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3898 ntokens 4171167840 Example 63000 of 138376 loss = 3.5017 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3899 ntokens 4171203240 Example 63300 of 138376 loss = 3.5017 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3900 ntokens 4171238640 Example 63600 of 138376 loss = 3.5013 nll loss = 2.1284 accu = 0.3713

Training: Epoch 9 of 10 Step 3901 ntokens 4171274040 Example 63900 of 138376 loss = 3.5014 nll loss = 2.1282 accu = 0.3714

Training: Epoch 9 of 10 Step 3902 ntokens 4171309440 Example 64200 of 138376 loss = 3.5010 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3903 ntokens 4171344840 Example 64500 of 138376 loss = 3.5011 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3904 ntokens 4171380240 Example 64800 of 138376 loss = 3.5010 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3905 ntokens 4171415640 Example 65100 of 138376 loss = 3.5010 nll loss = 2.1281 accu = 0.3714

Training: Epoch 9 of 10 Step 3906 ntokens 4171451040 Example 65400 of 138376 loss = 3.5010 nll loss = 2.1281 accu = 0.3715

Training: Epoch 9 of 10 Step 3907 ntokens 4171486440 Example 65700 of 138376 loss = 3.5007 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3908 ntokens 4171521840 Example 66000 of 138376 loss = 3.5005 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3909 ntokens 4171557240 Example 66300 of 138376 loss = 3.5008 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3910 ntokens 4171592640 Example 66600 of 138376 loss = 3.5007 nll loss = 2.1285 accu = 0.3713

Training: Epoch 9 of 10 Step 3911 ntokens 4171628040 Example 66900 of 138376 loss = 3.5010 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3912 ntokens 4171663440 Example 67200 of 138376 loss = 3.5008 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3913 ntokens 4171698840 Example 67500 of 138376 loss = 3.5003 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3914 ntokens 4171734240 Example 67800 of 138376 loss = 3.5001 nll loss = 2.1281 accu = 0.3714

Training: Epoch 9 of 10 Step 3915 ntokens 4171769640 Example 68100 of 138376 loss = 3.4999 nll loss = 2.1281 accu = 0.3715

Training: Epoch 9 of 10 Step 3916 ntokens 4171805040 Example 68400 of 138376 loss = 3.5002 nll loss = 2.1284 accu = 0.3713

Training: Epoch 9 of 10 Step 3917 ntokens 4171840440 Example 68700 of 138376 loss = 3.5005 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3918 ntokens 4171875840 Example 69000 of 138376 loss = 3.5006 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3919 ntokens 4171911240 Example 69300 of 138376 loss = 3.5003 nll loss = 2.1288 accu = 0.3712

Training: Epoch 9 of 10 Step 3920 ntokens 4171946640 Example 69600 of 138376 loss = 3.4999 nll loss = 2.1284 accu = 0.3713

Training: Epoch 9 of 10 Step 3921 ntokens 4171982040 Example 69900 of 138376 loss = 3.4998 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3922 ntokens 4172017440 Example 70200 of 138376 loss = 3.4995 nll loss = 2.1281 accu = 0.3714

Training: Epoch 9 of 10 Step 3923 ntokens 4172052840 Example 70500 of 138376 loss = 3.4996 nll loss = 2.1279 accu = 0.3715

Training: Epoch 9 of 10 Step 3924 ntokens 4172088240 Example 70800 of 138376 loss = 3.4994 nll loss = 2.1278 accu = 0.3716

Training: Epoch 9 of 10 Step 3925 ntokens 4172123640 Example 71100 of 138376 loss = 3.4994 nll loss = 2.1277 accu = 0.3716

Training: Epoch 9 of 10 Step 3926 ntokens 4172159040 Example 71400 of 138376 loss = 3.4996 nll loss = 2.1277 accu = 0.3716

Training: Epoch 9 of 10 Step 3927 ntokens 4172194440 Example 71700 of 138376 loss = 3.4995 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3928 ntokens 4172229840 Example 72000 of 138376 loss = 3.4997 nll loss = 2.1280 accu = 0.3715

Training: Epoch 9 of 10 Step 3929 ntokens 4172265240 Example 72300 of 138376 loss = 3.4995 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3930 ntokens 4172300640 Example 72600 of 138376 loss = 3.4996 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3931 ntokens 4172336040 Example 72900 of 138376 loss = 3.4996 nll loss = 2.1281 accu = 0.3715

Training: Epoch 9 of 10 Step 3932 ntokens 4172371440 Example 73200 of 138376 loss = 3.4997 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3933 ntokens 4172406840 Example 73500 of 138376 loss = 3.4994 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3934 ntokens 4172442240 Example 73800 of 138376 loss = 3.4996 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3935 ntokens 4172477640 Example 74100 of 138376 loss = 3.4998 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3936 ntokens 4172513040 Example 74400 of 138376 loss = 3.5000 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 3937 ntokens 4172548440 Example 74700 of 138376 loss = 3.5001 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3938 ntokens 4172583840 Example 75000 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3939 ntokens 4172619240 Example 75300 of 138376 loss = 3.5005 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3940 ntokens 4172654640 Example 75600 of 138376 loss = 3.5007 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3941 ntokens 4172690040 Example 75900 of 138376 loss = 3.5009 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3942 ntokens 4172725440 Example 76200 of 138376 loss = 3.5010 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3943 ntokens 4172760840 Example 76500 of 138376 loss = 3.5006 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3944 ntokens 4172796240 Example 76800 of 138376 loss = 3.5007 nll loss = 2.1286 accu = 0.3713

Training: Epoch 9 of 10 Step 3945 ntokens 4172831640 Example 77100 of 138376 loss = 3.5011 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3946 ntokens 4172867040 Example 77400 of 138376 loss = 3.5014 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3947 ntokens 4172902440 Example 77700 of 138376 loss = 3.5011 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3948 ntokens 4172937840 Example 78000 of 138376 loss = 3.5015 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 3949 ntokens 4172973240 Example 78300 of 138376 loss = 3.5017 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3950 ntokens 4173008640 Example 78600 of 138376 loss = 3.5017 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3951 ntokens 4173044040 Example 78900 of 138376 loss = 3.5017 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3952 ntokens 4173079440 Example 79200 of 138376 loss = 3.5015 nll loss = 2.1281 accu = 0.3715

Training: Epoch 9 of 10 Step 3953 ntokens 4173114840 Example 79500 of 138376 loss = 3.5019 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3954 ntokens 4173150240 Example 79800 of 138376 loss = 3.5022 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3955 ntokens 4173185640 Example 80100 of 138376 loss = 3.5018 nll loss = 2.1283 accu = 0.3714

Training: Epoch 9 of 10 Step 3956 ntokens 4173221040 Example 80400 of 138376 loss = 3.5019 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3957 ntokens 4173256440 Example 80700 of 138376 loss = 3.5018 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3958 ntokens 4173291840 Example 81000 of 138376 loss = 3.5017 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3959 ntokens 4173327240 Example 81300 of 138376 loss = 3.5014 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3960 ntokens 4173362640 Example 81600 of 138376 loss = 3.5015 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3961 ntokens 4173398040 Example 81900 of 138376 loss = 3.5016 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3962 ntokens 4173433440 Example 82200 of 138376 loss = 3.5015 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3963 ntokens 4173468840 Example 82500 of 138376 loss = 3.5014 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3964 ntokens 4173504240 Example 82800 of 138376 loss = 3.5014 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3965 ntokens 4173539640 Example 83100 of 138376 loss = 3.5016 nll loss = 2.1287 accu = 0.3713

Training: Epoch 9 of 10 Step 3966 ntokens 4173575040 Example 83400 of 138376 loss = 3.5014 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 3967 ntokens 4173610440 Example 83700 of 138376 loss = 3.5015 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3968 ntokens 4173645840 Example 84000 of 138376 loss = 3.5016 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3969 ntokens 4173681240 Example 84300 of 138376 loss = 3.5014 nll loss = 2.1287 accu = 0.3713

Training: Epoch 9 of 10 Step 3970 ntokens 4173716640 Example 84600 of 138376 loss = 3.5017 nll loss = 2.1288 accu = 0.3713

Training: Epoch 9 of 10 Step 3971 ntokens 4173752040 Example 84900 of 138376 loss = 3.5012 nll loss = 2.1289 accu = 0.3712

Training: Epoch 9 of 10 Step 3972 ntokens 4173787440 Example 85200 of 138376 loss = 3.5013 nll loss = 2.1287 accu = 0.3713

Training: Epoch 9 of 10 Step 3973 ntokens 4173822840 Example 85500 of 138376 loss = 3.5015 nll loss = 2.1289 accu = 0.3713

Training: Epoch 9 of 10 Step 3974 ntokens 4173858240 Example 85800 of 138376 loss = 3.5016 nll loss = 2.1291 accu = 0.3712

Training: Epoch 9 of 10 Step 3975 ntokens 4173893640 Example 86100 of 138376 loss = 3.5017 nll loss = 2.1292 accu = 0.3711

Training: Epoch 9 of 10 Step 3976 ntokens 4173929040 Example 86400 of 138376 loss = 3.5019 nll loss = 2.1291 accu = 0.3712

Training: Epoch 9 of 10 Step 3977 ntokens 4173964440 Example 86700 of 138376 loss = 3.5021 nll loss = 2.1292 accu = 0.3711

Training: Epoch 9 of 10 Step 3978 ntokens 4173999840 Example 87000 of 138376 loss = 3.5022 nll loss = 2.1289 accu = 0.3712

Training: Epoch 9 of 10 Step 3979 ntokens 4174035240 Example 87300 of 138376 loss = 3.5020 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 3980 ntokens 4174070640 Example 87600 of 138376 loss = 3.5019 nll loss = 2.1285 accu = 0.3714

Training: Epoch 9 of 10 Step 3981 ntokens 4174106040 Example 87900 of 138376 loss = 3.5018 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3982 ntokens 4174141440 Example 88200 of 138376 loss = 3.5019 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 3983 ntokens 4174176840 Example 88500 of 138376 loss = 3.5016 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3984 ntokens 4174212240 Example 88800 of 138376 loss = 3.5018 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 3985 ntokens 4174247640 Example 89100 of 138376 loss = 3.5023 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 3986 ntokens 4174283040 Example 89400 of 138376 loss = 3.5024 nll loss = 2.1284 accu = 0.3714

Training: Epoch 9 of 10 Step 3987 ntokens 4174318440 Example 89700 of 138376 loss = 3.5023 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3988 ntokens 4174353840 Example 90000 of 138376 loss = 3.5023 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 3989 ntokens 4174389240 Example 90300 of 138376 loss = 3.5023 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 3990 ntokens 4174424640 Example 90600 of 138376 loss = 3.5023 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3991 ntokens 4174460040 Example 90900 of 138376 loss = 3.5024 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3992 ntokens 4174495440 Example 91200 of 138376 loss = 3.5027 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3993 ntokens 4174530840 Example 91500 of 138376 loss = 3.5026 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 3994 ntokens 4174566240 Example 91800 of 138376 loss = 3.5022 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 3995 ntokens 4174601640 Example 92100 of 138376 loss = 3.5020 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 3996 ntokens 4174637040 Example 92400 of 138376 loss = 3.5019 nll loss = 2.1287 accu = 0.3713

Training: Epoch 9 of 10 Step 3997 ntokens 4174672440 Example 92700 of 138376 loss = 3.5019 nll loss = 2.1288 accu = 0.3713

Training: Epoch 9 of 10 Step 3998 ntokens 4174707840 Example 93000 of 138376 loss = 3.5018 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 3999 ntokens 4174743240 Example 93300 of 138376 loss = 3.5018 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4000 ntokens 4174778640 Example 93600 of 138376 loss = 3.5021 nll loss = 2.1289 accu = 0.3713

Training: Epoch 9 of 10 Step 4001 ntokens 4174814040 Example 93900 of 138376 loss = 3.5025 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4002 ntokens 4174849440 Example 94200 of 138376 loss = 3.5028 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4003 ntokens 4174884840 Example 94500 of 138376 loss = 3.5027 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4004 ntokens 4174920240 Example 94800 of 138376 loss = 3.5027 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4005 ntokens 4174955640 Example 95100 of 138376 loss = 3.5026 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4006 ntokens 4174991040 Example 95400 of 138376 loss = 3.5026 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 4007 ntokens 4175026440 Example 95700 of 138376 loss = 3.5026 nll loss = 2.1283 accu = 0.3716

Training: Epoch 9 of 10 Step 4008 ntokens 4175061840 Example 96000 of 138376 loss = 3.5026 nll loss = 2.1283 accu = 0.3716

Training: Epoch 9 of 10 Step 4009 ntokens 4175097240 Example 96300 of 138376 loss = 3.5024 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4010 ntokens 4175132640 Example 96600 of 138376 loss = 3.5024 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4011 ntokens 4175168040 Example 96900 of 138376 loss = 3.5026 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4012 ntokens 4175203440 Example 97200 of 138376 loss = 3.5024 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4013 ntokens 4175238840 Example 97500 of 138376 loss = 3.5023 nll loss = 2.1286 accu = 0.3715

Training: Epoch 9 of 10 Step 4014 ntokens 4175274240 Example 97800 of 138376 loss = 3.5025 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4015 ntokens 4175309640 Example 98100 of 138376 loss = 3.5025 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4016 ntokens 4175345040 Example 98400 of 138376 loss = 3.5028 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4017 ntokens 4175380440 Example 98700 of 138376 loss = 3.5026 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4018 ntokens 4175415840 Example 99000 of 138376 loss = 3.5025 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4019 ntokens 4175451240 Example 99300 of 138376 loss = 3.5024 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4020 ntokens 4175486640 Example 99600 of 138376 loss = 3.5019 nll loss = 2.1286 accu = 0.3715

Training: Epoch 9 of 10 Step 4021 ntokens 4175522040 Example 99900 of 138376 loss = 3.5024 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4022 ntokens 4175557440 Example 100200 of 138376 loss = 3.5024 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4023 ntokens 4175592840 Example 100500 of 138376 loss = 3.5028 nll loss = 2.1294 accu = 0.3712

Training: Epoch 9 of 10 Step 4024 ntokens 4175628240 Example 100800 of 138376 loss = 3.5027 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4025 ntokens 4175663640 Example 101100 of 138376 loss = 3.5022 nll loss = 2.1292 accu = 0.3713

Training: Epoch 9 of 10 Step 4026 ntokens 4175699040 Example 101400 of 138376 loss = 3.5022 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4027 ntokens 4175734440 Example 101700 of 138376 loss = 3.5021 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4028 ntokens 4175769840 Example 102000 of 138376 loss = 3.5021 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4029 ntokens 4175805240 Example 102300 of 138376 loss = 3.5022 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4030 ntokens 4175840640 Example 102600 of 138376 loss = 3.5021 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4031 ntokens 4175876040 Example 102900 of 138376 loss = 3.5018 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4032 ntokens 4175911440 Example 103200 of 138376 loss = 3.5016 nll loss = 2.1292 accu = 0.3713

Training: Epoch 9 of 10 Step 4033 ntokens 4175946840 Example 103500 of 138376 loss = 3.5013 nll loss = 2.1290 accu = 0.3713

Training: Epoch 9 of 10 Step 4034 ntokens 4175982240 Example 103800 of 138376 loss = 3.5012 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4035 ntokens 4176017640 Example 104100 of 138376 loss = 3.5014 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4036 ntokens 4176053040 Example 104400 of 138376 loss = 3.5012 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4037 ntokens 4176088440 Example 104700 of 138376 loss = 3.5014 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4038 ntokens 4176123840 Example 105000 of 138376 loss = 3.5012 nll loss = 2.1289 accu = 0.3714

Training: Epoch 9 of 10 Step 4039 ntokens 4176159240 Example 105300 of 138376 loss = 3.5014 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4040 ntokens 4176194640 Example 105600 of 138376 loss = 3.5011 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4041 ntokens 4176230040 Example 105900 of 138376 loss = 3.5012 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4042 ntokens 4176265440 Example 106200 of 138376 loss = 3.5010 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4043 ntokens 4176300840 Example 106500 of 138376 loss = 3.5013 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4044 ntokens 4176336240 Example 106800 of 138376 loss = 3.5011 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4045 ntokens 4176371640 Example 107100 of 138376 loss = 3.5011 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4046 ntokens 4176407040 Example 107400 of 138376 loss = 3.5012 nll loss = 2.1292 accu = 0.3713

Training: Epoch 9 of 10 Step 4047 ntokens 4176442440 Example 107700 of 138376 loss = 3.5011 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4048 ntokens 4176477840 Example 108000 of 138376 loss = 3.5011 nll loss = 2.1290 accu = 0.3713

Training: Epoch 9 of 10 Step 4049 ntokens 4176513240 Example 108300 of 138376 loss = 3.5011 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4050 ntokens 4176548640 Example 108600 of 138376 loss = 3.5011 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4051 ntokens 4176584040 Example 108900 of 138376 loss = 3.5010 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4052 ntokens 4176619440 Example 109200 of 138376 loss = 3.5011 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4053 ntokens 4176654840 Example 109500 of 138376 loss = 3.5009 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 4054 ntokens 4176690240 Example 109800 of 138376 loss = 3.5008 nll loss = 2.1282 accu = 0.3716

Training: Epoch 9 of 10 Step 4055 ntokens 4176725640 Example 110100 of 138376 loss = 3.5008 nll loss = 2.1281 accu = 0.3716

Training: Epoch 9 of 10 Step 4056 ntokens 4176761040 Example 110400 of 138376 loss = 3.5007 nll loss = 2.1281 accu = 0.3716

Training: Epoch 9 of 10 Step 4057 ntokens 4176796440 Example 110700 of 138376 loss = 3.5006 nll loss = 2.1282 accu = 0.3716

Training: Epoch 9 of 10 Step 4058 ntokens 4176831840 Example 111000 of 138376 loss = 3.5007 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4059 ntokens 4176867240 Example 111300 of 138376 loss = 3.5005 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4060 ntokens 4176902640 Example 111600 of 138376 loss = 3.5002 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4061 ntokens 4176938040 Example 111900 of 138376 loss = 3.5002 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4062 ntokens 4176973440 Example 112200 of 138376 loss = 3.5001 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4063 ntokens 4177008840 Example 112500 of 138376 loss = 3.4997 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4064 ntokens 4177044240 Example 112800 of 138376 loss = 3.4998 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4065 ntokens 4177079640 Example 113100 of 138376 loss = 3.5000 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4066 ntokens 4177115040 Example 113400 of 138376 loss = 3.5000 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4067 ntokens 4177150440 Example 113700 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4068 ntokens 4177185840 Example 114000 of 138376 loss = 3.5003 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4069 ntokens 4177221240 Example 114300 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4070 ntokens 4177256640 Example 114600 of 138376 loss = 3.5001 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4071 ntokens 4177292040 Example 114900 of 138376 loss = 3.5000 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4072 ntokens 4177327440 Example 115200 of 138376 loss = 3.5000 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4073 ntokens 4177362840 Example 115500 of 138376 loss = 3.5001 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4074 ntokens 4177398240 Example 115800 of 138376 loss = 3.5001 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4075 ntokens 4177433640 Example 116100 of 138376 loss = 3.5002 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4076 ntokens 4177469040 Example 116400 of 138376 loss = 3.5002 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4077 ntokens 4177504440 Example 116700 of 138376 loss = 3.5003 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4078 ntokens 4177539840 Example 117000 of 138376 loss = 3.5001 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4079 ntokens 4177575240 Example 117300 of 138376 loss = 3.5003 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4080 ntokens 4177610640 Example 117600 of 138376 loss = 3.5003 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4081 ntokens 4177646040 Example 117900 of 138376 loss = 3.5003 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4082 ntokens 4177681440 Example 118200 of 138376 loss = 3.5004 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4083 ntokens 4177716840 Example 118500 of 138376 loss = 3.5005 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4084 ntokens 4177752240 Example 118800 of 138376 loss = 3.5004 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4085 ntokens 4177787640 Example 119100 of 138376 loss = 3.5005 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4086 ntokens 4177823040 Example 119400 of 138376 loss = 3.5002 nll loss = 2.1286 accu = 0.3715

Training: Epoch 9 of 10 Step 4087 ntokens 4177858440 Example 119700 of 138376 loss = 3.5004 nll loss = 2.1289 accu = 0.3714

Training: Epoch 9 of 10 Step 4088 ntokens 4177893840 Example 120000 of 138376 loss = 3.5001 nll loss = 2.1289 accu = 0.3713

Training: Epoch 9 of 10 Step 4089 ntokens 4177929240 Example 120300 of 138376 loss = 3.4999 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4090 ntokens 4177964640 Example 120600 of 138376 loss = 3.5000 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4091 ntokens 4178000040 Example 120900 of 138376 loss = 3.5000 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4092 ntokens 4178035440 Example 121200 of 138376 loss = 3.4999 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4093 ntokens 4178070840 Example 121500 of 138376 loss = 3.5000 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4094 ntokens 4178106240 Example 121800 of 138376 loss = 3.4999 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4095 ntokens 4178141640 Example 122100 of 138376 loss = 3.4999 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4096 ntokens 4178177040 Example 122400 of 138376 loss = 3.4999 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4097 ntokens 4178212440 Example 122700 of 138376 loss = 3.5000 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4098 ntokens 4178247840 Example 123000 of 138376 loss = 3.5000 nll loss = 2.1290 accu = 0.3713

Training: Epoch 9 of 10 Step 4099 ntokens 4178283240 Example 123300 of 138376 loss = 3.5000 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4100 ntokens 4178318640 Example 123600 of 138376 loss = 3.4999 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4101 ntokens 4178354040 Example 123900 of 138376 loss = 3.4998 nll loss = 2.1294 accu = 0.3712

Training: Epoch 9 of 10 Step 4102 ntokens 4178389440 Example 124200 of 138376 loss = 3.4996 nll loss = 2.1293 accu = 0.3712

Training: Epoch 9 of 10 Step 4103 ntokens 4178424840 Example 124500 of 138376 loss = 3.4996 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4104 ntokens 4178460240 Example 124800 of 138376 loss = 3.4996 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4105 ntokens 4178495640 Example 125100 of 138376 loss = 3.4993 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4106 ntokens 4178531040 Example 125400 of 138376 loss = 3.4995 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4107 ntokens 4178566440 Example 125700 of 138376 loss = 3.4994 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4108 ntokens 4178601840 Example 126000 of 138376 loss = 3.4996 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4109 ntokens 4178637240 Example 126300 of 138376 loss = 3.4997 nll loss = 2.1292 accu = 0.3712

Training: Epoch 9 of 10 Step 4110 ntokens 4178672640 Example 126600 of 138376 loss = 3.4996 nll loss = 2.1291 accu = 0.3713

Training: Epoch 9 of 10 Step 4111 ntokens 4178708040 Example 126900 of 138376 loss = 3.4995 nll loss = 2.1290 accu = 0.3713

Training: Epoch 9 of 10 Step 4112 ntokens 4178743440 Example 127200 of 138376 loss = 3.4995 nll loss = 2.1289 accu = 0.3713

Training: Epoch 9 of 10 Step 4113 ntokens 4178778840 Example 127500 of 138376 loss = 3.4995 nll loss = 2.1289 accu = 0.3713

Training: Epoch 9 of 10 Step 4114 ntokens 4178814240 Example 127800 of 138376 loss = 3.4995 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4115 ntokens 4178849640 Example 128100 of 138376 loss = 3.4998 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4116 ntokens 4178885040 Example 128400 of 138376 loss = 3.4998 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4117 ntokens 4178920440 Example 128700 of 138376 loss = 3.5001 nll loss = 2.1282 accu = 0.3715

Training: Epoch 9 of 10 Step 4118 ntokens 4178955840 Example 129000 of 138376 loss = 3.5001 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4119 ntokens 4178991240 Example 129300 of 138376 loss = 3.5002 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 4120 ntokens 4179026640 Example 129600 of 138376 loss = 3.5001 nll loss = 2.1283 accu = 0.3715

Training: Epoch 9 of 10 Step 4121 ntokens 4179062040 Example 129900 of 138376 loss = 3.4999 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4122 ntokens 4179097440 Example 130200 of 138376 loss = 3.5000 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4123 ntokens 4179132840 Example 130500 of 138376 loss = 3.4999 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4124 ntokens 4179168240 Example 130800 of 138376 loss = 3.4999 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4125 ntokens 4179203640 Example 131100 of 138376 loss = 3.4999 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4126 ntokens 4179239040 Example 131400 of 138376 loss = 3.4997 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4127 ntokens 4179274440 Example 131700 of 138376 loss = 3.5000 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4128 ntokens 4179309840 Example 132000 of 138376 loss = 3.5001 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4129 ntokens 4179345240 Example 132300 of 138376 loss = 3.4999 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4130 ntokens 4179380640 Example 132600 of 138376 loss = 3.5002 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4131 ntokens 4179416040 Example 132900 of 138376 loss = 3.5001 nll loss = 2.1286 accu = 0.3714

Training: Epoch 9 of 10 Step 4132 ntokens 4179451440 Example 133200 of 138376 loss = 3.5002 nll loss = 2.1284 accu = 0.3715

Training: Epoch 9 of 10 Step 4133 ntokens 4179486840 Example 133500 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4134 ntokens 4179522240 Example 133800 of 138376 loss = 3.5001 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4135 ntokens 4179557640 Example 134100 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4136 ntokens 4179593040 Example 134400 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4137 ntokens 4179628440 Example 134700 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4138 ntokens 4179663840 Example 135000 of 138376 loss = 3.5002 nll loss = 2.1285 accu = 0.3715

Training: Epoch 9 of 10 Step 4139 ntokens 4179699240 Example 135300 of 138376 loss = 3.5004 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4140 ntokens 4179734640 Example 135600 of 138376 loss = 3.5006 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4141 ntokens 4179770040 Example 135900 of 138376 loss = 3.5006 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4142 ntokens 4179805440 Example 136200 of 138376 loss = 3.5007 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4143 ntokens 4179840840 Example 136500 of 138376 loss = 3.5009 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4144 ntokens 4179876240 Example 136800 of 138376 loss = 3.5007 nll loss = 2.1289 accu = 0.3714

Training: Epoch 9 of 10 Step 4145 ntokens 4179911640 Example 137100 of 138376 loss = 3.5005 nll loss = 2.1289 accu = 0.3714

Training: Epoch 9 of 10 Step 4146 ntokens 4179947040 Example 137400 of 138376 loss = 3.5002 nll loss = 2.1288 accu = 0.3714

Training: Epoch 9 of 10 Step 4147 ntokens 4179982440 Example 137700 of 138376 loss = 3.5001 nll loss = 2.1289 accu = 0.3714

Training: Epoch 9 of 10 Step 4148 ntokens 4180017840 Example 138000 of 138376 loss = 3.5001 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4149 ntokens 4180053240 Example 138300 of 138376 loss = 3.5002 nll loss = 2.1287 accu = 0.3714

Training: Epoch 9 of 10 Step 4150 ntokens 4180062208 Example 138376 of 138376 loss = 3.5003 nll loss = 2.1287 accu = 0.3714

Writing to checkpoint at 2024-05-28 17:10:34.628048
Validating: Epoch 9 of 10 Step 0 ntokens 4180062208 Example 300 of 34323 loss = 3.5584 nll loss = 2.1733 accu = 0.3526

Validating: Epoch 9 of 10 Step 1 ntokens 4180062208 Example 600 of 34323 loss = 3.5379 nll loss = 2.1585 accu = 0.3586

Validating: Epoch 9 of 10 Step 2 ntokens 4180062208 Example 900 of 34323 loss = 3.5508 nll loss = 2.1500 accu = 0.3625

Validating: Epoch 9 of 10 Step 3 ntokens 4180062208 Example 1200 of 34323 loss = 3.5354 nll loss = 2.1404 accu = 0.3657

Validating: Epoch 9 of 10 Step 4 ntokens 4180062208 Example 1500 of 34323 loss = 3.5362 nll loss = 2.1425 accu = 0.3652

Validating: Epoch 9 of 10 Step 5 ntokens 4180062208 Example 1800 of 34323 loss = 3.5407 nll loss = 2.1408 accu = 0.3656

Validating: Epoch 9 of 10 Step 6 ntokens 4180062208 Example 2100 of 34323 loss = 3.5369 nll loss = 2.1601 accu = 0.3589

Validating: Epoch 9 of 10 Step 7 ntokens 4180062208 Example 2400 of 34323 loss = 3.5263 nll loss = 2.1508 accu = 0.3624

Validating: Epoch 9 of 10 Step 8 ntokens 4180062208 Example 2700 of 34323 loss = 3.5249 nll loss = 2.1376 accu = 0.3671

Validating: Epoch 9 of 10 Step 9 ntokens 4180062208 Example 3000 of 34323 loss = 3.5361 nll loss = 2.1352 accu = 0.3685

Validating: Epoch 9 of 10 Step 10 ntokens 4180062208 Example 3300 of 34323 loss = 3.5313 nll loss = 2.1255 accu = 0.3719

Validating: Epoch 9 of 10 Step 11 ntokens 4180062208 Example 3600 of 34323 loss = 3.5194 nll loss = 2.1284 accu = 0.3711

Validating: Epoch 9 of 10 Step 12 ntokens 4180062208 Example 3900 of 34323 loss = 3.5170 nll loss = 2.1297 accu = 0.3709

Validating: Epoch 9 of 10 Step 13 ntokens 4180062208 Example 4200 of 34323 loss = 3.5157 nll loss = 2.1309 accu = 0.3707

Validating: Epoch 9 of 10 Step 14 ntokens 4180062208 Example 4500 of 34323 loss = 3.5129 nll loss = 2.1309 accu = 0.3706

Validating: Epoch 9 of 10 Step 15 ntokens 4180062208 Example 4800 of 34323 loss = 3.5113 nll loss = 2.1322 accu = 0.3701

Validating: Epoch 9 of 10 Step 16 ntokens 4180062208 Example 5100 of 34323 loss = 3.5097 nll loss = 2.1319 accu = 0.3702

Validating: Epoch 9 of 10 Step 17 ntokens 4180062208 Example 5400 of 34323 loss = 3.5056 nll loss = 2.1327 accu = 0.3698

Validating: Epoch 9 of 10 Step 18 ntokens 4180062208 Example 5700 of 34323 loss = 3.5072 nll loss = 2.1297 accu = 0.3709

Validating: Epoch 9 of 10 Step 19 ntokens 4180062208 Example 6000 of 34323 loss = 3.5089 nll loss = 2.1298 accu = 0.3709

Validating: Epoch 9 of 10 Step 20 ntokens 4180062208 Example 6300 of 34323 loss = 3.5097 nll loss = 2.1313 accu = 0.3703

Validating: Epoch 9 of 10 Step 21 ntokens 4180062208 Example 6600 of 34323 loss = 3.5058 nll loss = 2.1329 accu = 0.3699

Validating: Epoch 9 of 10 Step 22 ntokens 4180062208 Example 6900 of 34323 loss = 3.5095 nll loss = 2.1361 accu = 0.3687

Validating: Epoch 9 of 10 Step 23 ntokens 4180062208 Example 7200 of 34323 loss = 3.5067 nll loss = 2.1347 accu = 0.3692

Validating: Epoch 9 of 10 Step 24 ntokens 4180062208 Example 7500 of 34323 loss = 3.5080 nll loss = 2.1345 accu = 0.3692

Validating: Epoch 9 of 10 Step 25 ntokens 4180062208 Example 7800 of 34323 loss = 3.5098 nll loss = 2.1350 accu = 0.3691

Validating: Epoch 9 of 10 Step 26 ntokens 4180062208 Example 8100 of 34323 loss = 3.5078 nll loss = 2.1359 accu = 0.3687

Validating: Epoch 9 of 10 Step 27 ntokens 4180062208 Example 8400 of 34323 loss = 3.5099 nll loss = 2.1388 accu = 0.3676

Validating: Epoch 9 of 10 Step 28 ntokens 4180062208 Example 8700 of 34323 loss = 3.5086 nll loss = 2.1389 accu = 0.3675

Validating: Epoch 9 of 10 Step 29 ntokens 4180062208 Example 9000 of 34323 loss = 3.5098 nll loss = 2.1426 accu = 0.3661

Validating: Epoch 9 of 10 Step 30 ntokens 4180062208 Example 9300 of 34323 loss = 3.5079 nll loss = 2.1414 accu = 0.3666

Validating: Epoch 9 of 10 Step 31 ntokens 4180062208 Example 9600 of 34323 loss = 3.5114 nll loss = 2.1409 accu = 0.3667

Validating: Epoch 9 of 10 Step 32 ntokens 4180062208 Example 9900 of 34323 loss = 3.5080 nll loss = 2.1397 accu = 0.3672

Validating: Epoch 9 of 10 Step 33 ntokens 4180062208 Example 10200 of 34323 loss = 3.5060 nll loss = 2.1419 accu = 0.3664

Validating: Epoch 9 of 10 Step 34 ntokens 4180062208 Example 10500 of 34323 loss = 3.5064 nll loss = 2.1406 accu = 0.3669

Validating: Epoch 9 of 10 Step 35 ntokens 4180062208 Example 10800 of 34323 loss = 3.5061 nll loss = 2.1390 accu = 0.3674

Validating: Epoch 9 of 10 Step 36 ntokens 4180062208 Example 11100 of 34323 loss = 3.5071 nll loss = 2.1415 accu = 0.3666

Validating: Epoch 9 of 10 Step 37 ntokens 4180062208 Example 11400 of 34323 loss = 3.5059 nll loss = 2.1422 accu = 0.3664

Validating: Epoch 9 of 10 Step 38 ntokens 4180062208 Example 11700 of 34323 loss = 3.5069 nll loss = 2.1411 accu = 0.3668

Validating: Epoch 9 of 10 Step 39 ntokens 4180062208 Example 12000 of 34323 loss = 3.5075 nll loss = 2.1402 accu = 0.3671

Validating: Epoch 9 of 10 Step 40 ntokens 4180062208 Example 12300 of 34323 loss = 3.5057 nll loss = 2.1399 accu = 0.3672

Validating: Epoch 9 of 10 Step 41 ntokens 4180062208 Example 12600 of 34323 loss = 3.5058 nll loss = 2.1389 accu = 0.3676

Validating: Epoch 9 of 10 Step 42 ntokens 4180062208 Example 12900 of 34323 loss = 3.5070 nll loss = 2.1361 accu = 0.3686

Validating: Epoch 9 of 10 Step 43 ntokens 4180062208 Example 13200 of 34323 loss = 3.5068 nll loss = 2.1345 accu = 0.3692

Validating: Epoch 9 of 10 Step 44 ntokens 4180062208 Example 13500 of 34323 loss = 3.5063 nll loss = 2.1355 accu = 0.3689

Validating: Epoch 9 of 10 Step 45 ntokens 4180062208 Example 13800 of 34323 loss = 3.5058 nll loss = 2.1344 accu = 0.3693

Validating: Epoch 9 of 10 Step 46 ntokens 4180062208 Example 14100 of 34323 loss = 3.5028 nll loss = 2.1327 accu = 0.3699

Validating: Epoch 9 of 10 Step 47 ntokens 4180062208 Example 14400 of 34323 loss = 3.5006 nll loss = 2.1312 accu = 0.3705

Validating: Epoch 9 of 10 Step 48 ntokens 4180062208 Example 14700 of 34323 loss = 3.5004 nll loss = 2.1307 accu = 0.3706

Validating: Epoch 9 of 10 Step 49 ntokens 4180062208 Example 15000 of 34323 loss = 3.4986 nll loss = 2.1313 accu = 0.3705

Validating: Epoch 9 of 10 Step 50 ntokens 4180062208 Example 15300 of 34323 loss = 3.4983 nll loss = 2.1311 accu = 0.3706

Validating: Epoch 9 of 10 Step 51 ntokens 4180062208 Example 15600 of 34323 loss = 3.4969 nll loss = 2.1314 accu = 0.3705

Validating: Epoch 9 of 10 Step 52 ntokens 4180062208 Example 15900 of 34323 loss = 3.4979 nll loss = 2.1312 accu = 0.3706

Validating: Epoch 9 of 10 Step 53 ntokens 4180062208 Example 16200 of 34323 loss = 3.4980 nll loss = 2.1318 accu = 0.3704

Validating: Epoch 9 of 10 Step 54 ntokens 4180062208 Example 16500 of 34323 loss = 3.4981 nll loss = 2.1305 accu = 0.3709

Validating: Epoch 9 of 10 Step 55 ntokens 4180062208 Example 16800 of 34323 loss = 3.4993 nll loss = 2.1307 accu = 0.3707

Validating: Epoch 9 of 10 Step 56 ntokens 4180062208 Example 17100 of 34323 loss = 3.4992 nll loss = 2.1313 accu = 0.3705

Validating: Epoch 9 of 10 Step 57 ntokens 4180062208 Example 17400 of 34323 loss = 3.5002 nll loss = 2.1313 accu = 0.3705

Validating: Epoch 9 of 10 Step 58 ntokens 4180062208 Example 17700 of 34323 loss = 3.5010 nll loss = 2.1324 accu = 0.3701

Validating: Epoch 9 of 10 Step 59 ntokens 4180062208 Example 18000 of 34323 loss = 3.5019 nll loss = 2.1322 accu = 0.3701

Validating: Epoch 9 of 10 Step 60 ntokens 4180062208 Example 18300 of 34323 loss = 3.5004 nll loss = 2.1325 accu = 0.3700

Validating: Epoch 9 of 10 Step 61 ntokens 4180062208 Example 18600 of 34323 loss = 3.4996 nll loss = 2.1338 accu = 0.3695

Validating: Epoch 9 of 10 Step 62 ntokens 4180062208 Example 18900 of 34323 loss = 3.5005 nll loss = 2.1339 accu = 0.3695

Validating: Epoch 9 of 10 Step 63 ntokens 4180062208 Example 19200 of 34323 loss = 3.4998 nll loss = 2.1342 accu = 0.3694

Validating: Epoch 9 of 10 Step 64 ntokens 4180062208 Example 19500 of 34323 loss = 3.4988 nll loss = 2.1343 accu = 0.3693

Validating: Epoch 9 of 10 Step 65 ntokens 4180062208 Example 19800 of 34323 loss = 3.4963 nll loss = 2.1348 accu = 0.3692

Validating: Epoch 9 of 10 Step 66 ntokens 4180062208 Example 20100 of 34323 loss = 3.4953 nll loss = 2.1328 accu = 0.3699

Validating: Epoch 9 of 10 Step 67 ntokens 4180062208 Example 20400 of 34323 loss = 3.4955 nll loss = 2.1331 accu = 0.3698

Validating: Epoch 9 of 10 Step 68 ntokens 4180062208 Example 20700 of 34323 loss = 3.4952 nll loss = 2.1342 accu = 0.3694

Validating: Epoch 9 of 10 Step 69 ntokens 4180062208 Example 21000 of 34323 loss = 3.4948 nll loss = 2.1341 accu = 0.3694

Validating: Epoch 9 of 10 Step 70 ntokens 4180062208 Example 21300 of 34323 loss = 3.4949 nll loss = 2.1339 accu = 0.3694

Validating: Epoch 9 of 10 Step 71 ntokens 4180062208 Example 21600 of 34323 loss = 3.4959 nll loss = 2.1342 accu = 0.3693

Validating: Epoch 9 of 10 Step 72 ntokens 4180062208 Example 21900 of 34323 loss = 3.4978 nll loss = 2.1336 accu = 0.3695

Validating: Epoch 9 of 10 Step 73 ntokens 4180062208 Example 22200 of 34323 loss = 3.4980 nll loss = 2.1332 accu = 0.3697

Validating: Epoch 9 of 10 Step 74 ntokens 4180062208 Example 22500 of 34323 loss = 3.4981 nll loss = 2.1327 accu = 0.3698

Validating: Epoch 9 of 10 Step 75 ntokens 4180062208 Example 22800 of 34323 loss = 3.4975 nll loss = 2.1321 accu = 0.3700

Validating: Epoch 9 of 10 Step 76 ntokens 4180062208 Example 23100 of 34323 loss = 3.4992 nll loss = 2.1322 accu = 0.3700

Validating: Epoch 9 of 10 Step 77 ntokens 4180062208 Example 23400 of 34323 loss = 3.4991 nll loss = 2.1333 accu = 0.3695

Validating: Epoch 9 of 10 Step 78 ntokens 4180062208 Example 23700 of 34323 loss = 3.4994 nll loss = 2.1325 accu = 0.3698

Validating: Epoch 9 of 10 Step 79 ntokens 4180062208 Example 24000 of 34323 loss = 3.4985 nll loss = 2.1324 accu = 0.3699

Validating: Epoch 9 of 10 Step 80 ntokens 4180062208 Example 24300 of 34323 loss = 3.4961 nll loss = 2.1326 accu = 0.3698

Validating: Epoch 9 of 10 Step 81 ntokens 4180062208 Example 24600 of 34323 loss = 3.4971 nll loss = 2.1318 accu = 0.3701

Validating: Epoch 9 of 10 Step 82 ntokens 4180062208 Example 24900 of 34323 loss = 3.4972 nll loss = 2.1312 accu = 0.3702

Validating: Epoch 9 of 10 Step 83 ntokens 4180062208 Example 25200 of 34323 loss = 3.4966 nll loss = 2.1309 accu = 0.3703

Validating: Epoch 9 of 10 Step 84 ntokens 4180062208 Example 25500 of 34323 loss = 3.4971 nll loss = 2.1317 accu = 0.3701

Validating: Epoch 9 of 10 Step 85 ntokens 4180062208 Example 25800 of 34323 loss = 3.4964 nll loss = 2.1310 accu = 0.3703

Validating: Epoch 9 of 10 Step 86 ntokens 4180062208 Example 26100 of 34323 loss = 3.4962 nll loss = 2.1306 accu = 0.3705

Validating: Epoch 9 of 10 Step 87 ntokens 4180062208 Example 26400 of 34323 loss = 3.4959 nll loss = 2.1304 accu = 0.3706

Validating: Epoch 9 of 10 Step 88 ntokens 4180062208 Example 26700 of 34323 loss = 3.4957 nll loss = 2.1296 accu = 0.3709

Validating: Epoch 9 of 10 Step 89 ntokens 4180062208 Example 27000 of 34323 loss = 3.4952 nll loss = 2.1283 accu = 0.3713

Validating: Epoch 9 of 10 Step 90 ntokens 4180062208 Example 27300 of 34323 loss = 3.4950 nll loss = 2.1283 accu = 0.3713

Validating: Epoch 9 of 10 Step 91 ntokens 4180062208 Example 27600 of 34323 loss = 3.4945 nll loss = 2.1281 accu = 0.3714

Validating: Epoch 9 of 10 Step 92 ntokens 4180062208 Example 27900 of 34323 loss = 3.4959 nll loss = 2.1281 accu = 0.3714

Validating: Epoch 9 of 10 Step 93 ntokens 4180062208 Example 28200 of 34323 loss = 3.4947 nll loss = 2.1279 accu = 0.3715

Validating: Epoch 9 of 10 Step 94 ntokens 4180062208 Example 28500 of 34323 loss = 3.4950 nll loss = 2.1276 accu = 0.3716

Validating: Epoch 9 of 10 Step 95 ntokens 4180062208 Example 28800 of 34323 loss = 3.4945 nll loss = 2.1279 accu = 0.3714

Validating: Epoch 9 of 10 Step 96 ntokens 4180062208 Example 29100 of 34323 loss = 3.4945 nll loss = 2.1275 accu = 0.3716

Validating: Epoch 9 of 10 Step 97 ntokens 4180062208 Example 29400 of 34323 loss = 3.4948 nll loss = 2.1275 accu = 0.3716

Validating: Epoch 9 of 10 Step 98 ntokens 4180062208 Example 29700 of 34323 loss = 3.4958 nll loss = 2.1269 accu = 0.3718

Validating: Epoch 9 of 10 Step 99 ntokens 4180062208 Example 30000 of 34323 loss = 3.4967 nll loss = 2.1266 accu = 0.3719

Validating: Epoch 9 of 10 Step 100 ntokens 4180062208 Example 30300 of 34323 loss = 3.4969 nll loss = 2.1265 accu = 0.3720

Validating: Epoch 9 of 10 Step 101 ntokens 4180062208 Example 30600 of 34323 loss = 3.4971 nll loss = 2.1269 accu = 0.3718

Validating: Epoch 9 of 10 Step 102 ntokens 4180062208 Example 30900 of 34323 loss = 3.4965 nll loss = 2.1272 accu = 0.3717

Validating: Epoch 9 of 10 Step 103 ntokens 4180062208 Example 31200 of 34323 loss = 3.4964 nll loss = 2.1274 accu = 0.3716

Validating: Epoch 9 of 10 Step 104 ntokens 4180062208 Example 31500 of 34323 loss = 3.4969 nll loss = 2.1276 accu = 0.3716

Validating: Epoch 9 of 10 Step 105 ntokens 4180062208 Example 31800 of 34323 loss = 3.4972 nll loss = 2.1278 accu = 0.3715

Validating: Epoch 9 of 10 Step 106 ntokens 4180062208 Example 32100 of 34323 loss = 3.4982 nll loss = 2.1283 accu = 0.3713

Validating: Epoch 9 of 10 Step 107 ntokens 4180062208 Example 32400 of 34323 loss = 3.4980 nll loss = 2.1281 accu = 0.3714

Validating: Epoch 9 of 10 Step 108 ntokens 4180062208 Example 32700 of 34323 loss = 3.4979 nll loss = 2.1281 accu = 0.3714

Validating: Epoch 9 of 10 Step 109 ntokens 4180062208 Example 33000 of 34323 loss = 3.4969 nll loss = 2.1278 accu = 0.3715

Validating: Epoch 9 of 10 Step 110 ntokens 4180062208 Example 33300 of 34323 loss = 3.4963 nll loss = 2.1277 accu = 0.3715

Validating: Epoch 9 of 10 Step 111 ntokens 4180062208 Example 33600 of 34323 loss = 3.4973 nll loss = 2.1279 accu = 0.3714

Validating: Epoch 9 of 10 Step 112 ntokens 4180062208 Example 33900 of 34323 loss = 3.4973 nll loss = 2.1281 accu = 0.3713

Validating: Epoch 9 of 10 Step 113 ntokens 4180062208 Example 34200 of 34323 loss = 3.4968 nll loss = 2.1273 accu = 0.3717

Validating: Epoch 9 of 10 Step 114 ntokens 4180062208 Example 34323 of 34323 loss = 3.4970 nll loss = 2.1274 accu = 0.3716

Validation complete in 0:00:15.058944
Epoch complete in 0:02:30.303057
Training: Epoch 10 of 10 Step 4150 ntokens 8343831448 Example 300 of 138376 loss = 3.3459 nll loss = 2.0920 accu = 0.3882

Training: Epoch 10 of 10 Step 4151 ntokens 8343866848 Example 600 of 138376 loss = 3.3928 nll loss = 2.1136 accu = 0.3771

Training: Epoch 10 of 10 Step 4152 ntokens 8343902248 Example 900 of 138376 loss = 3.4208 nll loss = 2.1171 accu = 0.3775

Training: Epoch 10 of 10 Step 4153 ntokens 8343937648 Example 1200 of 138376 loss = 3.4505 nll loss = 2.1224 accu = 0.3755

Training: Epoch 10 of 10 Step 4154 ntokens 8343973048 Example 1500 of 138376 loss = 3.4783 nll loss = 2.1108 accu = 0.3791

Training: Epoch 10 of 10 Step 4155 ntokens 8344008448 Example 1800 of 138376 loss = 3.4779 nll loss = 2.1263 accu = 0.3735

Training: Epoch 10 of 10 Step 4156 ntokens 8344043848 Example 2100 of 138376 loss = 3.4749 nll loss = 2.1368 accu = 0.3701

Training: Epoch 10 of 10 Step 4157 ntokens 8344079248 Example 2400 of 138376 loss = 3.4827 nll loss = 2.1373 accu = 0.3691

Training: Epoch 10 of 10 Step 4158 ntokens 8344114648 Example 2700 of 138376 loss = 3.4798 nll loss = 2.1377 accu = 0.3686

Training: Epoch 10 of 10 Step 4159 ntokens 8344150048 Example 3000 of 138376 loss = 3.4806 nll loss = 2.1403 accu = 0.3677

Training: Epoch 10 of 10 Step 4160 ntokens 8344185448 Example 3300 of 138376 loss = 3.4709 nll loss = 2.1446 accu = 0.3665

Training: Epoch 10 of 10 Step 4161 ntokens 8344220848 Example 3600 of 138376 loss = 3.4804 nll loss = 2.1503 accu = 0.3646

Training: Epoch 10 of 10 Step 4162 ntokens 8344256248 Example 3900 of 138376 loss = 3.4898 nll loss = 2.1521 accu = 0.3640

Training: Epoch 10 of 10 Step 4163 ntokens 8344291648 Example 4200 of 138376 loss = 3.4900 nll loss = 2.1460 accu = 0.3663

Training: Epoch 10 of 10 Step 4164 ntokens 8344327048 Example 4500 of 138376 loss = 3.4964 nll loss = 2.1483 accu = 0.3656

Training: Epoch 10 of 10 Step 4165 ntokens 8344362448 Example 4800 of 138376 loss = 3.4986 nll loss = 2.1440 accu = 0.3669

Training: Epoch 10 of 10 Step 4166 ntokens 8344397848 Example 5100 of 138376 loss = 3.5032 nll loss = 2.1425 accu = 0.3672

Training: Epoch 10 of 10 Step 4167 ntokens 8344433248 Example 5400 of 138376 loss = 3.4942 nll loss = 2.1410 accu = 0.3676

Training: Epoch 10 of 10 Step 4168 ntokens 8344468648 Example 5700 of 138376 loss = 3.4899 nll loss = 2.1360 accu = 0.3691

Training: Epoch 10 of 10 Step 4169 ntokens 8344504048 Example 6000 of 138376 loss = 3.4940 nll loss = 2.1333 accu = 0.3700

Training: Epoch 10 of 10 Step 4170 ntokens 8344539448 Example 6300 of 138376 loss = 3.4947 nll loss = 2.1315 accu = 0.3707

Training: Epoch 10 of 10 Step 4171 ntokens 8344574848 Example 6600 of 138376 loss = 3.4964 nll loss = 2.1293 accu = 0.3715

Training: Epoch 10 of 10 Step 4172 ntokens 8344610248 Example 6900 of 138376 loss = 3.4921 nll loss = 2.1303 accu = 0.3713

Training: Epoch 10 of 10 Step 4173 ntokens 8344645648 Example 7200 of 138376 loss = 3.4920 nll loss = 2.1302 accu = 0.3713

Training: Epoch 10 of 10 Step 4174 ntokens 8344681048 Example 7500 of 138376 loss = 3.4944 nll loss = 2.1288 accu = 0.3718

Training: Epoch 10 of 10 Step 4175 ntokens 8344716448 Example 7800 of 138376 loss = 3.4944 nll loss = 2.1294 accu = 0.3716

Training: Epoch 10 of 10 Step 4176 ntokens 8344751848 Example 8100 of 138376 loss = 3.4969 nll loss = 2.1287 accu = 0.3716

Training: Epoch 10 of 10 Step 4177 ntokens 8344787248 Example 8400 of 138376 loss = 3.4941 nll loss = 2.1283 accu = 0.3717

Training: Epoch 10 of 10 Step 4178 ntokens 8344822648 Example 8700 of 138376 loss = 3.4943 nll loss = 2.1287 accu = 0.3715

Training: Epoch 10 of 10 Step 4179 ntokens 8344858048 Example 9000 of 138376 loss = 3.4966 nll loss = 2.1291 accu = 0.3713

Training: Epoch 10 of 10 Step 4180 ntokens 8344893448 Example 9300 of 138376 loss = 3.5005 nll loss = 2.1283 accu = 0.3717

Training: Epoch 10 of 10 Step 4181 ntokens 8344928848 Example 9600 of 138376 loss = 3.5029 nll loss = 2.1293 accu = 0.3713

Training: Epoch 10 of 10 Step 4182 ntokens 8344964248 Example 9900 of 138376 loss = 3.5009 nll loss = 2.1273 accu = 0.3720

Training: Epoch 10 of 10 Step 4183 ntokens 8344999648 Example 10200 of 138376 loss = 3.4974 nll loss = 2.1281 accu = 0.3717

Training: Epoch 10 of 10 Step 4184 ntokens 8345035048 Example 10500 of 138376 loss = 3.4988 nll loss = 2.1288 accu = 0.3715

Training: Epoch 10 of 10 Step 4185 ntokens 8345070448 Example 10800 of 138376 loss = 3.5028 nll loss = 2.1295 accu = 0.3713

Training: Epoch 10 of 10 Step 4186 ntokens 8345105848 Example 11100 of 138376 loss = 3.5033 nll loss = 2.1290 accu = 0.3715

Training: Epoch 10 of 10 Step 4187 ntokens 8345141248 Example 11400 of 138376 loss = 3.5037 nll loss = 2.1297 accu = 0.3712

Training: Epoch 10 of 10 Step 4188 ntokens 8345176648 Example 11700 of 138376 loss = 3.5040 nll loss = 2.1306 accu = 0.3709

Training: Epoch 10 of 10 Step 4189 ntokens 8345212048 Example 12000 of 138376 loss = 3.5066 nll loss = 2.1318 accu = 0.3705

Training: Epoch 10 of 10 Step 4190 ntokens 8345247448 Example 12300 of 138376 loss = 3.5067 nll loss = 2.1318 accu = 0.3706

Training: Epoch 10 of 10 Step 4191 ntokens 8345282848 Example 12600 of 138376 loss = 3.5038 nll loss = 2.1316 accu = 0.3707

Training: Epoch 10 of 10 Step 4192 ntokens 8345318248 Example 12900 of 138376 loss = 3.5043 nll loss = 2.1308 accu = 0.3709

Training: Epoch 10 of 10 Step 4193 ntokens 8345353648 Example 13200 of 138376 loss = 3.5038 nll loss = 2.1304 accu = 0.3710

Training: Epoch 10 of 10 Step 4194 ntokens 8345389048 Example 13500 of 138376 loss = 3.5044 nll loss = 2.1311 accu = 0.3707

Training: Epoch 10 of 10 Step 4195 ntokens 8345424448 Example 13800 of 138376 loss = 3.5041 nll loss = 2.1311 accu = 0.3707

Training: Epoch 10 of 10 Step 4196 ntokens 8345459848 Example 14100 of 138376 loss = 3.5048 nll loss = 2.1305 accu = 0.3709

Training: Epoch 10 of 10 Step 4197 ntokens 8345495248 Example 14400 of 138376 loss = 3.5067 nll loss = 2.1307 accu = 0.3708

Training: Epoch 10 of 10 Step 4198 ntokens 8345530648 Example 14700 of 138376 loss = 3.5050 nll loss = 2.1324 accu = 0.3701

Training: Epoch 10 of 10 Step 4199 ntokens 8345566048 Example 15000 of 138376 loss = 3.5058 nll loss = 2.1320 accu = 0.3703

Training: Epoch 10 of 10 Step 4200 ntokens 8345601448 Example 15300 of 138376 loss = 3.5040 nll loss = 2.1322 accu = 0.3702

Training: Epoch 10 of 10 Step 4201 ntokens 8345636848 Example 15600 of 138376 loss = 3.5023 nll loss = 2.1328 accu = 0.3700

Training: Epoch 10 of 10 Step 4202 ntokens 8345672248 Example 15900 of 138376 loss = 3.5015 nll loss = 2.1318 accu = 0.3703

Training: Epoch 10 of 10 Step 4203 ntokens 8345707648 Example 16200 of 138376 loss = 3.5010 nll loss = 2.1339 accu = 0.3696

Training: Epoch 10 of 10 Step 4204 ntokens 8345743048 Example 16500 of 138376 loss = 3.5018 nll loss = 2.1344 accu = 0.3693

Training: Epoch 10 of 10 Step 4205 ntokens 8345778448 Example 16800 of 138376 loss = 3.5018 nll loss = 2.1339 accu = 0.3695

Training: Epoch 10 of 10 Step 4206 ntokens 8345813848 Example 17100 of 138376 loss = 3.5043 nll loss = 2.1336 accu = 0.3696

Training: Epoch 10 of 10 Step 4207 ntokens 8345849248 Example 17400 of 138376 loss = 3.5045 nll loss = 2.1332 accu = 0.3698

Training: Epoch 10 of 10 Step 4208 ntokens 8345884648 Example 17700 of 138376 loss = 3.5052 nll loss = 2.1320 accu = 0.3702

Training: Epoch 10 of 10 Step 4209 ntokens 8345920048 Example 18000 of 138376 loss = 3.5056 nll loss = 2.1312 accu = 0.3706

Training: Epoch 10 of 10 Step 4210 ntokens 8345955448 Example 18300 of 138376 loss = 3.5063 nll loss = 2.1301 accu = 0.3709

Training: Epoch 10 of 10 Step 4211 ntokens 8345990848 Example 18600 of 138376 loss = 3.5067 nll loss = 2.1303 accu = 0.3709

Training: Epoch 10 of 10 Step 4212 ntokens 8346026248 Example 18900 of 138376 loss = 3.5061 nll loss = 2.1304 accu = 0.3708

Training: Epoch 10 of 10 Step 4213 ntokens 8346061648 Example 19200 of 138376 loss = 3.5041 nll loss = 2.1306 accu = 0.3707

Training: Epoch 10 of 10 Step 4214 ntokens 8346097048 Example 19500 of 138376 loss = 3.5026 nll loss = 2.1296 accu = 0.3711

Training: Epoch 10 of 10 Step 4215 ntokens 8346132448 Example 19800 of 138376 loss = 3.5021 nll loss = 2.1290 accu = 0.3713

Training: Epoch 10 of 10 Step 4216 ntokens 8346167848 Example 20100 of 138376 loss = 3.5017 nll loss = 2.1284 accu = 0.3715

Training: Epoch 10 of 10 Step 4217 ntokens 8346203248 Example 20400 of 138376 loss = 3.5025 nll loss = 2.1282 accu = 0.3716

Training: Epoch 10 of 10 Step 4218 ntokens 8346238648 Example 20700 of 138376 loss = 3.5030 nll loss = 2.1280 accu = 0.3717

Training: Epoch 10 of 10 Step 4219 ntokens 8346274048 Example 21000 of 138376 loss = 3.5027 nll loss = 2.1277 accu = 0.3719

Training: Epoch 10 of 10 Step 4220 ntokens 8346309448 Example 21300 of 138376 loss = 3.5031 nll loss = 2.1270 accu = 0.3722

Training: Epoch 10 of 10 Step 4221 ntokens 8346344848 Example 21600 of 138376 loss = 3.5028 nll loss = 2.1268 accu = 0.3723

Training: Epoch 10 of 10 Step 4222 ntokens 8346380248 Example 21900 of 138376 loss = 3.5028 nll loss = 2.1261 accu = 0.3725

Training: Epoch 10 of 10 Step 4223 ntokens 8346415648 Example 22200 of 138376 loss = 3.5035 nll loss = 2.1260 accu = 0.3726

Training: Epoch 10 of 10 Step 4224 ntokens 8346451048 Example 22500 of 138376 loss = 3.5042 nll loss = 2.1245 accu = 0.3731

Training: Epoch 10 of 10 Step 4225 ntokens 8346486448 Example 22800 of 138376 loss = 3.5043 nll loss = 2.1243 accu = 0.3732

Training: Epoch 10 of 10 Step 4226 ntokens 8346521848 Example 23100 of 138376 loss = 3.5033 nll loss = 2.1236 accu = 0.3734

Training: Epoch 10 of 10 Step 4227 ntokens 8346557248 Example 23400 of 138376 loss = 3.5017 nll loss = 2.1235 accu = 0.3734

Training: Epoch 10 of 10 Step 4228 ntokens 8346592648 Example 23700 of 138376 loss = 3.5019 nll loss = 2.1220 accu = 0.3740

Training: Epoch 10 of 10 Step 4229 ntokens 8346628048 Example 24000 of 138376 loss = 3.5020 nll loss = 2.1221 accu = 0.3739

Training: Epoch 10 of 10 Step 4230 ntokens 8346663448 Example 24300 of 138376 loss = 3.5013 nll loss = 2.1226 accu = 0.3737

Training: Epoch 10 of 10 Step 4231 ntokens 8346698848 Example 24600 of 138376 loss = 3.5012 nll loss = 2.1230 accu = 0.3736

Training: Epoch 10 of 10 Step 4232 ntokens 8346734248 Example 24900 of 138376 loss = 3.5003 nll loss = 2.1231 accu = 0.3736

Training: Epoch 10 of 10 Step 4233 ntokens 8346769648 Example 25200 of 138376 loss = 3.5012 nll loss = 2.1247 accu = 0.3730

Training: Epoch 10 of 10 Step 4234 ntokens 8346805048 Example 25500 of 138376 loss = 3.5009 nll loss = 2.1246 accu = 0.3731

Training: Epoch 10 of 10 Step 4235 ntokens 8346840448 Example 25800 of 138376 loss = 3.5016 nll loss = 2.1246 accu = 0.3731

Training: Epoch 10 of 10 Step 4236 ntokens 8346875848 Example 26100 of 138376 loss = 3.5021 nll loss = 2.1244 accu = 0.3732

Training: Epoch 10 of 10 Step 4237 ntokens 8346911248 Example 26400 of 138376 loss = 3.5030 nll loss = 2.1236 accu = 0.3735

Training: Epoch 10 of 10 Step 4238 ntokens 8346946648 Example 26700 of 138376 loss = 3.5017 nll loss = 2.1236 accu = 0.3735

Training: Epoch 10 of 10 Step 4239 ntokens 8346982048 Example 27000 of 138376 loss = 3.5022 nll loss = 2.1237 accu = 0.3734

Training: Epoch 10 of 10 Step 4240 ntokens 8347017448 Example 27300 of 138376 loss = 3.5013 nll loss = 2.1237 accu = 0.3734

Training: Epoch 10 of 10 Step 4241 ntokens 8347052848 Example 27600 of 138376 loss = 3.5032 nll loss = 2.1235 accu = 0.3735

Training: Epoch 10 of 10 Step 4242 ntokens 8347088248 Example 27900 of 138376 loss = 3.5035 nll loss = 2.1230 accu = 0.3737

Training: Epoch 10 of 10 Step 4243 ntokens 8347123648 Example 28200 of 138376 loss = 3.5031 nll loss = 2.1223 accu = 0.3739

Training: Epoch 10 of 10 Step 4244 ntokens 8347159048 Example 28500 of 138376 loss = 3.5043 nll loss = 2.1231 accu = 0.3736

Training: Epoch 10 of 10 Step 4245 ntokens 8347194448 Example 28800 of 138376 loss = 3.5046 nll loss = 2.1230 accu = 0.3736

Training: Epoch 10 of 10 Step 4246 ntokens 8347229848 Example 29100 of 138376 loss = 3.5039 nll loss = 2.1231 accu = 0.3735

Training: Epoch 10 of 10 Step 4247 ntokens 8347265248 Example 29400 of 138376 loss = 3.5041 nll loss = 2.1236 accu = 0.3733

Training: Epoch 10 of 10 Step 4248 ntokens 8347300648 Example 29700 of 138376 loss = 3.5053 nll loss = 2.1235 accu = 0.3734

Training: Epoch 10 of 10 Step 4249 ntokens 8347336048 Example 30000 of 138376 loss = 3.5058 nll loss = 2.1245 accu = 0.3730

Training: Epoch 10 of 10 Step 4250 ntokens 8347371448 Example 30300 of 138376 loss = 3.5058 nll loss = 2.1245 accu = 0.3730

Training: Epoch 10 of 10 Step 4251 ntokens 8347406848 Example 30600 of 138376 loss = 3.5053 nll loss = 2.1248 accu = 0.3729

Training: Epoch 10 of 10 Step 4252 ntokens 8347442248 Example 30900 of 138376 loss = 3.5049 nll loss = 2.1250 accu = 0.3728

Training: Epoch 10 of 10 Step 4253 ntokens 8347477648 Example 31200 of 138376 loss = 3.5039 nll loss = 2.1256 accu = 0.3727

Training: Epoch 10 of 10 Step 4254 ntokens 8347513048 Example 31500 of 138376 loss = 3.5038 nll loss = 2.1249 accu = 0.3729

Training: Epoch 10 of 10 Step 4255 ntokens 8347548448 Example 31800 of 138376 loss = 3.5035 nll loss = 2.1245 accu = 0.3730

Training: Epoch 10 of 10 Step 4256 ntokens 8347583848 Example 32100 of 138376 loss = 3.5040 nll loss = 2.1248 accu = 0.3730

Training: Epoch 10 of 10 Step 4257 ntokens 8347619248 Example 32400 of 138376 loss = 3.5037 nll loss = 2.1243 accu = 0.3731

Training: Epoch 10 of 10 Step 4258 ntokens 8347654648 Example 32700 of 138376 loss = 3.5024 nll loss = 2.1239 accu = 0.3732

Training: Epoch 10 of 10 Step 4259 ntokens 8347690048 Example 33000 of 138376 loss = 3.5027 nll loss = 2.1238 accu = 0.3733

Training: Epoch 10 of 10 Step 4260 ntokens 8347725448 Example 33300 of 138376 loss = 3.5030 nll loss = 2.1235 accu = 0.3734

Training: Epoch 10 of 10 Step 4261 ntokens 8347760848 Example 33600 of 138376 loss = 3.5040 nll loss = 2.1234 accu = 0.3734

Training: Epoch 10 of 10 Step 4262 ntokens 8347796248 Example 33900 of 138376 loss = 3.5047 nll loss = 2.1238 accu = 0.3733

Training: Epoch 10 of 10 Step 4263 ntokens 8347831648 Example 34200 of 138376 loss = 3.5046 nll loss = 2.1240 accu = 0.3732

Training: Epoch 10 of 10 Step 4264 ntokens 8347867048 Example 34500 of 138376 loss = 3.5054 nll loss = 2.1240 accu = 0.3732

Training: Epoch 10 of 10 Step 4265 ntokens 8347902448 Example 34800 of 138376 loss = 3.5062 nll loss = 2.1244 accu = 0.3730

Training: Epoch 10 of 10 Step 4266 ntokens 8347937848 Example 35100 of 138376 loss = 3.5071 nll loss = 2.1239 accu = 0.3732

Training: Epoch 10 of 10 Step 4267 ntokens 8347973248 Example 35400 of 138376 loss = 3.5075 nll loss = 2.1241 accu = 0.3731

Training: Epoch 10 of 10 Step 4268 ntokens 8348008648 Example 35700 of 138376 loss = 3.5080 nll loss = 2.1240 accu = 0.3732

Training: Epoch 10 of 10 Step 4269 ntokens 8348044048 Example 36000 of 138376 loss = 3.5082 nll loss = 2.1241 accu = 0.3731

Training: Epoch 10 of 10 Step 4270 ntokens 8348079448 Example 36300 of 138376 loss = 3.5082 nll loss = 2.1233 accu = 0.3734

Training: Epoch 10 of 10 Step 4271 ntokens 8348114848 Example 36600 of 138376 loss = 3.5075 nll loss = 2.1236 accu = 0.3733

Training: Epoch 10 of 10 Step 4272 ntokens 8348150248 Example 36900 of 138376 loss = 3.5064 nll loss = 2.1230 accu = 0.3735

Training: Epoch 10 of 10 Step 4273 ntokens 8348185648 Example 37200 of 138376 loss = 3.5059 nll loss = 2.1226 accu = 0.3736

Training: Epoch 10 of 10 Step 4274 ntokens 8348221048 Example 37500 of 138376 loss = 3.5053 nll loss = 2.1228 accu = 0.3736

Training: Epoch 10 of 10 Step 4275 ntokens 8348256448 Example 37800 of 138376 loss = 3.5050 nll loss = 2.1227 accu = 0.3736

Training: Epoch 10 of 10 Step 4276 ntokens 8348291848 Example 38100 of 138376 loss = 3.5051 nll loss = 2.1228 accu = 0.3736

Training: Epoch 10 of 10 Step 4277 ntokens 8348327248 Example 38400 of 138376 loss = 3.5043 nll loss = 2.1233 accu = 0.3733

Training: Epoch 10 of 10 Step 4278 ntokens 8348362648 Example 38700 of 138376 loss = 3.5037 nll loss = 2.1234 accu = 0.3733

Training: Epoch 10 of 10 Step 4279 ntokens 8348398048 Example 39000 of 138376 loss = 3.5038 nll loss = 2.1232 accu = 0.3734

Training: Epoch 10 of 10 Step 4280 ntokens 8348433448 Example 39300 of 138376 loss = 3.5031 nll loss = 2.1231 accu = 0.3734

Training: Epoch 10 of 10 Step 4281 ntokens 8348468848 Example 39600 of 138376 loss = 3.5033 nll loss = 2.1228 accu = 0.3735

Training: Epoch 10 of 10 Step 4282 ntokens 8348504248 Example 39900 of 138376 loss = 3.5031 nll loss = 2.1225 accu = 0.3736

Training: Epoch 10 of 10 Step 4283 ntokens 8348539648 Example 40200 of 138376 loss = 3.5029 nll loss = 2.1226 accu = 0.3736

Training: Epoch 10 of 10 Step 4284 ntokens 8348575048 Example 40500 of 138376 loss = 3.5036 nll loss = 2.1226 accu = 0.3736

Training: Epoch 10 of 10 Step 4285 ntokens 8348610448 Example 40800 of 138376 loss = 3.5040 nll loss = 2.1226 accu = 0.3736

Training: Epoch 10 of 10 Step 4286 ntokens 8348645848 Example 41100 of 138376 loss = 3.5046 nll loss = 2.1226 accu = 0.3736

Training: Epoch 10 of 10 Step 4287 ntokens 8348681248 Example 41400 of 138376 loss = 3.5058 nll loss = 2.1227 accu = 0.3735

Training: Epoch 10 of 10 Step 4288 ntokens 8348716648 Example 41700 of 138376 loss = 3.5050 nll loss = 2.1227 accu = 0.3735

Training: Epoch 10 of 10 Step 4289 ntokens 8348752048 Example 42000 of 138376 loss = 3.5059 nll loss = 2.1229 accu = 0.3734

Training: Epoch 10 of 10 Step 4290 ntokens 8348787448 Example 42300 of 138376 loss = 3.5061 nll loss = 2.1224 accu = 0.3736

Training: Epoch 10 of 10 Step 4291 ntokens 8348822848 Example 42600 of 138376 loss = 3.5060 nll loss = 2.1222 accu = 0.3737

Training: Epoch 10 of 10 Step 4292 ntokens 8348858248 Example 42900 of 138376 loss = 3.5059 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4293 ntokens 8348893648 Example 43200 of 138376 loss = 3.5055 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4294 ntokens 8348929048 Example 43500 of 138376 loss = 3.5053 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4295 ntokens 8348964448 Example 43800 of 138376 loss = 3.5049 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4296 ntokens 8348999848 Example 44100 of 138376 loss = 3.5048 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4297 ntokens 8349035248 Example 44400 of 138376 loss = 3.5043 nll loss = 2.1222 accu = 0.3737

Training: Epoch 10 of 10 Step 4298 ntokens 8349070648 Example 44700 of 138376 loss = 3.5045 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4299 ntokens 8349106048 Example 45000 of 138376 loss = 3.5045 nll loss = 2.1224 accu = 0.3736

Training: Epoch 10 of 10 Step 4300 ntokens 8349141448 Example 45300 of 138376 loss = 3.5039 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4301 ntokens 8349176848 Example 45600 of 138376 loss = 3.5036 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4302 ntokens 8349212248 Example 45900 of 138376 loss = 3.5037 nll loss = 2.1226 accu = 0.3735

Training: Epoch 10 of 10 Step 4303 ntokens 8349247648 Example 46200 of 138376 loss = 3.5030 nll loss = 2.1228 accu = 0.3734

Training: Epoch 10 of 10 Step 4304 ntokens 8349283048 Example 46500 of 138376 loss = 3.5025 nll loss = 2.1225 accu = 0.3736

Training: Epoch 10 of 10 Step 4305 ntokens 8349318448 Example 46800 of 138376 loss = 3.5030 nll loss = 2.1232 accu = 0.3733

Training: Epoch 10 of 10 Step 4306 ntokens 8349353848 Example 47100 of 138376 loss = 3.5034 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4307 ntokens 8349389248 Example 47400 of 138376 loss = 3.5035 nll loss = 2.1243 accu = 0.3730

Training: Epoch 10 of 10 Step 4308 ntokens 8349424648 Example 47700 of 138376 loss = 3.5035 nll loss = 2.1242 accu = 0.3730

Training: Epoch 10 of 10 Step 4309 ntokens 8349460048 Example 48000 of 138376 loss = 3.5033 nll loss = 2.1244 accu = 0.3729

Training: Epoch 10 of 10 Step 4310 ntokens 8349495448 Example 48300 of 138376 loss = 3.5037 nll loss = 2.1244 accu = 0.3729

Training: Epoch 10 of 10 Step 4311 ntokens 8349530848 Example 48600 of 138376 loss = 3.5035 nll loss = 2.1248 accu = 0.3728

Training: Epoch 10 of 10 Step 4312 ntokens 8349566248 Example 48900 of 138376 loss = 3.5038 nll loss = 2.1246 accu = 0.3728

Training: Epoch 10 of 10 Step 4313 ntokens 8349601648 Example 49200 of 138376 loss = 3.5041 nll loss = 2.1250 accu = 0.3727

Training: Epoch 10 of 10 Step 4314 ntokens 8349637048 Example 49500 of 138376 loss = 3.5042 nll loss = 2.1248 accu = 0.3727

Training: Epoch 10 of 10 Step 4315 ntokens 8349672448 Example 49800 of 138376 loss = 3.5043 nll loss = 2.1245 accu = 0.3729

Training: Epoch 10 of 10 Step 4316 ntokens 8349707848 Example 50100 of 138376 loss = 3.5046 nll loss = 2.1244 accu = 0.3729

Training: Epoch 10 of 10 Step 4317 ntokens 8349743248 Example 50400 of 138376 loss = 3.5040 nll loss = 2.1246 accu = 0.3728

Training: Epoch 10 of 10 Step 4318 ntokens 8349778648 Example 50700 of 138376 loss = 3.5040 nll loss = 2.1248 accu = 0.3727

Training: Epoch 10 of 10 Step 4319 ntokens 8349814048 Example 51000 of 138376 loss = 3.5037 nll loss = 2.1247 accu = 0.3728

Training: Epoch 10 of 10 Step 4320 ntokens 8349849448 Example 51300 of 138376 loss = 3.5036 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4321 ntokens 8349884848 Example 51600 of 138376 loss = 3.5033 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4322 ntokens 8349920248 Example 51900 of 138376 loss = 3.5026 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4323 ntokens 8349955648 Example 52200 of 138376 loss = 3.5031 nll loss = 2.1239 accu = 0.3731

Training: Epoch 10 of 10 Step 4324 ntokens 8349991048 Example 52500 of 138376 loss = 3.5032 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4325 ntokens 8350026448 Example 52800 of 138376 loss = 3.5038 nll loss = 2.1235 accu = 0.3732

Training: Epoch 10 of 10 Step 4326 ntokens 8350061848 Example 53100 of 138376 loss = 3.5037 nll loss = 2.1235 accu = 0.3732

Training: Epoch 10 of 10 Step 4327 ntokens 8350097248 Example 53400 of 138376 loss = 3.5043 nll loss = 2.1238 accu = 0.3731

Training: Epoch 10 of 10 Step 4328 ntokens 8350132648 Example 53700 of 138376 loss = 3.5043 nll loss = 2.1238 accu = 0.3731

Training: Epoch 10 of 10 Step 4329 ntokens 8350168048 Example 54000 of 138376 loss = 3.5044 nll loss = 2.1238 accu = 0.3731

Training: Epoch 10 of 10 Step 4330 ntokens 8350203448 Example 54300 of 138376 loss = 3.5037 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4331 ntokens 8350238848 Example 54600 of 138376 loss = 3.5042 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4332 ntokens 8350274248 Example 54900 of 138376 loss = 3.5040 nll loss = 2.1229 accu = 0.3734

Training: Epoch 10 of 10 Step 4333 ntokens 8350309648 Example 55200 of 138376 loss = 3.5046 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4334 ntokens 8350345048 Example 55500 of 138376 loss = 3.5050 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4335 ntokens 8350380448 Example 55800 of 138376 loss = 3.5057 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4336 ntokens 8350415848 Example 56100 of 138376 loss = 3.5056 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4337 ntokens 8350451248 Example 56400 of 138376 loss = 3.5054 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4338 ntokens 8350486648 Example 56700 of 138376 loss = 3.5056 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4339 ntokens 8350522048 Example 57000 of 138376 loss = 3.5061 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4340 ntokens 8350557448 Example 57300 of 138376 loss = 3.5063 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4341 ntokens 8350592848 Example 57600 of 138376 loss = 3.5067 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4342 ntokens 8350628248 Example 57900 of 138376 loss = 3.5066 nll loss = 2.1224 accu = 0.3735

Training: Epoch 10 of 10 Step 4343 ntokens 8350663648 Example 58200 of 138376 loss = 3.5063 nll loss = 2.1224 accu = 0.3735

Training: Epoch 10 of 10 Step 4344 ntokens 8350699048 Example 58500 of 138376 loss = 3.5060 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4345 ntokens 8350734448 Example 58800 of 138376 loss = 3.5061 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4346 ntokens 8350769848 Example 59100 of 138376 loss = 3.5063 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4347 ntokens 8350805248 Example 59400 of 138376 loss = 3.5065 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4348 ntokens 8350840648 Example 59700 of 138376 loss = 3.5065 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4349 ntokens 8350876048 Example 60000 of 138376 loss = 3.5062 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4350 ntokens 8350911448 Example 60300 of 138376 loss = 3.5059 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4351 ntokens 8350946848 Example 60600 of 138376 loss = 3.5061 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4352 ntokens 8350982248 Example 60900 of 138376 loss = 3.5057 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4353 ntokens 8351017648 Example 61200 of 138376 loss = 3.5063 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4354 ntokens 8351053048 Example 61500 of 138376 loss = 3.5057 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4355 ntokens 8351088448 Example 61800 of 138376 loss = 3.5052 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4356 ntokens 8351123848 Example 62100 of 138376 loss = 3.5048 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4357 ntokens 8351159248 Example 62400 of 138376 loss = 3.5047 nll loss = 2.1221 accu = 0.3736

Training: Epoch 10 of 10 Step 4358 ntokens 8351194648 Example 62700 of 138376 loss = 3.5044 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4359 ntokens 8351230048 Example 63000 of 138376 loss = 3.5040 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4360 ntokens 8351265448 Example 63300 of 138376 loss = 3.5046 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4361 ntokens 8351300848 Example 63600 of 138376 loss = 3.5047 nll loss = 2.1224 accu = 0.3735

Training: Epoch 10 of 10 Step 4362 ntokens 8351336248 Example 63900 of 138376 loss = 3.5047 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4363 ntokens 8351371648 Example 64200 of 138376 loss = 3.5045 nll loss = 2.1228 accu = 0.3734

Training: Epoch 10 of 10 Step 4364 ntokens 8351407048 Example 64500 of 138376 loss = 3.5042 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4365 ntokens 8351442448 Example 64800 of 138376 loss = 3.5039 nll loss = 2.1226 accu = 0.3734

Training: Epoch 10 of 10 Step 4366 ntokens 8351477848 Example 65100 of 138376 loss = 3.5042 nll loss = 2.1226 accu = 0.3734

Training: Epoch 10 of 10 Step 4367 ntokens 8351513248 Example 65400 of 138376 loss = 3.5037 nll loss = 2.1228 accu = 0.3733

Training: Epoch 10 of 10 Step 4368 ntokens 8351548648 Example 65700 of 138376 loss = 3.5037 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4369 ntokens 8351584048 Example 66000 of 138376 loss = 3.5040 nll loss = 2.1223 accu = 0.3735

Training: Epoch 10 of 10 Step 4370 ntokens 8351619448 Example 66300 of 138376 loss = 3.5042 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4371 ntokens 8351654848 Example 66600 of 138376 loss = 3.5039 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4372 ntokens 8351690248 Example 66900 of 138376 loss = 3.5034 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4373 ntokens 8351725648 Example 67200 of 138376 loss = 3.5035 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4374 ntokens 8351761048 Example 67500 of 138376 loss = 3.5035 nll loss = 2.1229 accu = 0.3734

Training: Epoch 10 of 10 Step 4375 ntokens 8351796448 Example 67800 of 138376 loss = 3.5040 nll loss = 2.1228 accu = 0.3734

Training: Epoch 10 of 10 Step 4376 ntokens 8351831848 Example 68100 of 138376 loss = 3.5038 nll loss = 2.1228 accu = 0.3734

Training: Epoch 10 of 10 Step 4377 ntokens 8351867248 Example 68400 of 138376 loss = 3.5035 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4378 ntokens 8351902648 Example 68700 of 138376 loss = 3.5033 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4379 ntokens 8351938048 Example 69000 of 138376 loss = 3.5038 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4380 ntokens 8351973448 Example 69300 of 138376 loss = 3.5034 nll loss = 2.1226 accu = 0.3735

Training: Epoch 10 of 10 Step 4381 ntokens 8352008848 Example 69600 of 138376 loss = 3.5036 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4382 ntokens 8352044248 Example 69900 of 138376 loss = 3.5039 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4383 ntokens 8352079648 Example 70200 of 138376 loss = 3.5038 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4384 ntokens 8352115048 Example 70500 of 138376 loss = 3.5042 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4385 ntokens 8352150448 Example 70800 of 138376 loss = 3.5041 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4386 ntokens 8352185848 Example 71100 of 138376 loss = 3.5038 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4387 ntokens 8352221248 Example 71400 of 138376 loss = 3.5038 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4388 ntokens 8352256648 Example 71700 of 138376 loss = 3.5039 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4389 ntokens 8352292048 Example 72000 of 138376 loss = 3.5036 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4390 ntokens 8352327448 Example 72300 of 138376 loss = 3.5036 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4391 ntokens 8352362848 Example 72600 of 138376 loss = 3.5035 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4392 ntokens 8352398248 Example 72900 of 138376 loss = 3.5036 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4393 ntokens 8352433648 Example 73200 of 138376 loss = 3.5033 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4394 ntokens 8352469048 Example 73500 of 138376 loss = 3.5037 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4395 ntokens 8352504448 Example 73800 of 138376 loss = 3.5035 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4396 ntokens 8352539848 Example 74100 of 138376 loss = 3.5034 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4397 ntokens 8352575248 Example 74400 of 138376 loss = 3.5034 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4398 ntokens 8352610648 Example 74700 of 138376 loss = 3.5031 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4399 ntokens 8352646048 Example 75000 of 138376 loss = 3.5030 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4400 ntokens 8352681448 Example 75300 of 138376 loss = 3.5029 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4401 ntokens 8352716848 Example 75600 of 138376 loss = 3.5028 nll loss = 2.1227 accu = 0.3734

Training: Epoch 10 of 10 Step 4402 ntokens 8352752248 Example 75900 of 138376 loss = 3.5027 nll loss = 2.1224 accu = 0.3735

Training: Epoch 10 of 10 Step 4403 ntokens 8352787648 Example 76200 of 138376 loss = 3.5029 nll loss = 2.1223 accu = 0.3735

Training: Epoch 10 of 10 Step 4404 ntokens 8352823048 Example 76500 of 138376 loss = 3.5025 nll loss = 2.1218 accu = 0.3737

Training: Epoch 10 of 10 Step 4405 ntokens 8352858448 Example 76800 of 138376 loss = 3.5027 nll loss = 2.1214 accu = 0.3738

Training: Epoch 10 of 10 Step 4406 ntokens 8352893848 Example 77100 of 138376 loss = 3.5027 nll loss = 2.1215 accu = 0.3738

Training: Epoch 10 of 10 Step 4407 ntokens 8352929248 Example 77400 of 138376 loss = 3.5025 nll loss = 2.1215 accu = 0.3738

Training: Epoch 10 of 10 Step 4408 ntokens 8352964648 Example 77700 of 138376 loss = 3.5026 nll loss = 2.1213 accu = 0.3739

Training: Epoch 10 of 10 Step 4409 ntokens 8353000048 Example 78000 of 138376 loss = 3.5026 nll loss = 2.1215 accu = 0.3738

Training: Epoch 10 of 10 Step 4410 ntokens 8353035448 Example 78300 of 138376 loss = 3.5024 nll loss = 2.1213 accu = 0.3739

Training: Epoch 10 of 10 Step 4411 ntokens 8353070848 Example 78600 of 138376 loss = 3.5024 nll loss = 2.1215 accu = 0.3738

Training: Epoch 10 of 10 Step 4412 ntokens 8353106248 Example 78900 of 138376 loss = 3.5023 nll loss = 2.1214 accu = 0.3739

Training: Epoch 10 of 10 Step 4413 ntokens 8353141648 Example 79200 of 138376 loss = 3.5017 nll loss = 2.1216 accu = 0.3738

Training: Epoch 10 of 10 Step 4414 ntokens 8353177048 Example 79500 of 138376 loss = 3.5021 nll loss = 2.1214 accu = 0.3738

Training: Epoch 10 of 10 Step 4415 ntokens 8353212448 Example 79800 of 138376 loss = 3.5020 nll loss = 2.1215 accu = 0.3738

Training: Epoch 10 of 10 Step 4416 ntokens 8353247848 Example 80100 of 138376 loss = 3.5021 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4417 ntokens 8353283248 Example 80400 of 138376 loss = 3.5024 nll loss = 2.1217 accu = 0.3737

Training: Epoch 10 of 10 Step 4418 ntokens 8353318648 Example 80700 of 138376 loss = 3.5022 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4419 ntokens 8353354048 Example 81000 of 138376 loss = 3.5021 nll loss = 2.1221 accu = 0.3736

Training: Epoch 10 of 10 Step 4420 ntokens 8353389448 Example 81300 of 138376 loss = 3.5024 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4421 ntokens 8353424848 Example 81600 of 138376 loss = 3.5020 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4422 ntokens 8353460248 Example 81900 of 138376 loss = 3.5021 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4423 ntokens 8353495648 Example 82200 of 138376 loss = 3.5019 nll loss = 2.1218 accu = 0.3737

Training: Epoch 10 of 10 Step 4424 ntokens 8353531048 Example 82500 of 138376 loss = 3.5018 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4425 ntokens 8353566448 Example 82800 of 138376 loss = 3.5020 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4426 ntokens 8353601848 Example 83100 of 138376 loss = 3.5019 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4427 ntokens 8353637248 Example 83400 of 138376 loss = 3.5022 nll loss = 2.1224 accu = 0.3735

Training: Epoch 10 of 10 Step 4428 ntokens 8353672648 Example 83700 of 138376 loss = 3.5023 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4429 ntokens 8353708048 Example 84000 of 138376 loss = 3.5022 nll loss = 2.1221 accu = 0.3736

Training: Epoch 10 of 10 Step 4430 ntokens 8353743448 Example 84300 of 138376 loss = 3.5022 nll loss = 2.1218 accu = 0.3737

Training: Epoch 10 of 10 Step 4431 ntokens 8353778848 Example 84600 of 138376 loss = 3.5024 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4432 ntokens 8353814248 Example 84900 of 138376 loss = 3.5026 nll loss = 2.1221 accu = 0.3737

Training: Epoch 10 of 10 Step 4433 ntokens 8353849648 Example 85200 of 138376 loss = 3.5029 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4434 ntokens 8353885048 Example 85500 of 138376 loss = 3.5030 nll loss = 2.1214 accu = 0.3739

Training: Epoch 10 of 10 Step 4435 ntokens 8353920448 Example 85800 of 138376 loss = 3.5029 nll loss = 2.1212 accu = 0.3739

Training: Epoch 10 of 10 Step 4436 ntokens 8353955848 Example 86100 of 138376 loss = 3.5033 nll loss = 2.1215 accu = 0.3739

Training: Epoch 10 of 10 Step 4437 ntokens 8353991248 Example 86400 of 138376 loss = 3.5035 nll loss = 2.1213 accu = 0.3739

Training: Epoch 10 of 10 Step 4438 ntokens 8354026648 Example 86700 of 138376 loss = 3.5033 nll loss = 2.1212 accu = 0.3740

Training: Epoch 10 of 10 Step 4439 ntokens 8354062048 Example 87000 of 138376 loss = 3.5031 nll loss = 2.1213 accu = 0.3739

Training: Epoch 10 of 10 Step 4440 ntokens 8354097448 Example 87300 of 138376 loss = 3.5030 nll loss = 2.1213 accu = 0.3739

Training: Epoch 10 of 10 Step 4441 ntokens 8354132848 Example 87600 of 138376 loss = 3.5030 nll loss = 2.1212 accu = 0.3740

Training: Epoch 10 of 10 Step 4442 ntokens 8354168248 Example 87900 of 138376 loss = 3.5034 nll loss = 2.1213 accu = 0.3740

Training: Epoch 10 of 10 Step 4443 ntokens 8354203648 Example 88200 of 138376 loss = 3.5030 nll loss = 2.1211 accu = 0.3740

Training: Epoch 10 of 10 Step 4444 ntokens 8354239048 Example 88500 of 138376 loss = 3.5033 nll loss = 2.1213 accu = 0.3739

Training: Epoch 10 of 10 Step 4445 ntokens 8354274448 Example 88800 of 138376 loss = 3.5034 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4446 ntokens 8354309848 Example 89100 of 138376 loss = 3.5035 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4447 ntokens 8354345248 Example 89400 of 138376 loss = 3.5035 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4448 ntokens 8354380648 Example 89700 of 138376 loss = 3.5033 nll loss = 2.1216 accu = 0.3738

Training: Epoch 10 of 10 Step 4449 ntokens 8354416048 Example 90000 of 138376 loss = 3.5033 nll loss = 2.1213 accu = 0.3740

Training: Epoch 10 of 10 Step 4450 ntokens 8354451448 Example 90300 of 138376 loss = 3.5033 nll loss = 2.1214 accu = 0.3739

Training: Epoch 10 of 10 Step 4451 ntokens 8354486848 Example 90600 of 138376 loss = 3.5032 nll loss = 2.1213 accu = 0.3740

Training: Epoch 10 of 10 Step 4452 ntokens 8354522248 Example 90900 of 138376 loss = 3.5033 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4453 ntokens 8354557648 Example 91200 of 138376 loss = 3.5034 nll loss = 2.1215 accu = 0.3739

Training: Epoch 10 of 10 Step 4454 ntokens 8354593048 Example 91500 of 138376 loss = 3.5036 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4455 ntokens 8354628448 Example 91800 of 138376 loss = 3.5037 nll loss = 2.1215 accu = 0.3739

Training: Epoch 10 of 10 Step 4456 ntokens 8354663848 Example 92100 of 138376 loss = 3.5035 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4457 ntokens 8354699248 Example 92400 of 138376 loss = 3.5034 nll loss = 2.1215 accu = 0.3739

Training: Epoch 10 of 10 Step 4458 ntokens 8354734648 Example 92700 of 138376 loss = 3.5031 nll loss = 2.1216 accu = 0.3738

Training: Epoch 10 of 10 Step 4459 ntokens 8354770048 Example 93000 of 138376 loss = 3.5029 nll loss = 2.1216 accu = 0.3738

Training: Epoch 10 of 10 Step 4460 ntokens 8354805448 Example 93300 of 138376 loss = 3.5029 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4461 ntokens 8354840848 Example 93600 of 138376 loss = 3.5027 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4462 ntokens 8354876248 Example 93900 of 138376 loss = 3.5027 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4463 ntokens 8354911648 Example 94200 of 138376 loss = 3.5030 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4464 ntokens 8354947048 Example 94500 of 138376 loss = 3.5029 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4465 ntokens 8354982448 Example 94800 of 138376 loss = 3.5025 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4466 ntokens 8355017848 Example 95100 of 138376 loss = 3.5029 nll loss = 2.1221 accu = 0.3737

Training: Epoch 10 of 10 Step 4467 ntokens 8355053248 Example 95400 of 138376 loss = 3.5029 nll loss = 2.1221 accu = 0.3737

Training: Epoch 10 of 10 Step 4468 ntokens 8355088648 Example 95700 of 138376 loss = 3.5032 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4469 ntokens 8355124048 Example 96000 of 138376 loss = 3.5031 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4470 ntokens 8355159448 Example 96300 of 138376 loss = 3.5032 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4471 ntokens 8355194848 Example 96600 of 138376 loss = 3.5032 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4472 ntokens 8355230248 Example 96900 of 138376 loss = 3.5033 nll loss = 2.1220 accu = 0.3737

Training: Epoch 10 of 10 Step 4473 ntokens 8355265648 Example 97200 of 138376 loss = 3.5033 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4474 ntokens 8355301048 Example 97500 of 138376 loss = 3.5035 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4475 ntokens 8355336448 Example 97800 of 138376 loss = 3.5036 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4476 ntokens 8355371848 Example 98100 of 138376 loss = 3.5037 nll loss = 2.1220 accu = 0.3738

Training: Epoch 10 of 10 Step 4477 ntokens 8355407248 Example 98400 of 138376 loss = 3.5039 nll loss = 2.1220 accu = 0.3738

Training: Epoch 10 of 10 Step 4478 ntokens 8355442648 Example 98700 of 138376 loss = 3.5038 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4479 ntokens 8355478048 Example 99000 of 138376 loss = 3.5038 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4480 ntokens 8355513448 Example 99300 of 138376 loss = 3.5039 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4481 ntokens 8355548848 Example 99600 of 138376 loss = 3.5041 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4482 ntokens 8355584248 Example 99900 of 138376 loss = 3.5035 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4483 ntokens 8355619648 Example 100200 of 138376 loss = 3.5038 nll loss = 2.1216 accu = 0.3738

Training: Epoch 10 of 10 Step 4484 ntokens 8355655048 Example 100500 of 138376 loss = 3.5036 nll loss = 2.1216 accu = 0.3739

Training: Epoch 10 of 10 Step 4485 ntokens 8355690448 Example 100800 of 138376 loss = 3.5036 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4486 ntokens 8355725848 Example 101100 of 138376 loss = 3.5035 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4487 ntokens 8355761248 Example 101400 of 138376 loss = 3.5031 nll loss = 2.1217 accu = 0.3738

Training: Epoch 10 of 10 Step 4488 ntokens 8355796648 Example 101700 of 138376 loss = 3.5027 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4489 ntokens 8355832048 Example 102000 of 138376 loss = 3.5026 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4490 ntokens 8355867448 Example 102300 of 138376 loss = 3.5024 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4491 ntokens 8355902848 Example 102600 of 138376 loss = 3.5025 nll loss = 2.1221 accu = 0.3737

Training: Epoch 10 of 10 Step 4492 ntokens 8355938248 Example 102900 of 138376 loss = 3.5026 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4493 ntokens 8355973648 Example 103200 of 138376 loss = 3.5026 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4494 ntokens 8356009048 Example 103500 of 138376 loss = 3.5028 nll loss = 2.1222 accu = 0.3737

Training: Epoch 10 of 10 Step 4495 ntokens 8356044448 Example 103800 of 138376 loss = 3.5026 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4496 ntokens 8356079848 Example 104100 of 138376 loss = 3.5025 nll loss = 2.1222 accu = 0.3737

Training: Epoch 10 of 10 Step 4497 ntokens 8356115248 Example 104400 of 138376 loss = 3.5024 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4498 ntokens 8356150648 Example 104700 of 138376 loss = 3.5025 nll loss = 2.1222 accu = 0.3737

Training: Epoch 10 of 10 Step 4499 ntokens 8356186048 Example 105000 of 138376 loss = 3.5025 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4500 ntokens 8356221448 Example 105300 of 138376 loss = 3.5022 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4501 ntokens 8356256848 Example 105600 of 138376 loss = 3.5020 nll loss = 2.1219 accu = 0.3738

Training: Epoch 10 of 10 Step 4502 ntokens 8356292248 Example 105900 of 138376 loss = 3.5021 nll loss = 2.1216 accu = 0.3738

Training: Epoch 10 of 10 Step 4503 ntokens 8356327648 Example 106200 of 138376 loss = 3.5023 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4504 ntokens 8356363048 Example 106500 of 138376 loss = 3.5024 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4505 ntokens 8356398448 Example 106800 of 138376 loss = 3.5024 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4506 ntokens 8356433848 Example 107100 of 138376 loss = 3.5026 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4507 ntokens 8356469248 Example 107400 of 138376 loss = 3.5026 nll loss = 2.1219 accu = 0.3737

Training: Epoch 10 of 10 Step 4508 ntokens 8356504648 Example 107700 of 138376 loss = 3.5025 nll loss = 2.1218 accu = 0.3738

Training: Epoch 10 of 10 Step 4509 ntokens 8356540048 Example 108000 of 138376 loss = 3.5026 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4510 ntokens 8356575448 Example 108300 of 138376 loss = 3.5027 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4511 ntokens 8356610848 Example 108600 of 138376 loss = 3.5029 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4512 ntokens 8356646248 Example 108900 of 138376 loss = 3.5028 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4513 ntokens 8356681648 Example 109200 of 138376 loss = 3.5027 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4514 ntokens 8356717048 Example 109500 of 138376 loss = 3.5025 nll loss = 2.1224 accu = 0.3736

Training: Epoch 10 of 10 Step 4515 ntokens 8356752448 Example 109800 of 138376 loss = 3.5022 nll loss = 2.1224 accu = 0.3736

Training: Epoch 10 of 10 Step 4516 ntokens 8356787848 Example 110100 of 138376 loss = 3.5019 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4517 ntokens 8356823248 Example 110400 of 138376 loss = 3.5020 nll loss = 2.1222 accu = 0.3736

Training: Epoch 10 of 10 Step 4518 ntokens 8356858648 Example 110700 of 138376 loss = 3.5022 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4519 ntokens 8356894048 Example 111000 of 138376 loss = 3.5020 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4520 ntokens 8356929448 Example 111300 of 138376 loss = 3.5019 nll loss = 2.1226 accu = 0.3735

Training: Epoch 10 of 10 Step 4521 ntokens 8356964848 Example 111600 of 138376 loss = 3.5017 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4522 ntokens 8357000248 Example 111900 of 138376 loss = 3.5016 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4523 ntokens 8357035648 Example 112200 of 138376 loss = 3.5015 nll loss = 2.1224 accu = 0.3735

Training: Epoch 10 of 10 Step 4524 ntokens 8357071048 Example 112500 of 138376 loss = 3.5015 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4525 ntokens 8357106448 Example 112800 of 138376 loss = 3.5013 nll loss = 2.1223 accu = 0.3736

Training: Epoch 10 of 10 Step 4526 ntokens 8357141848 Example 113100 of 138376 loss = 3.5014 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4527 ntokens 8357177248 Example 113400 of 138376 loss = 3.5013 nll loss = 2.1226 accu = 0.3735

Training: Epoch 10 of 10 Step 4528 ntokens 8357212648 Example 113700 of 138376 loss = 3.5013 nll loss = 2.1226 accu = 0.3734

Training: Epoch 10 of 10 Step 4529 ntokens 8357248048 Example 114000 of 138376 loss = 3.5011 nll loss = 2.1226 accu = 0.3735

Training: Epoch 10 of 10 Step 4530 ntokens 8357283448 Example 114300 of 138376 loss = 3.5009 nll loss = 2.1225 accu = 0.3735

Training: Epoch 10 of 10 Step 4531 ntokens 8357318848 Example 114600 of 138376 loss = 3.5010 nll loss = 2.1226 accu = 0.3735

Training: Epoch 10 of 10 Step 4532 ntokens 8357354248 Example 114900 of 138376 loss = 3.5011 nll loss = 2.1228 accu = 0.3734

Training: Epoch 10 of 10 Step 4533 ntokens 8357389648 Example 115200 of 138376 loss = 3.5009 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4534 ntokens 8357425048 Example 115500 of 138376 loss = 3.5009 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4535 ntokens 8357460448 Example 115800 of 138376 loss = 3.5009 nll loss = 2.1228 accu = 0.3734

Training: Epoch 10 of 10 Step 4536 ntokens 8357495848 Example 116100 of 138376 loss = 3.5008 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4537 ntokens 8357531248 Example 116400 of 138376 loss = 3.5010 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4538 ntokens 8357566648 Example 116700 of 138376 loss = 3.5010 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4539 ntokens 8357602048 Example 117000 of 138376 loss = 3.5010 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4540 ntokens 8357637448 Example 117300 of 138376 loss = 3.5009 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4541 ntokens 8357672848 Example 117600 of 138376 loss = 3.5012 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4542 ntokens 8357708248 Example 117900 of 138376 loss = 3.5012 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4543 ntokens 8357743648 Example 118200 of 138376 loss = 3.5012 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4544 ntokens 8357779048 Example 118500 of 138376 loss = 3.5015 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4545 ntokens 8357814448 Example 118800 of 138376 loss = 3.5014 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4546 ntokens 8357849848 Example 119100 of 138376 loss = 3.5014 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4547 ntokens 8357885248 Example 119400 of 138376 loss = 3.5012 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4548 ntokens 8357920648 Example 119700 of 138376 loss = 3.5012 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4549 ntokens 8357956048 Example 120000 of 138376 loss = 3.5012 nll loss = 2.1229 accu = 0.3733

Training: Epoch 10 of 10 Step 4550 ntokens 8357991448 Example 120300 of 138376 loss = 3.5012 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4551 ntokens 8358026848 Example 120600 of 138376 loss = 3.5011 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4552 ntokens 8358062248 Example 120900 of 138376 loss = 3.5011 nll loss = 2.1231 accu = 0.3733

Training: Epoch 10 of 10 Step 4553 ntokens 8358097648 Example 121200 of 138376 loss = 3.5011 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4554 ntokens 8358133048 Example 121500 of 138376 loss = 3.5015 nll loss = 2.1230 accu = 0.3733

Training: Epoch 10 of 10 Step 4555 ntokens 8358168448 Example 121800 of 138376 loss = 3.5014 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4556 ntokens 8358203848 Example 122100 of 138376 loss = 3.5014 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4557 ntokens 8358239248 Example 122400 of 138376 loss = 3.5015 nll loss = 2.1235 accu = 0.3732

Training: Epoch 10 of 10 Step 4558 ntokens 8358274648 Example 122700 of 138376 loss = 3.5015 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4559 ntokens 8358310048 Example 123000 of 138376 loss = 3.5013 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4560 ntokens 8358345448 Example 123300 of 138376 loss = 3.5013 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4561 ntokens 8358380848 Example 123600 of 138376 loss = 3.5013 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4562 ntokens 8358416248 Example 123900 of 138376 loss = 3.5014 nll loss = 2.1235 accu = 0.3732

Training: Epoch 10 of 10 Step 4563 ntokens 8358451648 Example 124200 of 138376 loss = 3.5011 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4564 ntokens 8358487048 Example 124500 of 138376 loss = 3.5010 nll loss = 2.1232 accu = 0.3733

Training: Epoch 10 of 10 Step 4565 ntokens 8358522448 Example 124800 of 138376 loss = 3.5012 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4566 ntokens 8358557848 Example 125100 of 138376 loss = 3.5012 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4567 ntokens 8358593248 Example 125400 of 138376 loss = 3.5013 nll loss = 2.1232 accu = 0.3732

Training: Epoch 10 of 10 Step 4568 ntokens 8358628648 Example 125700 of 138376 loss = 3.5014 nll loss = 2.1233 accu = 0.3732

Training: Epoch 10 of 10 Step 4569 ntokens 8358664048 Example 126000 of 138376 loss = 3.5016 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4570 ntokens 8358699448 Example 126300 of 138376 loss = 3.5016 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4571 ntokens 8358734848 Example 126600 of 138376 loss = 3.5017 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4572 ntokens 8358770248 Example 126900 of 138376 loss = 3.5019 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4573 ntokens 8358805648 Example 127200 of 138376 loss = 3.5019 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4574 ntokens 8358841048 Example 127500 of 138376 loss = 3.5018 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4575 ntokens 8358876448 Example 127800 of 138376 loss = 3.5018 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4576 ntokens 8358911848 Example 128100 of 138376 loss = 3.5017 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4577 ntokens 8358947248 Example 128400 of 138376 loss = 3.5018 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4578 ntokens 8358982648 Example 128700 of 138376 loss = 3.5021 nll loss = 2.1238 accu = 0.3730

Training: Epoch 10 of 10 Step 4579 ntokens 8359018048 Example 129000 of 138376 loss = 3.5022 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4580 ntokens 8359053448 Example 129300 of 138376 loss = 3.5022 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4581 ntokens 8359088848 Example 129600 of 138376 loss = 3.5024 nll loss = 2.1236 accu = 0.3731

Training: Epoch 10 of 10 Step 4582 ntokens 8359124248 Example 129900 of 138376 loss = 3.5022 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4583 ntokens 8359159648 Example 130200 of 138376 loss = 3.5024 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4584 ntokens 8359195048 Example 130500 of 138376 loss = 3.5025 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4585 ntokens 8359230448 Example 130800 of 138376 loss = 3.5027 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4586 ntokens 8359265848 Example 131100 of 138376 loss = 3.5028 nll loss = 2.1238 accu = 0.3730

Training: Epoch 10 of 10 Step 4587 ntokens 8359301248 Example 131400 of 138376 loss = 3.5026 nll loss = 2.1239 accu = 0.3730

Training: Epoch 10 of 10 Step 4588 ntokens 8359336648 Example 131700 of 138376 loss = 3.5028 nll loss = 2.1239 accu = 0.3730

Training: Epoch 10 of 10 Step 4589 ntokens 8359372048 Example 132000 of 138376 loss = 3.5027 nll loss = 2.1239 accu = 0.3730

Training: Epoch 10 of 10 Step 4590 ntokens 8359407448 Example 132300 of 138376 loss = 3.5027 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4591 ntokens 8359442848 Example 132600 of 138376 loss = 3.5028 nll loss = 2.1239 accu = 0.3730

Training: Epoch 10 of 10 Step 4592 ntokens 8359478248 Example 132900 of 138376 loss = 3.5028 nll loss = 2.1238 accu = 0.3730

Training: Epoch 10 of 10 Step 4593 ntokens 8359513648 Example 133200 of 138376 loss = 3.5028 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4594 ntokens 8359549048 Example 133500 of 138376 loss = 3.5027 nll loss = 2.1234 accu = 0.3732

Training: Epoch 10 of 10 Step 4595 ntokens 8359584448 Example 133800 of 138376 loss = 3.5029 nll loss = 2.1235 accu = 0.3732

Training: Epoch 10 of 10 Step 4596 ntokens 8359619848 Example 134100 of 138376 loss = 3.5028 nll loss = 2.1235 accu = 0.3731

Training: Epoch 10 of 10 Step 4597 ntokens 8359655248 Example 134400 of 138376 loss = 3.5030 nll loss = 2.1237 accu = 0.3731

Training: Epoch 10 of 10 Step 4598 ntokens 8359690648 Example 134700 of 138376 loss = 3.5029 nll loss = 2.1241 accu = 0.3729

Training: Epoch 10 of 10 Step 4599 ntokens 8359726048 Example 135000 of 138376 loss = 3.5030 nll loss = 2.1242 accu = 0.3729

Training: Epoch 10 of 10 Step 4600 ntokens 8359761448 Example 135300 of 138376 loss = 3.5028 nll loss = 2.1242 accu = 0.3729

Training: Epoch 10 of 10 Step 4601 ntokens 8359796848 Example 135600 of 138376 loss = 3.5025 nll loss = 2.1241 accu = 0.3729

Training: Epoch 10 of 10 Step 4602 ntokens 8359832248 Example 135900 of 138376 loss = 3.5026 nll loss = 2.1241 accu = 0.3729

Training: Epoch 10 of 10 Step 4603 ntokens 8359867648 Example 136200 of 138376 loss = 3.5025 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4604 ntokens 8359903048 Example 136500 of 138376 loss = 3.5027 nll loss = 2.1239 accu = 0.3730

Training: Epoch 10 of 10 Step 4605 ntokens 8359938448 Example 136800 of 138376 loss = 3.5028 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4606 ntokens 8359973848 Example 137100 of 138376 loss = 3.5026 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4607 ntokens 8360009248 Example 137400 of 138376 loss = 3.5027 nll loss = 2.1241 accu = 0.3729

Training: Epoch 10 of 10 Step 4608 ntokens 8360044648 Example 137700 of 138376 loss = 3.5028 nll loss = 2.1240 accu = 0.3730

Training: Epoch 10 of 10 Step 4609 ntokens 8360080048 Example 138000 of 138376 loss = 3.5028 nll loss = 2.1241 accu = 0.3730

Training: Epoch 10 of 10 Step 4610 ntokens 8360115448 Example 138300 of 138376 loss = 3.5029 nll loss = 2.1242 accu = 0.3729

Training: Epoch 10 of 10 Step 4611 ntokens 8360124416 Example 138376 of 138376 loss = 3.5029 nll loss = 2.1242 accu = 0.3729

Writing to checkpoint at 2024-05-28 17:13:04.931381
Validating: Epoch 10 of 10 Step 0 ntokens 8360124416 Example 300 of 34323 loss = 3.4382 nll loss = 2.0665 accu = 0.3913

Validating: Epoch 10 of 10 Step 1 ntokens 8360124416 Example 600 of 34323 loss = 3.4300 nll loss = 2.0893 accu = 0.3842

Validating: Epoch 10 of 10 Step 2 ntokens 8360124416 Example 900 of 34323 loss = 3.4748 nll loss = 2.1246 accu = 0.3713

Validating: Epoch 10 of 10 Step 3 ntokens 8360124416 Example 1200 of 34323 loss = 3.4789 nll loss = 2.1270 accu = 0.3709

Validating: Epoch 10 of 10 Step 4 ntokens 8360124416 Example 1500 of 34323 loss = 3.4918 nll loss = 2.1314 accu = 0.3691

Validating: Epoch 10 of 10 Step 5 ntokens 8360124416 Example 1800 of 34323 loss = 3.4891 nll loss = 2.1256 accu = 0.3711

Validating: Epoch 10 of 10 Step 6 ntokens 8360124416 Example 2100 of 34323 loss = 3.4836 nll loss = 2.1309 accu = 0.3695

Validating: Epoch 10 of 10 Step 7 ntokens 8360124416 Example 2400 of 34323 loss = 3.4820 nll loss = 2.1265 accu = 0.3710

Validating: Epoch 10 of 10 Step 8 ntokens 8360124416 Example 2700 of 34323 loss = 3.4823 nll loss = 2.1282 accu = 0.3705

Validating: Epoch 10 of 10 Step 9 ntokens 8360124416 Example 3000 of 34323 loss = 3.4754 nll loss = 2.1294 accu = 0.3705

Validating: Epoch 10 of 10 Step 10 ntokens 8360124416 Example 3300 of 34323 loss = 3.4722 nll loss = 2.1253 accu = 0.3719

Validating: Epoch 10 of 10 Step 11 ntokens 8360124416 Example 3600 of 34323 loss = 3.4693 nll loss = 2.1199 accu = 0.3740

Validating: Epoch 10 of 10 Step 12 ntokens 8360124416 Example 3900 of 34323 loss = 3.4762 nll loss = 2.1253 accu = 0.3722

Validating: Epoch 10 of 10 Step 13 ntokens 8360124416 Example 4200 of 34323 loss = 3.4776 nll loss = 2.1244 accu = 0.3727

Validating: Epoch 10 of 10 Step 14 ntokens 8360124416 Example 4500 of 34323 loss = 3.4774 nll loss = 2.1198 accu = 0.3743

Validating: Epoch 10 of 10 Step 15 ntokens 8360124416 Example 4800 of 34323 loss = 3.4815 nll loss = 2.1237 accu = 0.3727

Validating: Epoch 10 of 10 Step 16 ntokens 8360124416 Example 5100 of 34323 loss = 3.4865 nll loss = 2.1245 accu = 0.3726

Validating: Epoch 10 of 10 Step 17 ntokens 8360124416 Example 5400 of 34323 loss = 3.4899 nll loss = 2.1295 accu = 0.3709

Validating: Epoch 10 of 10 Step 18 ntokens 8360124416 Example 5700 of 34323 loss = 3.4865 nll loss = 2.1312 accu = 0.3704

Validating: Epoch 10 of 10 Step 19 ntokens 8360124416 Example 6000 of 34323 loss = 3.4871 nll loss = 2.1315 accu = 0.3702

Validating: Epoch 10 of 10 Step 20 ntokens 8360124416 Example 6300 of 34323 loss = 3.4869 nll loss = 2.1267 accu = 0.3720

Validating: Epoch 10 of 10 Step 21 ntokens 8360124416 Example 6600 of 34323 loss = 3.4913 nll loss = 2.1302 accu = 0.3707

Validating: Epoch 10 of 10 Step 22 ntokens 8360124416 Example 6900 of 34323 loss = 3.4917 nll loss = 2.1295 accu = 0.3709

Validating: Epoch 10 of 10 Step 23 ntokens 8360124416 Example 7200 of 34323 loss = 3.4958 nll loss = 2.1317 accu = 0.3701

Validating: Epoch 10 of 10 Step 24 ntokens 8360124416 Example 7500 of 34323 loss = 3.4921 nll loss = 2.1307 accu = 0.3704

Validating: Epoch 10 of 10 Step 25 ntokens 8360124416 Example 7800 of 34323 loss = 3.4935 nll loss = 2.1297 accu = 0.3708

Validating: Epoch 10 of 10 Step 26 ntokens 8360124416 Example 8100 of 34323 loss = 3.4932 nll loss = 2.1312 accu = 0.3704

Validating: Epoch 10 of 10 Step 27 ntokens 8360124416 Example 8400 of 34323 loss = 3.4906 nll loss = 2.1287 accu = 0.3714

Validating: Epoch 10 of 10 Step 28 ntokens 8360124416 Example 8700 of 34323 loss = 3.4914 nll loss = 2.1289 accu = 0.3714

Validating: Epoch 10 of 10 Step 29 ntokens 8360124416 Example 9000 of 34323 loss = 3.4924 nll loss = 2.1277 accu = 0.3717

Validating: Epoch 10 of 10 Step 30 ntokens 8360124416 Example 9300 of 34323 loss = 3.4963 nll loss = 2.1245 accu = 0.3729

Validating: Epoch 10 of 10 Step 31 ntokens 8360124416 Example 9600 of 34323 loss = 3.5012 nll loss = 2.1248 accu = 0.3727

Validating: Epoch 10 of 10 Step 32 ntokens 8360124416 Example 9900 of 34323 loss = 3.5020 nll loss = 2.1256 accu = 0.3724

Validating: Epoch 10 of 10 Step 33 ntokens 8360124416 Example 10200 of 34323 loss = 3.5009 nll loss = 2.1260 accu = 0.3723

Validating: Epoch 10 of 10 Step 34 ntokens 8360124416 Example 10500 of 34323 loss = 3.5025 nll loss = 2.1279 accu = 0.3716

Validating: Epoch 10 of 10 Step 35 ntokens 8360124416 Example 10800 of 34323 loss = 3.5013 nll loss = 2.1308 accu = 0.3705

Validating: Epoch 10 of 10 Step 36 ntokens 8360124416 Example 11100 of 34323 loss = 3.5018 nll loss = 2.1287 accu = 0.3711

Validating: Epoch 10 of 10 Step 37 ntokens 8360124416 Example 11400 of 34323 loss = 3.4993 nll loss = 2.1281 accu = 0.3713

Validating: Epoch 10 of 10 Step 38 ntokens 8360124416 Example 11700 of 34323 loss = 3.4978 nll loss = 2.1276 accu = 0.3714

Validating: Epoch 10 of 10 Step 39 ntokens 8360124416 Example 12000 of 34323 loss = 3.4987 nll loss = 2.1273 accu = 0.3716

Validating: Epoch 10 of 10 Step 40 ntokens 8360124416 Example 12300 of 34323 loss = 3.4984 nll loss = 2.1270 accu = 0.3716

Validating: Epoch 10 of 10 Step 41 ntokens 8360124416 Example 12600 of 34323 loss = 3.4988 nll loss = 2.1275 accu = 0.3715

Validating: Epoch 10 of 10 Step 42 ntokens 8360124416 Example 12900 of 34323 loss = 3.5001 nll loss = 2.1279 accu = 0.3714

Validating: Epoch 10 of 10 Step 43 ntokens 8360124416 Example 13200 of 34323 loss = 3.4995 nll loss = 2.1289 accu = 0.3710

Validating: Epoch 10 of 10 Step 44 ntokens 8360124416 Example 13500 of 34323 loss = 3.4986 nll loss = 2.1280 accu = 0.3713

Validating: Epoch 10 of 10 Step 45 ntokens 8360124416 Example 13800 of 34323 loss = 3.4974 nll loss = 2.1291 accu = 0.3709

Validating: Epoch 10 of 10 Step 46 ntokens 8360124416 Example 14100 of 34323 loss = 3.4985 nll loss = 2.1289 accu = 0.3709

Validating: Epoch 10 of 10 Step 47 ntokens 8360124416 Example 14400 of 34323 loss = 3.4976 nll loss = 2.1289 accu = 0.3709

Validating: Epoch 10 of 10 Step 48 ntokens 8360124416 Example 14700 of 34323 loss = 3.4967 nll loss = 2.1281 accu = 0.3712

Validating: Epoch 10 of 10 Step 49 ntokens 8360124416 Example 15000 of 34323 loss = 3.4963 nll loss = 2.1287 accu = 0.3710

Validating: Epoch 10 of 10 Step 50 ntokens 8360124416 Example 15300 of 34323 loss = 3.4967 nll loss = 2.1288 accu = 0.3709

Validating: Epoch 10 of 10 Step 51 ntokens 8360124416 Example 15600 of 34323 loss = 3.4955 nll loss = 2.1296 accu = 0.3706

Validating: Epoch 10 of 10 Step 52 ntokens 8360124416 Example 15900 of 34323 loss = 3.4956 nll loss = 2.1288 accu = 0.3709

Validating: Epoch 10 of 10 Step 53 ntokens 8360124416 Example 16200 of 34323 loss = 3.4975 nll loss = 2.1285 accu = 0.3710

Validating: Epoch 10 of 10 Step 54 ntokens 8360124416 Example 16500 of 34323 loss = 3.4972 nll loss = 2.1301 accu = 0.3704

Validating: Epoch 10 of 10 Step 55 ntokens 8360124416 Example 16800 of 34323 loss = 3.4983 nll loss = 2.1309 accu = 0.3702

Validating: Epoch 10 of 10 Step 56 ntokens 8360124416 Example 17100 of 34323 loss = 3.4998 nll loss = 2.1310 accu = 0.3701

Validating: Epoch 10 of 10 Step 57 ntokens 8360124416 Example 17400 of 34323 loss = 3.4988 nll loss = 2.1306 accu = 0.3703

Validating: Epoch 10 of 10 Step 58 ntokens 8360124416 Example 17700 of 34323 loss = 3.4994 nll loss = 2.1290 accu = 0.3708

Validating: Epoch 10 of 10 Step 59 ntokens 8360124416 Example 18000 of 34323 loss = 3.4990 nll loss = 2.1282 accu = 0.3711

Validating: Epoch 10 of 10 Step 60 ntokens 8360124416 Example 18300 of 34323 loss = 3.4984 nll loss = 2.1299 accu = 0.3706

Validating: Epoch 10 of 10 Step 61 ntokens 8360124416 Example 18600 of 34323 loss = 3.4994 nll loss = 2.1306 accu = 0.3704

Validating: Epoch 10 of 10 Step 62 ntokens 8360124416 Example 18900 of 34323 loss = 3.4982 nll loss = 2.1308 accu = 0.3703

Validating: Epoch 10 of 10 Step 63 ntokens 8360124416 Example 19200 of 34323 loss = 3.4974 nll loss = 2.1309 accu = 0.3702

Validating: Epoch 10 of 10 Step 64 ntokens 8360124416 Example 19500 of 34323 loss = 3.4964 nll loss = 2.1302 accu = 0.3704

Validating: Epoch 10 of 10 Step 65 ntokens 8360124416 Example 19800 of 34323 loss = 3.4967 nll loss = 2.1297 accu = 0.3707

Validating: Epoch 10 of 10 Step 66 ntokens 8360124416 Example 20100 of 34323 loss = 3.4958 nll loss = 2.1284 accu = 0.3711

Validating: Epoch 10 of 10 Step 67 ntokens 8360124416 Example 20400 of 34323 loss = 3.4956 nll loss = 2.1282 accu = 0.3712

Validating: Epoch 10 of 10 Step 68 ntokens 8360124416 Example 20700 of 34323 loss = 3.4965 nll loss = 2.1300 accu = 0.3705

Validating: Epoch 10 of 10 Step 69 ntokens 8360124416 Example 21000 of 34323 loss = 3.4971 nll loss = 2.1293 accu = 0.3707

Validating: Epoch 10 of 10 Step 70 ntokens 8360124416 Example 21300 of 34323 loss = 3.4971 nll loss = 2.1289 accu = 0.3709

Validating: Epoch 10 of 10 Step 71 ntokens 8360124416 Example 21600 of 34323 loss = 3.4989 nll loss = 2.1297 accu = 0.3706

Validating: Epoch 10 of 10 Step 72 ntokens 8360124416 Example 21900 of 34323 loss = 3.4992 nll loss = 2.1290 accu = 0.3708

Validating: Epoch 10 of 10 Step 73 ntokens 8360124416 Example 22200 of 34323 loss = 3.4993 nll loss = 2.1290 accu = 0.3708

Validating: Epoch 10 of 10 Step 74 ntokens 8360124416 Example 22500 of 34323 loss = 3.4996 nll loss = 2.1288 accu = 0.3709

Validating: Epoch 10 of 10 Step 75 ntokens 8360124416 Example 22800 of 34323 loss = 3.4999 nll loss = 2.1293 accu = 0.3707

Validating: Epoch 10 of 10 Step 76 ntokens 8360124416 Example 23100 of 34323 loss = 3.4992 nll loss = 2.1297 accu = 0.3706

Validating: Epoch 10 of 10 Step 77 ntokens 8360124416 Example 23400 of 34323 loss = 3.4999 nll loss = 2.1298 accu = 0.3706

Validating: Epoch 10 of 10 Step 78 ntokens 8360124416 Example 23700 of 34323 loss = 3.5005 nll loss = 2.1304 accu = 0.3704

Validating: Epoch 10 of 10 Step 79 ntokens 8360124416 Example 24000 of 34323 loss = 3.5002 nll loss = 2.1301 accu = 0.3705

Validating: Epoch 10 of 10 Step 80 ntokens 8360124416 Example 24300 of 34323 loss = 3.4999 nll loss = 2.1302 accu = 0.3705

Validating: Epoch 10 of 10 Step 81 ntokens 8360124416 Example 24600 of 34323 loss = 3.5005 nll loss = 2.1302 accu = 0.3705

Validating: Epoch 10 of 10 Step 82 ntokens 8360124416 Example 24900 of 34323 loss = 3.5004 nll loss = 2.1305 accu = 0.3704

Validating: Epoch 10 of 10 Step 83 ntokens 8360124416 Example 25200 of 34323 loss = 3.5011 nll loss = 2.1296 accu = 0.3707

Validating: Epoch 10 of 10 Step 84 ntokens 8360124416 Example 25500 of 34323 loss = 3.5003 nll loss = 2.1298 accu = 0.3706

Validating: Epoch 10 of 10 Step 85 ntokens 8360124416 Example 25800 of 34323 loss = 3.5003 nll loss = 2.1286 accu = 0.3710

Validating: Epoch 10 of 10 Step 86 ntokens 8360124416 Example 26100 of 34323 loss = 3.4999 nll loss = 2.1281 accu = 0.3712

Validating: Epoch 10 of 10 Step 87 ntokens 8360124416 Example 26400 of 34323 loss = 3.4997 nll loss = 2.1278 accu = 0.3713

Validating: Epoch 10 of 10 Step 88 ntokens 8360124416 Example 26700 of 34323 loss = 3.5012 nll loss = 2.1279 accu = 0.3713

Validating: Epoch 10 of 10 Step 89 ntokens 8360124416 Example 27000 of 34323 loss = 3.5029 nll loss = 2.1269 accu = 0.3716

Validating: Epoch 10 of 10 Step 90 ntokens 8360124416 Example 27300 of 34323 loss = 3.5030 nll loss = 2.1262 accu = 0.3719

Validating: Epoch 10 of 10 Step 91 ntokens 8360124416 Example 27600 of 34323 loss = 3.5031 nll loss = 2.1263 accu = 0.3719

Validating: Epoch 10 of 10 Step 92 ntokens 8360124416 Example 27900 of 34323 loss = 3.5023 nll loss = 2.1261 accu = 0.3720

Validating: Epoch 10 of 10 Step 93 ntokens 8360124416 Example 28200 of 34323 loss = 3.5015 nll loss = 2.1265 accu = 0.3719

Validating: Epoch 10 of 10 Step 94 ntokens 8360124416 Example 28500 of 34323 loss = 3.5009 nll loss = 2.1267 accu = 0.3718

Validating: Epoch 10 of 10 Step 95 ntokens 8360124416 Example 28800 of 34323 loss = 3.5007 nll loss = 2.1255 accu = 0.3722

Validating: Epoch 10 of 10 Step 96 ntokens 8360124416 Example 29100 of 34323 loss = 3.5028 nll loss = 2.1253 accu = 0.3723

Validating: Epoch 10 of 10 Step 97 ntokens 8360124416 Example 29400 of 34323 loss = 3.5017 nll loss = 2.1245 accu = 0.3726

Validating: Epoch 10 of 10 Step 98 ntokens 8360124416 Example 29700 of 34323 loss = 3.5018 nll loss = 2.1243 accu = 0.3726

Validating: Epoch 10 of 10 Step 99 ntokens 8360124416 Example 30000 of 34323 loss = 3.5020 nll loss = 2.1238 accu = 0.3728

Validating: Epoch 10 of 10 Step 100 ntokens 8360124416 Example 30300 of 34323 loss = 3.5007 nll loss = 2.1235 accu = 0.3729

Validating: Epoch 10 of 10 Step 101 ntokens 8360124416 Example 30600 of 34323 loss = 3.5014 nll loss = 2.1233 accu = 0.3730

Validating: Epoch 10 of 10 Step 102 ntokens 8360124416 Example 30900 of 34323 loss = 3.5018 nll loss = 2.1236 accu = 0.3729

Validating: Epoch 10 of 10 Step 103 ntokens 8360124416 Example 31200 of 34323 loss = 3.5029 nll loss = 2.1236 accu = 0.3729

Validating: Epoch 10 of 10 Step 104 ntokens 8360124416 Example 31500 of 34323 loss = 3.5030 nll loss = 2.1245 accu = 0.3726

Validating: Epoch 10 of 10 Step 105 ntokens 8360124416 Example 31800 of 34323 loss = 3.5025 nll loss = 2.1248 accu = 0.3725

Validating: Epoch 10 of 10 Step 106 ntokens 8360124416 Example 32100 of 34323 loss = 3.5031 nll loss = 2.1248 accu = 0.3724

Validating: Epoch 10 of 10 Step 107 ntokens 8360124416 Example 32400 of 34323 loss = 3.5027 nll loss = 2.1244 accu = 0.3726

Validating: Epoch 10 of 10 Step 108 ntokens 8360124416 Example 32700 of 34323 loss = 3.5027 nll loss = 2.1246 accu = 0.3725

Validating: Epoch 10 of 10 Step 109 ntokens 8360124416 Example 33000 of 34323 loss = 3.5039 nll loss = 2.1249 accu = 0.3723

Validating: Epoch 10 of 10 Step 110 ntokens 8360124416 Example 33300 of 34323 loss = 3.5043 nll loss = 2.1251 accu = 0.3723

Validating: Epoch 10 of 10 Step 111 ntokens 8360124416 Example 33600 of 34323 loss = 3.5032 nll loss = 2.1260 accu = 0.3719

Validating: Epoch 10 of 10 Step 112 ntokens 8360124416 Example 33900 of 34323 loss = 3.5027 nll loss = 2.1257 accu = 0.3721

Validating: Epoch 10 of 10 Step 113 ntokens 8360124416 Example 34200 of 34323 loss = 3.5021 nll loss = 2.1252 accu = 0.3722

Validating: Epoch 10 of 10 Step 114 ntokens 8360124416 Example 34323 of 34323 loss = 3.5023 nll loss = 2.1251 accu = 0.3723

Validation complete in 0:00:15.053702
Epoch complete in 0:02:30.247582
All done.
/stg3/data3/Jonathan/miniconda/envs/evodiff/lib/python3.8/site-packages/torch/autograd/graph.py:744: UserWarning: Plan failed with a cudnnException: CUDNN_BACKEND_EXECUTION_PLAN_DESCRIPTOR: cudnnFinalize Descriptor Failed cudnn_status: CUDNN_STATUS_NOT_SUPPORTED (Triggered internally at ../aten/src/ATen/native/cudnn/Conv_v8.cpp:919.)
  return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
/stg3/data3/Jonathan/miniconda/envs/evodiff/lib/python3.8/site-packages/torch/nn/modules/conv.py:306: UserWarning: Plan failed with a cudnnException: CUDNN_BACKEND_EXECUTION_PLAN_DESCRIPTOR: cudnnFinalize Descriptor Failed cudnn_status: CUDNN_STATUS_NOT_SUPPORTED (Triggered internally at ../aten/src/ATen/native/cudnn/Conv_v8.cpp:919.)
  return F.conv1d(input, weight, bias, self.stride,