-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathtraining_log.txt
More file actions
3200 lines (3200 loc) · 202 KB
/
Copy pathtraining_log.txt
File metadata and controls
3200 lines (3200 loc) · 202 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Epoch [1/3], Step [1/12942], Loss: 2.0852, Perplexity: 8.0462
Epoch [1/3], Step [2/12942], Loss: 1.9726, Perplexity: 7.1892
Epoch [1/3], Step [3/12942], Loss: 2.3083, Perplexity: 10.0576
Epoch [1/3], Step [4/12942], Loss: 2.0825, Perplexity: 8.0249
Epoch [1/3], Step [5/12942], Loss: 2.1701, Perplexity: 8.7592
Epoch [1/3], Step [6/12942], Loss: 2.4508, Perplexity: 11.5973
Epoch [1/3], Step [7/12942], Loss: 2.0415, Perplexity: 7.7021
Epoch [1/3], Step [8/12942], Loss: 2.0865, Perplexity: 8.0569
Epoch [1/3], Step [9/12942], Loss: 2.1468, Perplexity: 8.5571
Epoch [1/3], Step [10/12942], Loss: 1.8729, Perplexity: 6.5072
Epoch [1/3], Step [11/12942], Loss: 2.2246, Perplexity: 9.2497
Epoch [1/3], Step [12/12942], Loss: 2.1382, Perplexity: 8.4840
Epoch [1/3], Step [13/12942], Loss: 1.8215, Perplexity: 6.1814
Epoch [1/3], Step [14/12942], Loss: 2.0221, Perplexity: 7.5544
Epoch [1/3], Step [15/12942], Loss: 2.0658, Perplexity: 7.8913
Epoch [1/3], Step [16/12942], Loss: 2.0427, Perplexity: 7.7115
Epoch [1/3], Step [17/12942], Loss: 2.1617, Perplexity: 8.6861
Epoch [1/3], Step [18/12942], Loss: 2.0595, Perplexity: 7.8423
Epoch [1/3], Step [19/12942], Loss: 1.9954, Perplexity: 7.3554
Epoch [1/3], Step [20/12942], Loss: 2.6311, Perplexity: 13.8894
Epoch [1/3], Step [21/12942], Loss: 2.2404, Perplexity: 9.3968
Epoch [1/3], Step [22/12942], Loss: 1.9787, Perplexity: 7.2336
Epoch [1/3], Step [23/12942], Loss: 1.7047, Perplexity: 5.5000
Epoch [1/3], Step [24/12942], Loss: 2.0549, Perplexity: 7.8062
Epoch [1/3], Step [25/12942], Loss: 2.0711, Perplexity: 7.9336
Epoch [1/3], Step [26/12942], Loss: 1.9431, Perplexity: 6.9805
Epoch [1/3], Step [27/12942], Loss: 2.0101, Perplexity: 7.4639
Epoch [1/3], Step [28/12942], Loss: 2.1424, Perplexity: 8.5200
Epoch [1/3], Step [29/12942], Loss: 2.1216, Perplexity: 8.3442
Epoch [1/3], Step [30/12942], Loss: 1.9898, Perplexity: 7.3143
Epoch [1/3], Step [31/12942], Loss: 2.0342, Perplexity: 7.6460
Epoch [1/3], Step [32/12942], Loss: 2.0418, Perplexity: 7.7044
Epoch [1/3], Step [33/12942], Loss: 2.1164, Perplexity: 8.3013
Epoch [1/3], Step [34/12942], Loss: 2.2977, Perplexity: 9.9516
Epoch [1/3], Step [35/12942], Loss: 2.0539, Perplexity: 7.7979
Epoch [1/3], Step [36/12942], Loss: 2.2996, Perplexity: 9.9700
Epoch [1/3], Step [37/12942], Loss: 2.0479, Perplexity: 7.7515
Epoch [1/3], Step [38/12942], Loss: 2.2658, Perplexity: 9.6385
Epoch [1/3], Step [39/12942], Loss: 2.4975, Perplexity: 12.1520
Epoch [1/3], Step [40/12942], Loss: 1.8896, Perplexity: 6.6169
Epoch [1/3], Step [41/12942], Loss: 1.8829, Perplexity: 6.5726
Epoch [1/3], Step [42/12942], Loss: 2.0111, Perplexity: 7.4712
Epoch [1/3], Step [43/12942], Loss: 2.1591, Perplexity: 8.6634
Epoch [1/3], Step [44/12942], Loss: 1.7481, Perplexity: 5.7437
Epoch [1/3], Step [45/12942], Loss: 2.1154, Perplexity: 8.2931
Epoch [1/3], Step [46/12942], Loss: 1.8388, Perplexity: 6.2893
Epoch [1/3], Step [47/12942], Loss: 2.2057, Perplexity: 9.0765
Epoch [1/3], Step [48/12942], Loss: 2.0306, Perplexity: 7.6188
Epoch [1/3], Step [49/12942], Loss: 2.3618, Perplexity: 10.6099
Epoch [1/3], Step [50/12942], Loss: 1.8607, Perplexity: 6.4280
Epoch [1/3], Step [51/12942], Loss: 1.8520, Perplexity: 6.3725
Epoch [1/3], Step [52/12942], Loss: 2.1858, Perplexity: 8.8980
Epoch [1/3], Step [53/12942], Loss: 2.0396, Perplexity: 7.6877
Epoch [1/3], Step [54/12942], Loss: 2.4533, Perplexity: 11.6264
Epoch [1/3], Step [55/12942], Loss: 2.0452, Perplexity: 7.7310
Epoch [1/3], Step [56/12942], Loss: 1.8783, Perplexity: 6.5421
Epoch [1/3], Step [57/12942], Loss: 2.1988, Perplexity: 9.0145
Epoch [1/3], Step [58/12942], Loss: 2.0850, Perplexity: 8.0449
Epoch [1/3], Step [59/12942], Loss: 1.8890, Perplexity: 6.6129
Epoch [1/3], Step [60/12942], Loss: 1.8624, Perplexity: 6.4394
Epoch [1/3], Step [61/12942], Loss: 1.7279, Perplexity: 5.6286
Epoch [1/3], Step [62/12942], Loss: 2.0236, Perplexity: 7.5651
Epoch [1/3], Step [63/12942], Loss: 2.2642, Perplexity: 9.6234
Epoch [1/3], Step [64/12942], Loss: 1.8407, Perplexity: 6.3010
Epoch [1/3], Step [65/12942], Loss: 1.9909, Perplexity: 7.3220
Epoch [1/3], Step [66/12942], Loss: 2.3972, Perplexity: 10.9920
Epoch [1/3], Step [67/12942], Loss: 2.3634, Perplexity: 10.6275
Epoch [1/3], Step [68/12942], Loss: 2.0468, Perplexity: 7.7427
Epoch [1/3], Step [69/12942], Loss: 1.9646, Perplexity: 7.1320
Epoch [1/3], Step [70/12942], Loss: 2.0366, Perplexity: 7.6648
Epoch [1/3], Step [71/12942], Loss: 1.9507, Perplexity: 7.0339
Epoch [1/3], Step [72/12942], Loss: 2.1792, Perplexity: 8.8394
Epoch [1/3], Step [73/12942], Loss: 2.1604, Perplexity: 8.6744
Epoch [1/3], Step [74/12942], Loss: 1.7937, Perplexity: 6.0117
Epoch [1/3], Step [75/12942], Loss: 2.5615, Perplexity: 12.9549
Epoch [1/3], Step [76/12942], Loss: 1.8703, Perplexity: 6.4900
Epoch [1/3], Step [77/12942], Loss: 2.2738, Perplexity: 9.7165
Epoch [1/3], Step [78/12942], Loss: 1.9543, Perplexity: 7.0587
Epoch [1/3], Step [79/12942], Loss: 2.0204, Perplexity: 7.5413
Epoch [1/3], Step [80/12942], Loss: 1.9948, Perplexity: 7.3510
Epoch [1/3], Step [81/12942], Loss: 2.3713, Perplexity: 10.7115
Epoch [1/3], Step [82/12942], Loss: 1.9421, Perplexity: 6.9735
Epoch [1/3], Step [83/12942], Loss: 2.2409, Perplexity: 9.4018
Epoch [1/3], Step [84/12942], Loss: 2.4536, Perplexity: 11.6296
Epoch [1/3], Step [85/12942], Loss: 2.0651, Perplexity: 7.8862
Epoch [1/3], Step [86/12942], Loss: 1.7195, Perplexity: 5.5815
Epoch [1/3], Step [87/12942], Loss: 2.0867, Perplexity: 8.0580
Epoch [1/3], Step [88/12942], Loss: 2.0750, Perplexity: 7.9644
Epoch [1/3], Step [89/12942], Loss: 2.0314, Perplexity: 7.6250
Epoch [1/3], Step [90/12942], Loss: 1.9940, Perplexity: 7.3450
Epoch [1/3], Step [91/12942], Loss: 2.2239, Perplexity: 9.2432
Epoch [1/3], Step [92/12942], Loss: 1.9650, Perplexity: 7.1349
Epoch [1/3], Step [93/12942], Loss: 2.0414, Perplexity: 7.7011
Epoch [1/3], Step [94/12942], Loss: 2.1080, Perplexity: 8.2319
Epoch [1/3], Step [95/12942], Loss: 2.2320, Perplexity: 9.3181
Epoch [1/3], Step [96/12942], Loss: 1.8977, Perplexity: 6.6708
Epoch [1/3], Step [97/12942], Loss: 1.9226, Perplexity: 6.8386
Epoch [1/3], Step [98/12942], Loss: 2.1026, Perplexity: 8.1876
Epoch [1/3], Step [99/12942], Loss: 2.1983, Perplexity: 9.0100
Epoch [1/3], Step [100/12942], Loss: 2.1665, Perplexity: 8.7277
Epoch [1/3], Step [101/12942], Loss: 1.8716, Perplexity: 6.4987
Epoch [1/3], Step [102/12942], Loss: 2.2996, Perplexity: 9.9703
Epoch [1/3], Step [103/12942], Loss: 2.0103, Perplexity: 7.4653
Epoch [1/3], Step [104/12942], Loss: 1.8429, Perplexity: 6.3149
Epoch [1/3], Step [105/12942], Loss: 2.0127, Perplexity: 7.4838
Epoch [1/3], Step [106/12942], Loss: 1.6428, Perplexity: 5.1694
Epoch [1/3], Step [107/12942], Loss: 1.9751, Perplexity: 7.2077
Epoch [1/3], Step [108/12942], Loss: 2.0008, Perplexity: 7.3947
Epoch [1/3], Step [109/12942], Loss: 2.4487, Perplexity: 11.5733
Epoch [1/3], Step [110/12942], Loss: 1.8895, Perplexity: 6.6164
Epoch [1/3], Step [111/12942], Loss: 2.3450, Perplexity: 10.4332
Epoch [1/3], Step [112/12942], Loss: 2.0288, Perplexity: 7.6052
Epoch [1/3], Step [113/12942], Loss: 2.5868, Perplexity: 13.2866
Epoch [1/3], Step [114/12942], Loss: 2.2028, Perplexity: 9.0501
Epoch [1/3], Step [115/12942], Loss: 1.9859, Perplexity: 7.2855
Epoch [1/3], Step [116/12942], Loss: 2.5032, Perplexity: 12.2212
Epoch [1/3], Step [117/12942], Loss: 1.8118, Perplexity: 6.1217
Epoch [1/3], Step [118/12942], Loss: 2.2781, Perplexity: 9.7583
Epoch [1/3], Step [119/12942], Loss: 2.1773, Perplexity: 8.8221
Epoch [1/3], Step [120/12942], Loss: 1.6583, Perplexity: 5.2506
Epoch [1/3], Step [121/12942], Loss: 2.0708, Perplexity: 7.9310
Epoch [1/3], Step [122/12942], Loss: 2.1610, Perplexity: 8.6797
Epoch [1/3], Step [123/12942], Loss: 1.7509, Perplexity: 5.7600
Epoch [1/3], Step [124/12942], Loss: 1.8289, Perplexity: 6.2272
Epoch [1/3], Step [125/12942], Loss: 1.9932, Perplexity: 7.3389
Epoch [1/3], Step [126/12942], Loss: 2.1487, Perplexity: 8.5738
Epoch [1/3], Step [127/12942], Loss: 2.1727, Perplexity: 8.7816
Epoch [1/3], Step [128/12942], Loss: 2.4422, Perplexity: 11.4984
Epoch [1/3], Step [129/12942], Loss: 2.4545, Perplexity: 11.6411
Epoch [1/3], Step [130/12942], Loss: 1.8273, Perplexity: 6.2169
Epoch [1/3], Step [131/12942], Loss: 1.9678, Perplexity: 7.1549
Epoch [1/3], Step [132/12942], Loss: 2.0656, Perplexity: 7.8899
Epoch [1/3], Step [133/12942], Loss: 1.8552, Perplexity: 6.3928
Epoch [1/3], Step [134/12942], Loss: 2.0698, Perplexity: 7.9233
Epoch [1/3], Step [135/12942], Loss: 2.0485, Perplexity: 7.7560
Epoch [1/3], Step [136/12942], Loss: 1.9933, Perplexity: 7.3399
Epoch [1/3], Step [137/12942], Loss: 1.9621, Perplexity: 7.1144
Epoch [1/3], Step [138/12942], Loss: 1.9828, Perplexity: 7.2633
Epoch [1/3], Step [139/12942], Loss: 2.0104, Perplexity: 7.4661
Epoch [1/3], Step [140/12942], Loss: 2.4936, Perplexity: 12.1044
Epoch [1/3], Step [141/12942], Loss: 1.9648, Perplexity: 7.1333
Epoch [1/3], Step [142/12942], Loss: 1.8663, Perplexity: 6.4642
Epoch [1/3], Step [143/12942], Loss: 2.1687, Perplexity: 8.7468
Epoch [1/3], Step [144/12942], Loss: 2.2089, Perplexity: 9.1055
Epoch [1/3], Step [145/12942], Loss: 1.9748, Perplexity: 7.2050
Epoch [1/3], Step [146/12942], Loss: 2.0496, Perplexity: 7.7648
Epoch [1/3], Step [147/12942], Loss: 2.3651, Perplexity: 10.6453
Epoch [1/3], Step [148/12942], Loss: 2.0609, Perplexity: 7.8532
Epoch [1/3], Step [149/12942], Loss: 1.8147, Perplexity: 6.1390
Epoch [1/3], Step [150/12942], Loss: 2.3784, Perplexity: 10.7880
Epoch [1/3], Step [151/12942], Loss: 2.1134, Perplexity: 8.2765
Epoch [1/3], Step [152/12942], Loss: 1.8853, Perplexity: 6.5885
Epoch [1/3], Step [153/12942], Loss: 1.9831, Perplexity: 7.2654
Epoch [1/3], Step [154/12942], Loss: 2.1456, Perplexity: 8.5468
Epoch [1/3], Step [155/12942], Loss: 2.0465, Perplexity: 7.7406
Epoch [1/3], Step [156/12942], Loss: 1.9405, Perplexity: 6.9623
Epoch [1/3], Step [157/12942], Loss: 1.9416, Perplexity: 6.9701
Epoch [1/3], Step [158/12942], Loss: 2.2972, Perplexity: 9.9463
Epoch [1/3], Step [159/12942], Loss: 2.1475, Perplexity: 8.5633
Epoch [1/3], Step [160/12942], Loss: 2.1800, Perplexity: 8.8464
Epoch [1/3], Step [161/12942], Loss: 2.0707, Perplexity: 7.9306
Epoch [1/3], Step [162/12942], Loss: 2.3956, Perplexity: 10.9751
Epoch [1/3], Step [163/12942], Loss: 2.4511, Perplexity: 11.6009
Epoch [1/3], Step [164/12942], Loss: 2.9762, Perplexity: 19.6140
Epoch [1/3], Step [165/12942], Loss: 2.3394, Perplexity: 10.3749
Epoch [1/3], Step [166/12942], Loss: 1.8595, Perplexity: 6.4208
Epoch [1/3], Step [167/12942], Loss: 2.0490, Perplexity: 7.7603
Epoch [1/3], Step [168/12942], Loss: 2.7081, Perplexity: 15.0010
Epoch [1/3], Step [169/12942], Loss: 1.9996, Perplexity: 7.3860
Epoch [1/3], Step [170/12942], Loss: 2.1236, Perplexity: 8.3615
Epoch [1/3], Step [171/12942], Loss: 2.0117, Perplexity: 7.4762
Epoch [1/3], Step [172/12942], Loss: 1.7109, Perplexity: 5.5340
Epoch [1/3], Step [173/12942], Loss: 2.2221, Perplexity: 9.2268
Epoch [1/3], Step [174/12942], Loss: 1.9366, Perplexity: 6.9354
Epoch [1/3], Step [175/12942], Loss: 1.8654, Perplexity: 6.4582
Epoch [1/3], Step [176/12942], Loss: 2.1050, Perplexity: 8.2072
Epoch [1/3], Step [177/12942], Loss: 2.4306, Perplexity: 11.3660
Epoch [1/3], Step [178/12942], Loss: 2.2205, Perplexity: 9.2121
Epoch [1/3], Step [179/12942], Loss: 2.1607, Perplexity: 8.6775
Epoch [1/3], Step [180/12942], Loss: 2.7885, Perplexity: 16.2566
Epoch [1/3], Step [181/12942], Loss: 2.1077, Perplexity: 8.2294
Epoch [1/3], Step [182/12942], Loss: 1.9575, Perplexity: 7.0813
Epoch [1/3], Step [183/12942], Loss: 2.0974, Perplexity: 8.1446
Epoch [1/3], Step [184/12942], Loss: 1.9765, Perplexity: 7.2176
Epoch [1/3], Step [185/12942], Loss: 1.9715, Perplexity: 7.1813
Epoch [1/3], Step [186/12942], Loss: 2.0816, Perplexity: 8.0176
Epoch [1/3], Step [187/12942], Loss: 1.9492, Perplexity: 7.0232
Epoch [1/3], Step [188/12942], Loss: 1.8583, Perplexity: 6.4131
Epoch [1/3], Step [189/12942], Loss: 2.2310, Perplexity: 9.3090
Epoch [1/3], Step [190/12942], Loss: 1.9403, Perplexity: 6.9608
Epoch [1/3], Step [191/12942], Loss: 1.8115, Perplexity: 6.1197
Epoch [1/3], Step [192/12942], Loss: 2.0914, Perplexity: 8.0959
Epoch [1/3], Step [193/12942], Loss: 1.9446, Perplexity: 6.9908
Epoch [1/3], Step [194/12942], Loss: 2.2796, Perplexity: 9.7729
Epoch [1/3], Step [195/12942], Loss: 1.9040, Perplexity: 6.7124
Epoch [1/3], Step [196/12942], Loss: 1.8539, Perplexity: 6.3847
Epoch [1/3], Step [197/12942], Loss: 2.0427, Perplexity: 7.7113
Epoch [1/3], Step [198/12942], Loss: 3.2700, Perplexity: 26.3100
Epoch [1/3], Step [199/12942], Loss: 2.1393, Perplexity: 8.4933
Epoch [1/3], Step [200/12942], Loss: 2.2255, Perplexity: 9.2579
Epoch [1/3], Step [201/12942], Loss: 2.0328, Perplexity: 7.6354
Epoch [1/3], Step [202/12942], Loss: 1.9933, Perplexity: 7.3399
Epoch [1/3], Step [203/12942], Loss: 2.1917, Perplexity: 8.9504
Epoch [1/3], Step [204/12942], Loss: 2.1344, Perplexity: 8.4518
Epoch [1/3], Step [205/12942], Loss: 2.2652, Perplexity: 9.6333
Epoch [1/3], Step [206/12942], Loss: 2.3127, Perplexity: 10.1019
Epoch [1/3], Step [207/12942], Loss: 2.0841, Perplexity: 8.0373
Epoch [1/3], Step [208/12942], Loss: 2.2751, Perplexity: 9.7288
Epoch [1/3], Step [209/12942], Loss: 2.0287, Perplexity: 7.6043
Epoch [1/3], Step [210/12942], Loss: 2.3939, Perplexity: 10.9561
Epoch [1/3], Step [211/12942], Loss: 2.0450, Perplexity: 7.7288
Epoch [1/3], Step [212/12942], Loss: 1.8737, Perplexity: 6.5122
Epoch [1/3], Step [213/12942], Loss: 1.9345, Perplexity: 6.9202
Epoch [1/3], Step [214/12942], Loss: 2.2169, Perplexity: 9.1789
Epoch [1/3], Step [215/12942], Loss: 2.3590, Perplexity: 10.5808
Epoch [1/3], Step [216/12942], Loss: 2.3054, Perplexity: 10.0281
Epoch [1/3], Step [217/12942], Loss: 2.0886, Perplexity: 8.0735
Epoch [1/3], Step [218/12942], Loss: 1.6999, Perplexity: 5.4733
Epoch [1/3], Step [219/12942], Loss: 2.0396, Perplexity: 7.6872
Epoch [1/3], Step [220/12942], Loss: 2.4200, Perplexity: 11.2463
Epoch [1/3], Step [221/12942], Loss: 2.1961, Perplexity: 8.9894
Epoch [1/3], Step [222/12942], Loss: 2.1777, Perplexity: 8.8263
Epoch [1/3], Step [223/12942], Loss: 1.9331, Perplexity: 6.9111
Epoch [1/3], Step [224/12942], Loss: 2.0655, Perplexity: 7.8891
Epoch [1/3], Step [225/12942], Loss: 2.0315, Perplexity: 7.6253
Epoch [1/3], Step [226/12942], Loss: 2.2039, Perplexity: 9.0605
Epoch [1/3], Step [227/12942], Loss: 2.2581, Perplexity: 9.5651
Epoch [1/3], Step [228/12942], Loss: 1.9426, Perplexity: 6.9769
Epoch [1/3], Step [229/12942], Loss: 2.0587, Perplexity: 7.8355
Epoch [1/3], Step [230/12942], Loss: 2.0421, Perplexity: 7.7065
Epoch [1/3], Step [231/12942], Loss: 2.1931, Perplexity: 8.9630
Epoch [1/3], Step [232/12942], Loss: 1.9958, Perplexity: 7.3583
Epoch [1/3], Step [233/12942], Loss: 2.1242, Perplexity: 8.3664
Epoch [1/3], Step [234/12942], Loss: 1.9962, Perplexity: 7.3612
Epoch [1/3], Step [235/12942], Loss: 2.1314, Perplexity: 8.4271
Epoch [1/3], Step [236/12942], Loss: 1.7856, Perplexity: 5.9634
Epoch [1/3], Step [237/12942], Loss: 2.1598, Perplexity: 8.6697
Epoch [1/3], Step [238/12942], Loss: 2.4452, Perplexity: 11.5327
Epoch [1/3], Step [239/12942], Loss: 2.1614, Perplexity: 8.6831
Epoch [1/3], Step [240/12942], Loss: 1.6763, Perplexity: 5.3460
Epoch [1/3], Step [241/12942], Loss: 2.5233, Perplexity: 12.4700
Epoch [1/3], Step [242/12942], Loss: 2.0626, Perplexity: 7.8661
Epoch [1/3], Step [243/12942], Loss: 2.5449, Perplexity: 12.7417
Epoch [1/3], Step [244/12942], Loss: 2.2634, Perplexity: 9.6153
Epoch [1/3], Step [245/12942], Loss: 1.9009, Perplexity: 6.6918
Epoch [1/3], Step [246/12942], Loss: 2.2663, Perplexity: 9.6441
Epoch [1/3], Step [247/12942], Loss: 1.8733, Perplexity: 6.5099
Epoch [1/3], Step [248/12942], Loss: 2.1831, Perplexity: 8.8741
Epoch [1/3], Step [249/12942], Loss: 1.8920, Perplexity: 6.6323
Epoch [1/3], Step [250/12942], Loss: 2.0361, Perplexity: 7.6606
Epoch [1/3], Step [251/12942], Loss: 1.8941, Perplexity: 6.6465
Epoch [1/3], Step [252/12942], Loss: 1.9280, Perplexity: 6.8760
Epoch [1/3], Step [253/12942], Loss: 2.8508, Perplexity: 17.3017
Epoch [1/3], Step [254/12942], Loss: 2.0856, Perplexity: 8.0498
Epoch [1/3], Step [255/12942], Loss: 2.0131, Perplexity: 7.4864
Epoch [1/3], Step [256/12942], Loss: 2.1173, Perplexity: 8.3085
Epoch [1/3], Step [257/12942], Loss: 2.4669, Perplexity: 11.7855
Epoch [1/3], Step [258/12942], Loss: 2.3112, Perplexity: 10.0864
Epoch [1/3], Step [259/12942], Loss: 1.9463, Perplexity: 7.0029
Epoch [1/3], Step [260/12942], Loss: 2.2557, Perplexity: 9.5420
Epoch [1/3], Step [261/12942], Loss: 2.1237, Perplexity: 8.3622
Epoch [1/3], Step [262/12942], Loss: 1.9869, Perplexity: 7.2926
Epoch [1/3], Step [263/12942], Loss: 2.0060, Perplexity: 7.4332
Epoch [1/3], Step [264/12942], Loss: 2.2155, Perplexity: 9.1657
Epoch [1/3], Step [265/12942], Loss: 1.9596, Perplexity: 7.0963
Epoch [1/3], Step [266/12942], Loss: 1.9457, Perplexity: 6.9986
Epoch [1/3], Step [267/12942], Loss: 1.8344, Perplexity: 6.2616
Epoch [1/3], Step [268/12942], Loss: 2.0776, Perplexity: 7.9853
Epoch [1/3], Step [269/12942], Loss: 1.8565, Perplexity: 6.4010
Epoch [1/3], Step [270/12942], Loss: 1.9096, Perplexity: 6.7503
Epoch [1/3], Step [271/12942], Loss: 1.9056, Perplexity: 6.7234
Epoch [1/3], Step [272/12942], Loss: 2.0126, Perplexity: 7.4828
Epoch [1/3], Step [273/12942], Loss: 1.9249, Perplexity: 6.8544
Epoch [1/3], Step [274/12942], Loss: 1.9686, Perplexity: 7.1607
Epoch [1/3], Step [275/12942], Loss: 2.4958, Perplexity: 12.1313
Epoch [1/3], Step [276/12942], Loss: 1.7743, Perplexity: 5.8963
Epoch [1/3], Step [277/12942], Loss: 1.8795, Perplexity: 6.5503
Epoch [1/3], Step [278/12942], Loss: 2.1715, Perplexity: 8.7712
Epoch [1/3], Step [279/12942], Loss: 2.1105, Perplexity: 8.2522
Epoch [1/3], Step [280/12942], Loss: 3.0781, Perplexity: 21.7167
Epoch [1/3], Step [281/12942], Loss: 1.9424, Perplexity: 6.9752
Epoch [1/3], Step [282/12942], Loss: 2.0542, Perplexity: 7.8003
Epoch [1/3], Step [283/12942], Loss: 2.4547, Perplexity: 11.6428
Epoch [1/3], Step [284/12942], Loss: 1.9710, Perplexity: 7.1775
Epoch [1/3], Step [285/12942], Loss: 2.2119, Perplexity: 9.1333
Epoch [1/3], Step [286/12942], Loss: 2.0993, Perplexity: 8.1606
Epoch [1/3], Step [287/12942], Loss: 2.2376, Perplexity: 9.3712
Epoch [1/3], Step [288/12942], Loss: 2.8103, Perplexity: 16.6143
Epoch [1/3], Step [289/12942], Loss: 2.0470, Perplexity: 7.7444
Epoch [1/3], Step [290/12942], Loss: 2.0619, Perplexity: 7.8609
Epoch [1/3], Step [291/12942], Loss: 2.0868, Perplexity: 8.0592
Epoch [1/3], Step [292/12942], Loss: 2.2017, Perplexity: 9.0403
Epoch [1/3], Step [293/12942], Loss: 2.3058, Perplexity: 10.0321
Epoch [1/3], Step [294/12942], Loss: 1.9119, Perplexity: 6.7662
Epoch [1/3], Step [295/12942], Loss: 2.2235, Perplexity: 9.2392
Epoch [1/3], Step [296/12942], Loss: 2.0283, Perplexity: 7.6010
Epoch [1/3], Step [297/12942], Loss: 2.5376, Perplexity: 12.6494
Epoch [1/3], Step [298/12942], Loss: 1.8877, Perplexity: 6.6039
Epoch [1/3], Step [299/12942], Loss: 1.9710, Perplexity: 7.1776
Epoch [1/3], Step [300/12942], Loss: 1.8385, Perplexity: 6.2871
Epoch [1/3], Step [301/12942], Loss: 1.9760, Perplexity: 7.2135
Epoch [1/3], Step [302/12942], Loss: 2.1522, Perplexity: 8.6039
Epoch [1/3], Step [303/12942], Loss: 2.1694, Perplexity: 8.7534
Epoch [1/3], Step [304/12942], Loss: 2.1159, Perplexity: 8.2970
Epoch [1/3], Step [305/12942], Loss: 1.9563, Perplexity: 7.0731
Epoch [1/3], Step [306/12942], Loss: 1.9205, Perplexity: 6.8242
Epoch [1/3], Step [307/12942], Loss: 2.0178, Perplexity: 7.5221
Epoch [1/3], Step [308/12942], Loss: 1.6975, Perplexity: 5.4605
Epoch [1/3], Step [309/12942], Loss: 1.9466, Perplexity: 7.0048
Epoch [1/3], Step [310/12942], Loss: 2.3282, Perplexity: 10.2599
Epoch [1/3], Step [311/12942], Loss: 2.0496, Perplexity: 7.7648
Epoch [1/3], Step [312/12942], Loss: 2.1803, Perplexity: 8.8490
Epoch [1/3], Step [313/12942], Loss: 1.9911, Perplexity: 7.3239
Epoch [1/3], Step [314/12942], Loss: 1.7659, Perplexity: 5.8468
Epoch [1/3], Step [315/12942], Loss: 2.2042, Perplexity: 9.0626
Epoch [1/3], Step [316/12942], Loss: 2.1073, Perplexity: 8.2262
Epoch [1/3], Step [317/12942], Loss: 2.1450, Perplexity: 8.5423
Epoch [1/3], Step [318/12942], Loss: 2.2199, Perplexity: 9.2066
Epoch [1/3], Step [319/12942], Loss: 2.0122, Perplexity: 7.4798
Epoch [1/3], Step [320/12942], Loss: 2.1428, Perplexity: 8.5231
Epoch [1/3], Step [321/12942], Loss: 1.9150, Perplexity: 6.7867
Epoch [1/3], Step [322/12942], Loss: 1.9509, Perplexity: 7.0348
Epoch [1/3], Step [323/12942], Loss: 1.9151, Perplexity: 6.7874
Epoch [1/3], Step [324/12942], Loss: 2.4134, Perplexity: 11.1716
Epoch [1/3], Step [325/12942], Loss: 1.9993, Perplexity: 7.3836
Epoch [1/3], Step [326/12942], Loss: 2.4149, Perplexity: 11.1884
Epoch [1/3], Step [327/12942], Loss: 1.8389, Perplexity: 6.2894
Epoch [1/3], Step [328/12942], Loss: 2.1587, Perplexity: 8.6596
Epoch [1/3], Step [329/12942], Loss: 2.1954, Perplexity: 8.9834
Epoch [1/3], Step [330/12942], Loss: 2.1421, Perplexity: 8.5171
Epoch [1/3], Step [331/12942], Loss: 2.0031, Perplexity: 7.4122
Epoch [1/3], Step [332/12942], Loss: 2.4566, Perplexity: 11.6655
Epoch [1/3], Step [333/12942], Loss: 2.1077, Perplexity: 8.2297
Epoch [1/3], Step [334/12942], Loss: 2.0371, Perplexity: 7.6680
Epoch [1/3], Step [335/12942], Loss: 2.1390, Perplexity: 8.4909
Epoch [1/3], Step [336/12942], Loss: 2.2176, Perplexity: 9.1856
Epoch [1/3], Step [337/12942], Loss: 2.0651, Perplexity: 7.8864
Epoch [1/3], Step [338/12942], Loss: 2.3050, Perplexity: 10.0238
Epoch [1/3], Step [339/12942], Loss: 2.0332, Perplexity: 7.6387
Epoch [1/3], Step [340/12942], Loss: 2.0597, Perplexity: 7.8435
Epoch [1/3], Step [341/12942], Loss: 2.2272, Perplexity: 9.2742
Epoch [1/3], Step [342/12942], Loss: 2.4365, Perplexity: 11.4330
Epoch [1/3], Step [343/12942], Loss: 1.9698, Perplexity: 7.1690
Epoch [1/3], Step [344/12942], Loss: 1.8172, Perplexity: 6.1548
Epoch [1/3], Step [345/12942], Loss: 1.8384, Perplexity: 6.2864
Epoch [1/3], Step [346/12942], Loss: 2.1258, Perplexity: 8.3796
Epoch [1/3], Step [347/12942], Loss: 1.7438, Perplexity: 5.7192
Epoch [1/3], Step [348/12942], Loss: 1.7599, Perplexity: 5.8116
Epoch [1/3], Step [349/12942], Loss: 2.0592, Perplexity: 7.8398
Epoch [1/3], Step [350/12942], Loss: 1.8663, Perplexity: 6.4646
Epoch [1/3], Step [351/12942], Loss: 2.1484, Perplexity: 8.5708
Epoch [1/3], Step [352/12942], Loss: 2.2659, Perplexity: 9.6396
Epoch [1/3], Step [353/12942], Loss: 1.8054, Perplexity: 6.0826
Epoch [1/3], Step [354/12942], Loss: 2.0112, Perplexity: 7.4724
Epoch [1/3], Step [355/12942], Loss: 1.9334, Perplexity: 6.9128
Epoch [1/3], Step [356/12942], Loss: 2.1128, Perplexity: 8.2715
Epoch [1/3], Step [357/12942], Loss: 2.0738, Perplexity: 7.9549
Epoch [1/3], Step [358/12942], Loss: 2.2131, Perplexity: 9.1439
Epoch [1/3], Step [359/12942], Loss: 1.8135, Perplexity: 6.1320
Epoch [1/3], Step [360/12942], Loss: 1.6550, Perplexity: 5.2333
Epoch [1/3], Step [361/12942], Loss: 2.1130, Perplexity: 8.2733
Epoch [1/3], Step [362/12942], Loss: 2.1396, Perplexity: 8.4963
Epoch [1/3], Step [363/12942], Loss: 2.0967, Perplexity: 8.1389
Epoch [1/3], Step [364/12942], Loss: 1.8814, Perplexity: 6.5629
Epoch [1/3], Step [365/12942], Loss: 2.3165, Perplexity: 10.1404
Epoch [1/3], Step [366/12942], Loss: 2.0071, Perplexity: 7.4417
Epoch [1/3], Step [367/12942], Loss: 1.7453, Perplexity: 5.7274
Epoch [1/3], Step [368/12942], Loss: 1.9178, Perplexity: 6.8060
Epoch [1/3], Step [369/12942], Loss: 2.0790, Perplexity: 7.9966
Epoch [1/3], Step [370/12942], Loss: 2.0955, Perplexity: 8.1296
Epoch [1/3], Step [371/12942], Loss: 2.3197, Perplexity: 10.1731
Epoch [1/3], Step [372/12942], Loss: 2.0456, Perplexity: 7.7340
Epoch [1/3], Step [373/12942], Loss: 1.9387, Perplexity: 6.9499
Epoch [1/3], Step [374/12942], Loss: 2.2251, Perplexity: 9.2545
Epoch [1/3], Step [375/12942], Loss: 2.3168, Perplexity: 10.1431
Epoch [1/3], Step [376/12942], Loss: 1.8375, Perplexity: 6.2810
Epoch [1/3], Step [377/12942], Loss: 1.9326, Perplexity: 6.9071
Epoch [1/3], Step [378/12942], Loss: 1.9248, Perplexity: 6.8538
Epoch [1/3], Step [379/12942], Loss: 1.8483, Perplexity: 6.3489
Epoch [1/3], Step [380/12942], Loss: 2.0090, Perplexity: 7.4557
Epoch [1/3], Step [381/12942], Loss: 1.9284, Perplexity: 6.8787
Epoch [1/3], Step [382/12942], Loss: 2.2334, Perplexity: 9.3319
Epoch [1/3], Step [383/12942], Loss: 2.0389, Perplexity: 7.6821
Epoch [1/3], Step [384/12942], Loss: 1.9719, Perplexity: 7.1847
Epoch [1/3], Step [385/12942], Loss: 2.3149, Perplexity: 10.1237
Epoch [1/3], Step [386/12942], Loss: 1.9827, Perplexity: 7.2625
Epoch [1/3], Step [387/12942], Loss: 1.9474, Perplexity: 7.0106
Epoch [1/3], Step [388/12942], Loss: 2.2137, Perplexity: 9.1496
Epoch [1/3], Step [389/12942], Loss: 2.0144, Perplexity: 7.4964
Epoch [1/3], Step [390/12942], Loss: 2.0685, Perplexity: 7.9132
Epoch [1/3], Step [391/12942], Loss: 1.9637, Perplexity: 7.1253
Epoch [1/3], Step [392/12942], Loss: 2.3697, Perplexity: 10.6937
Epoch [1/3], Step [393/12942], Loss: 2.0523, Perplexity: 7.7855
Epoch [1/3], Step [394/12942], Loss: 1.8794, Perplexity: 6.5494
Epoch [1/3], Step [395/12942], Loss: 2.2680, Perplexity: 9.6605
Epoch [1/3], Step [396/12942], Loss: 1.8860, Perplexity: 6.5928
Epoch [1/3], Step [397/12942], Loss: 2.0352, Perplexity: 7.6540
Epoch [1/3], Step [398/12942], Loss: 1.8659, Perplexity: 6.4619
Epoch [1/3], Step [399/12942], Loss: 1.9347, Perplexity: 6.9221
Epoch [1/3], Step [400/12942], Loss: 2.0982, Perplexity: 8.1516
Epoch [1/3], Step [401/12942], Loss: 2.0009, Perplexity: 7.3955
Epoch [1/3], Step [402/12942], Loss: 2.2547, Perplexity: 9.5320
Epoch [1/3], Step [403/12942], Loss: 2.0109, Perplexity: 7.4703
Epoch [1/3], Step [404/12942], Loss: 2.0305, Perplexity: 7.6178
Epoch [1/3], Step [405/12942], Loss: 2.0920, Perplexity: 8.1010
Epoch [1/3], Step [406/12942], Loss: 2.2370, Perplexity: 9.3652
Epoch [1/3], Step [407/12942], Loss: 2.2972, Perplexity: 9.9460
Epoch [1/3], Step [408/12942], Loss: 2.3152, Perplexity: 10.1264
Epoch [1/3], Step [409/12942], Loss: 2.1158, Perplexity: 8.2961
Epoch [1/3], Step [410/12942], Loss: 1.9209, Perplexity: 6.8269
Epoch [1/3], Step [411/12942], Loss: 2.0810, Perplexity: 8.0128
Epoch [1/3], Step [412/12942], Loss: 1.7755, Perplexity: 5.9030
Epoch [1/3], Step [413/12942], Loss: 2.2513, Perplexity: 9.4999
Epoch [1/3], Step [414/12942], Loss: 1.8187, Perplexity: 6.1636
Epoch [1/3], Step [415/12942], Loss: 2.0863, Perplexity: 8.0554
Epoch [1/3], Step [416/12942], Loss: 2.1794, Perplexity: 8.8413
Epoch [1/3], Step [417/12942], Loss: 2.0338, Perplexity: 7.6430
Epoch [1/3], Step [418/12942], Loss: 2.0998, Perplexity: 8.1644
Epoch [1/3], Step [419/12942], Loss: 2.5903, Perplexity: 13.3332
Epoch [1/3], Step [420/12942], Loss: 1.8606, Perplexity: 6.4275
Epoch [1/3], Step [421/12942], Loss: 2.0949, Perplexity: 8.1244
Epoch [1/3], Step [422/12942], Loss: 2.1801, Perplexity: 8.8474
Epoch [1/3], Step [423/12942], Loss: 2.5433, Perplexity: 12.7214
Epoch [1/3], Step [424/12942], Loss: 2.1763, Perplexity: 8.8135
Epoch [1/3], Step [425/12942], Loss: 1.9898, Perplexity: 7.3139
Epoch [1/3], Step [426/12942], Loss: 2.4842, Perplexity: 11.9911
Epoch [1/3], Step [427/12942], Loss: 1.9610, Perplexity: 7.1064
Epoch [1/3], Step [428/12942], Loss: 1.8970, Perplexity: 6.6658
Epoch [1/3], Step [429/12942], Loss: 2.1923, Perplexity: 8.9561
Epoch [1/3], Step [430/12942], Loss: 1.8579, Perplexity: 6.4100
Epoch [1/3], Step [431/12942], Loss: 1.8990, Perplexity: 6.6794
Epoch [1/3], Step [432/12942], Loss: 2.0402, Perplexity: 7.6920
Epoch [1/3], Step [433/12942], Loss: 1.9864, Perplexity: 7.2896
Epoch [1/3], Step [434/12942], Loss: 1.7722, Perplexity: 5.8839
Epoch [1/3], Step [435/12942], Loss: 1.6411, Perplexity: 5.1607
Epoch [1/3], Step [436/12942], Loss: 2.2134, Perplexity: 9.1464
Epoch [1/3], Step [437/12942], Loss: 1.9490, Perplexity: 7.0214
Epoch [1/3], Step [438/12942], Loss: 2.0035, Perplexity: 7.4146
Epoch [1/3], Step [439/12942], Loss: 2.1960, Perplexity: 8.9889
Epoch [1/3], Step [440/12942], Loss: 2.4156, Perplexity: 11.1965
Epoch [1/3], Step [441/12942], Loss: 1.9051, Perplexity: 6.7199
Epoch [1/3], Step [442/12942], Loss: 2.0883, Perplexity: 8.0709
Epoch [1/3], Step [443/12942], Loss: 2.7309, Perplexity: 15.3461
Epoch [1/3], Step [444/12942], Loss: 1.9523, Perplexity: 7.0452
Epoch [1/3], Step [445/12942], Loss: 1.8999, Perplexity: 6.6853
Epoch [1/3], Step [446/12942], Loss: 1.8362, Perplexity: 6.2726
Epoch [1/3], Step [447/12942], Loss: 2.2733, Perplexity: 9.7112
Epoch [1/3], Step [448/12942], Loss: 2.5544, Perplexity: 12.8640
Epoch [1/3], Step [449/12942], Loss: 1.9114, Perplexity: 6.7626
Epoch [1/3], Step [450/12942], Loss: 2.0827, Perplexity: 8.0264
Epoch [1/3], Step [451/12942], Loss: 1.8641, Perplexity: 6.4499
Epoch [1/3], Step [452/12942], Loss: 1.9483, Perplexity: 7.0165
Epoch [1/3], Step [453/12942], Loss: 2.1029, Perplexity: 8.1897
Epoch [1/3], Step [454/12942], Loss: 1.7826, Perplexity: 5.9450
Epoch [1/3], Step [455/12942], Loss: 2.2745, Perplexity: 9.7227
Epoch [1/3], Step [456/12942], Loss: 2.1190, Perplexity: 8.3225
Epoch [1/3], Step [457/12942], Loss: 2.1227, Perplexity: 8.3536
Epoch [1/3], Step [458/12942], Loss: 2.0841, Perplexity: 8.0377
Epoch [1/3], Step [459/12942], Loss: 2.0518, Perplexity: 7.7820
Epoch [1/3], Step [460/12942], Loss: 1.8817, Perplexity: 6.5646
Epoch [1/3], Step [461/12942], Loss: 2.1535, Perplexity: 8.6148
Epoch [1/3], Step [462/12942], Loss: 2.3917, Perplexity: 10.9319
Epoch [1/3], Step [463/12942], Loss: 1.9018, Perplexity: 6.6979
Epoch [1/3], Step [464/12942], Loss: 2.2075, Perplexity: 9.0928
Epoch [1/3], Step [465/12942], Loss: 1.6762, Perplexity: 5.3450
Epoch [1/3], Step [466/12942], Loss: 1.8229, Perplexity: 6.1896
Epoch [1/3], Step [467/12942], Loss: 2.0021, Perplexity: 7.4048
Epoch [1/3], Step [468/12942], Loss: 2.1646, Perplexity: 8.7108
Epoch [1/3], Step [469/12942], Loss: 1.9774, Perplexity: 7.2243
Epoch [1/3], Step [470/12942], Loss: 2.2172, Perplexity: 9.1816
Epoch [1/3], Step [471/12942], Loss: 2.0207, Perplexity: 7.5434
Epoch [1/3], Step [472/12942], Loss: 2.0416, Perplexity: 7.7027
Epoch [1/3], Step [473/12942], Loss: 2.1037, Perplexity: 8.1968
Epoch [1/3], Step [474/12942], Loss: 1.9014, Perplexity: 6.6952
Epoch [1/3], Step [475/12942], Loss: 1.8448, Perplexity: 6.3267
Epoch [1/3], Step [476/12942], Loss: 2.0356, Perplexity: 7.6570
Epoch [1/3], Step [477/12942], Loss: 2.1005, Perplexity: 8.1706
Epoch [1/3], Step [478/12942], Loss: 2.2038, Perplexity: 9.0597
Epoch [1/3], Step [479/12942], Loss: 2.1786, Perplexity: 8.8341
Epoch [1/3], Step [480/12942], Loss: 1.7988, Perplexity: 6.0424
Epoch [1/3], Step [481/12942], Loss: 1.8710, Perplexity: 6.4945
Epoch [1/3], Step [482/12942], Loss: 2.0081, Perplexity: 7.4489
Epoch [1/3], Step [483/12942], Loss: 1.6337, Perplexity: 5.1226
Epoch [1/3], Step [484/12942], Loss: 3.4340, Perplexity: 30.9999
Epoch [1/3], Step [485/12942], Loss: 1.8272, Perplexity: 6.2167
Epoch [1/3], Step [486/12942], Loss: 1.9833, Perplexity: 7.2669
Epoch [1/3], Step [487/12942], Loss: 2.0949, Perplexity: 8.1243
Epoch [1/3], Step [488/12942], Loss: 2.1008, Perplexity: 8.1729
Epoch [1/3], Step [489/12942], Loss: 2.1162, Perplexity: 8.2998
Epoch [1/3], Step [490/12942], Loss: 1.9266, Perplexity: 6.8661
Epoch [1/3], Step [491/12942], Loss: 1.7250, Perplexity: 5.6125
Epoch [1/3], Step [492/12942], Loss: 1.8774, Perplexity: 6.5364
Epoch [1/3], Step [493/12942], Loss: 1.9958, Perplexity: 7.3578
Epoch [1/3], Step [494/12942], Loss: 1.7807, Perplexity: 5.9342
Epoch [1/3], Step [495/12942], Loss: 2.0729, Perplexity: 7.9482
Epoch [1/3], Step [496/12942], Loss: 2.2528, Perplexity: 9.5144
Epoch [1/3], Step [497/12942], Loss: 2.0770, Perplexity: 7.9802
Epoch [1/3], Step [498/12942], Loss: 2.0057, Perplexity: 7.4313
Epoch [1/3], Step [499/12942], Loss: 1.9305, Perplexity: 6.8929
Epoch [1/3], Step [500/12942], Loss: 2.0098, Perplexity: 7.4616
Epoch [1/3], Step [501/12942], Loss: 1.9786, Perplexity: 7.2329
Epoch [1/3], Step [502/12942], Loss: 1.7802, Perplexity: 5.9312
Epoch [1/3], Step [503/12942], Loss: 2.0845, Perplexity: 8.0407
Epoch [1/3], Step [504/12942], Loss: 2.2913, Perplexity: 9.8880
Epoch [1/3], Step [505/12942], Loss: 2.1755, Perplexity: 8.8070
Epoch [1/3], Step [506/12942], Loss: 2.0898, Perplexity: 8.0832
Epoch [1/3], Step [507/12942], Loss: 2.3292, Perplexity: 10.2698
Epoch [1/3], Step [508/12942], Loss: 2.3073, Perplexity: 10.0472
Epoch [1/3], Step [509/12942], Loss: 2.0762, Perplexity: 7.9738
Epoch [1/3], Step [510/12942], Loss: 1.9831, Perplexity: 7.2649
Epoch [1/3], Step [511/12942], Loss: 1.8795, Perplexity: 6.5499
Epoch [1/3], Step [512/12942], Loss: 2.3096, Perplexity: 10.0707
Epoch [1/3], Step [513/12942], Loss: 2.0722, Perplexity: 7.9419
Epoch [1/3], Step [514/12942], Loss: 2.6958, Perplexity: 14.8166
Epoch [1/3], Step [515/12942], Loss: 1.9495, Perplexity: 7.0250
Epoch [1/3], Step [516/12942], Loss: 2.3322, Perplexity: 10.3002
Epoch [1/3], Step [517/12942], Loss: 2.1043, Perplexity: 8.2012
Epoch [1/3], Step [518/12942], Loss: 2.4815, Perplexity: 11.9593
Epoch [1/3], Step [519/12942], Loss: 2.1309, Perplexity: 8.4224
Epoch [1/3], Step [520/12942], Loss: 2.1105, Perplexity: 8.2523
Epoch [1/3], Step [521/12942], Loss: 1.9305, Perplexity: 6.8933
Epoch [1/3], Step [522/12942], Loss: 2.0151, Perplexity: 7.5014
Epoch [1/3], Step [523/12942], Loss: 2.2793, Perplexity: 9.7697
Epoch [1/3], Step [524/12942], Loss: 2.0811, Perplexity: 8.0131
Epoch [1/3], Step [525/12942], Loss: 1.8627, Perplexity: 6.4408
Epoch [1/3], Step [526/12942], Loss: 2.7079, Perplexity: 14.9977
Epoch [1/3], Step [527/12942], Loss: 2.3597, Perplexity: 10.5875
Epoch [1/3], Step [528/12942], Loss: 2.1436, Perplexity: 8.5302
Epoch [1/3], Step [529/12942], Loss: 1.7934, Perplexity: 6.0100
Epoch [1/3], Step [530/12942], Loss: 1.7487, Perplexity: 5.7473
Epoch [1/3], Step [531/12942], Loss: 2.1010, Perplexity: 8.1744
Epoch [1/3], Step [532/12942], Loss: 2.0079, Perplexity: 7.4475
Epoch [1/3], Step [533/12942], Loss: 1.7714, Perplexity: 5.8791
Epoch [1/3], Step [534/12942], Loss: 2.0221, Perplexity: 7.5539
Epoch [1/3], Step [535/12942], Loss: 1.8969, Perplexity: 6.6652
Epoch [1/3], Step [536/12942], Loss: 2.4344, Perplexity: 11.4091
Epoch [1/3], Step [537/12942], Loss: 1.8202, Perplexity: 6.1734
Epoch [1/3], Step [538/12942], Loss: 2.1979, Perplexity: 9.0060
Epoch [1/3], Step [539/12942], Loss: 1.9056, Perplexity: 6.7232
Epoch [1/3], Step [540/12942], Loss: 2.5745, Perplexity: 13.1252
Epoch [1/3], Step [541/12942], Loss: 2.0635, Perplexity: 7.8738
Epoch [1/3], Step [542/12942], Loss: 2.0649, Perplexity: 7.8841
Epoch [1/3], Step [543/12942], Loss: 2.0670, Perplexity: 7.9010
Epoch [1/3], Step [544/12942], Loss: 1.9476, Perplexity: 7.0119
Epoch [1/3], Step [545/12942], Loss: 2.1465, Perplexity: 8.5545
Epoch [1/3], Step [546/12942], Loss: 2.1121, Perplexity: 8.2659
Epoch [1/3], Step [547/12942], Loss: 2.0729, Perplexity: 7.9476
Epoch [1/3], Step [548/12942], Loss: 2.2278, Perplexity: 9.2797
Epoch [1/3], Step [549/12942], Loss: 1.9305, Perplexity: 6.8930
Epoch [1/3], Step [550/12942], Loss: 1.8899, Perplexity: 6.6188
Epoch [1/3], Step [551/12942], Loss: 2.0997, Perplexity: 8.1637
Epoch [1/3], Step [552/12942], Loss: 2.2251, Perplexity: 9.2542
Epoch [1/3], Step [553/12942], Loss: 1.9172, Perplexity: 6.8019
Epoch [1/3], Step [554/12942], Loss: 2.0224, Perplexity: 7.5561
Epoch [1/3], Step [555/12942], Loss: 2.1244, Perplexity: 8.3682
Epoch [1/3], Step [556/12942], Loss: 2.0377, Perplexity: 7.6727
Epoch [1/3], Step [557/12942], Loss: 2.0252, Perplexity: 7.5780
Epoch [1/3], Step [558/12942], Loss: 1.9303, Perplexity: 6.8916
Epoch [1/3], Step [559/12942], Loss: 1.9286, Perplexity: 6.8798
Epoch [1/3], Step [560/12942], Loss: 2.1908, Perplexity: 8.9420
Epoch [1/3], Step [561/12942], Loss: 2.2244, Perplexity: 9.2479
Epoch [1/3], Step [562/12942], Loss: 1.8710, Perplexity: 6.4946
Epoch [1/3], Step [563/12942], Loss: 2.2938, Perplexity: 9.9127
Epoch [1/3], Step [564/12942], Loss: 1.9097, Perplexity: 6.7510
Epoch [1/3], Step [565/12942], Loss: 2.0648, Perplexity: 7.8834
Epoch [1/3], Step [566/12942], Loss: 2.1375, Perplexity: 8.4780
Epoch [1/3], Step [567/12942], Loss: 2.3113, Perplexity: 10.0873
Epoch [1/3], Step [568/12942], Loss: 1.8640, Perplexity: 6.4492
Epoch [1/3], Step [569/12942], Loss: 2.1967, Perplexity: 8.9949
Epoch [1/3], Step [570/12942], Loss: 2.0180, Perplexity: 7.5229
Epoch [1/3], Step [571/12942], Loss: 2.1092, Perplexity: 8.2419
Epoch [1/3], Step [572/12942], Loss: 1.9252, Perplexity: 6.8567
Epoch [1/3], Step [573/12942], Loss: 1.9893, Perplexity: 7.3105
Epoch [1/3], Step [574/12942], Loss: 3.1672, Perplexity: 23.7421
Epoch [1/3], Step [575/12942], Loss: 2.0843, Perplexity: 8.0386
Epoch [1/3], Step [576/12942], Loss: 2.3023, Perplexity: 9.9976
Epoch [1/3], Step [577/12942], Loss: 1.8251, Perplexity: 6.2035
Epoch [1/3], Step [578/12942], Loss: 2.0785, Perplexity: 7.9924
Epoch [1/3], Step [579/12942], Loss: 1.6287, Perplexity: 5.0975
Epoch [1/3], Step [580/12942], Loss: 1.8628, Perplexity: 6.4415
Epoch [1/3], Step [581/12942], Loss: 2.0893, Perplexity: 8.0791
Epoch [1/3], Step [582/12942], Loss: 2.1339, Perplexity: 8.4477
Epoch [1/3], Step [583/12942], Loss: 2.0503, Perplexity: 7.7702
Epoch [1/3], Step [584/12942], Loss: 2.1628, Perplexity: 8.6958
Epoch [1/3], Step [585/12942], Loss: 1.9741, Perplexity: 7.2005
Epoch [1/3], Step [586/12942], Loss: 1.9195, Perplexity: 6.8174
Epoch [1/3], Step [587/12942], Loss: 1.9846, Perplexity: 7.2760
Epoch [1/3], Step [588/12942], Loss: 1.8898, Perplexity: 6.6179
Epoch [1/3], Step [589/12942], Loss: 1.8804, Perplexity: 6.5564
Epoch [1/3], Step [590/12942], Loss: 2.2045, Perplexity: 9.0661
Epoch [1/3], Step [591/12942], Loss: 1.9053, Perplexity: 6.7213
Epoch [1/3], Step [592/12942], Loss: 2.2164, Perplexity: 9.1739
Epoch [1/3], Step [593/12942], Loss: 2.3124, Perplexity: 10.0989
Epoch [1/3], Step [594/12942], Loss: 1.9821, Perplexity: 7.2582
Epoch [1/3], Step [595/12942], Loss: 2.0014, Perplexity: 7.3991
Epoch [1/3], Step [596/12942], Loss: 1.8936, Perplexity: 6.6432
Epoch [1/3], Step [597/12942], Loss: 2.2778, Perplexity: 9.7556
Epoch [1/3], Step [598/12942], Loss: 2.1750, Perplexity: 8.8020
Epoch [1/3], Step [599/12942], Loss: 1.8496, Perplexity: 6.3574
Epoch [1/3], Step [600/12942], Loss: 2.1736, Perplexity: 8.7901
Epoch [1/3], Step [601/12942], Loss: 2.2215, Perplexity: 9.2208
Epoch [1/3], Step [602/12942], Loss: 2.2710, Perplexity: 9.6888
Epoch [1/3], Step [603/12942], Loss: 1.9718, Perplexity: 7.1838
Epoch [1/3], Step [604/12942], Loss: 1.8952, Perplexity: 6.6535
Epoch [1/3], Step [605/12942], Loss: 1.9548, Perplexity: 7.0625
Epoch [1/3], Step [606/12942], Loss: 2.1170, Perplexity: 8.3058
Epoch [1/3], Step [607/12942], Loss: 1.9145, Perplexity: 6.7838
Epoch [1/3], Step [608/12942], Loss: 2.3389, Perplexity: 10.3700
Epoch [1/3], Step [609/12942], Loss: 2.8330, Perplexity: 16.9967
Epoch [1/3], Step [610/12942], Loss: 2.3033, Perplexity: 10.0074
Epoch [1/3], Step [611/12942], Loss: 2.4088, Perplexity: 11.1209
Epoch [1/3], Step [612/12942], Loss: 2.5116, Perplexity: 12.3243
Epoch [1/3], Step [613/12942], Loss: 1.8748, Perplexity: 6.5197
Epoch [1/3], Step [614/12942], Loss: 2.1746, Perplexity: 8.7990
Epoch [1/3], Step [615/12942], Loss: 1.8721, Perplexity: 6.5020
Epoch [1/3], Step [616/12942], Loss: 2.2680, Perplexity: 9.6602
Epoch [1/3], Step [617/12942], Loss: 2.3384, Perplexity: 10.3649
Epoch [1/3], Step [618/12942], Loss: 2.0706, Perplexity: 7.9300
Epoch [1/3], Step [619/12942], Loss: 1.8416, Perplexity: 6.3064
Epoch [1/3], Step [620/12942], Loss: 1.8516, Perplexity: 6.3701
Epoch [1/3], Step [621/12942], Loss: 2.3150, Perplexity: 10.1245
Epoch [1/3], Step [622/12942], Loss: 2.0247, Perplexity: 7.5742
Epoch [1/3], Step [623/12942], Loss: 2.0362, Perplexity: 7.6611
Epoch [1/3], Step [624/12942], Loss: 2.0931, Perplexity: 8.1097
Epoch [1/3], Step [625/12942], Loss: 1.9569, Perplexity: 7.0773
Epoch [1/3], Step [626/12942], Loss: 2.0624, Perplexity: 7.8645
Epoch [1/3], Step [627/12942], Loss: 1.9374, Perplexity: 6.9408
Epoch [1/3], Step [628/12942], Loss: 1.8805, Perplexity: 6.5569
Epoch [1/3], Step [629/12942], Loss: 2.4109, Perplexity: 11.1440
Epoch [1/3], Step [630/12942], Loss: 1.9686, Perplexity: 7.1606
Epoch [1/3], Step [631/12942], Loss: 1.8946, Perplexity: 6.6497
Epoch [1/3], Step [632/12942], Loss: 2.1483, Perplexity: 8.5700
Epoch [1/3], Step [633/12942], Loss: 2.0293, Perplexity: 7.6088
Epoch [1/3], Step [634/12942], Loss: 1.9556, Perplexity: 7.0684
Epoch [1/3], Step [635/12942], Loss: 2.1006, Perplexity: 8.1708
Epoch [1/3], Step [636/12942], Loss: 2.1195, Perplexity: 8.3267
Epoch [1/3], Step [637/12942], Loss: 1.8327, Perplexity: 6.2507
Epoch [1/3], Step [638/12942], Loss: 1.9834, Perplexity: 7.2675
Epoch [1/3], Step [639/12942], Loss: 2.0685, Perplexity: 7.9130
Epoch [1/3], Step [640/12942], Loss: 2.4495, Perplexity: 11.5828
Epoch [1/3], Step [641/12942], Loss: 2.1171, Perplexity: 8.3072
Epoch [1/3], Step [642/12942], Loss: 1.9598, Perplexity: 7.0980
Epoch [1/3], Step [643/12942], Loss: 1.8486, Perplexity: 6.3506
Epoch [1/3], Step [644/12942], Loss: 1.8283, Perplexity: 6.2236
Epoch [1/3], Step [645/12942], Loss: 2.2856, Perplexity: 9.8315
Epoch [1/3], Step [646/12942], Loss: 2.0763, Perplexity: 7.9746
Epoch [1/3], Step [647/12942], Loss: 2.0464, Perplexity: 7.7403
Epoch [1/3], Step [648/12942], Loss: 2.1872, Perplexity: 8.9100
Epoch [1/3], Step [649/12942], Loss: 2.2570, Perplexity: 9.5545
Epoch [1/3], Step [650/12942], Loss: 2.3766, Perplexity: 10.7685
Epoch [1/3], Step [651/12942], Loss: 2.7060, Perplexity: 14.9690
Epoch [1/3], Step [652/12942], Loss: 1.6307, Perplexity: 5.1074
Epoch [1/3], Step [653/12942], Loss: 1.9803, Perplexity: 7.2448
Epoch [1/3], Step [654/12942], Loss: 1.8834, Perplexity: 6.5758
Epoch [1/3], Step [655/12942], Loss: 2.2848, Perplexity: 9.8233
Epoch [1/3], Step [656/12942], Loss: 1.9683, Perplexity: 7.1584
Epoch [1/3], Step [657/12942], Loss: 2.0681, Perplexity: 7.9096
Epoch [1/3], Step [658/12942], Loss: 2.4497, Perplexity: 11.5843
Epoch [1/3], Step [659/12942], Loss: 2.4556, Perplexity: 11.6531
Epoch [1/3], Step [660/12942], Loss: 2.0819, Perplexity: 8.0197
Epoch [1/3], Step [661/12942], Loss: 2.1095, Perplexity: 8.2440
Epoch [1/3], Step [662/12942], Loss: 1.7510, Perplexity: 5.7602
Epoch [1/3], Step [663/12942], Loss: 1.9086, Perplexity: 6.7433
Epoch [1/3], Step [664/12942], Loss: 2.3881, Perplexity: 10.8928
Epoch [1/3], Step [665/12942], Loss: 1.9289, Perplexity: 6.8818
Epoch [1/3], Step [666/12942], Loss: 1.8744, Perplexity: 6.5169
Epoch [1/3], Step [667/12942], Loss: 1.9916, Perplexity: 7.3276
Epoch [1/3], Step [668/12942], Loss: 1.8750, Perplexity: 6.5211
Epoch [1/3], Step [669/12942], Loss: 2.1014, Perplexity: 8.1774
Epoch [1/3], Step [670/12942], Loss: 2.1608, Perplexity: 8.6777
Epoch [1/3], Step [671/12942], Loss: 2.0789, Perplexity: 7.9960
Epoch [1/3], Step [672/12942], Loss: 2.7311, Perplexity: 15.3494
Epoch [1/3], Step [673/12942], Loss: 1.9575, Perplexity: 7.0817
Epoch [1/3], Step [674/12942], Loss: 2.0341, Perplexity: 7.6457
Epoch [1/3], Step [675/12942], Loss: 2.0039, Perplexity: 7.4183
Epoch [1/3], Step [676/12942], Loss: 1.9903, Perplexity: 7.3179
Epoch [1/3], Step [677/12942], Loss: 3.0657, Perplexity: 21.4493
Epoch [1/3], Step [678/12942], Loss: 2.0040, Perplexity: 7.4185
Epoch [1/3], Step [679/12942], Loss: 2.2633, Perplexity: 9.6147
Epoch [1/3], Step [680/12942], Loss: 2.8789, Perplexity: 17.7941
Epoch [1/3], Step [681/12942], Loss: 1.7459, Perplexity: 5.7308
Epoch [1/3], Step [682/12942], Loss: 1.6298, Perplexity: 5.1029
Epoch [1/3], Step [683/12942], Loss: 1.9165, Perplexity: 6.7973
Epoch [1/3], Step [684/12942], Loss: 1.9449, Perplexity: 6.9927
Epoch [1/3], Step [685/12942], Loss: 2.0817, Perplexity: 8.0180
Epoch [1/3], Step [686/12942], Loss: 1.8495, Perplexity: 6.3564
Epoch [1/3], Step [687/12942], Loss: 2.2991, Perplexity: 9.9655
Epoch [1/3], Step [688/12942], Loss: 2.0861, Perplexity: 8.0538
Epoch [1/3], Step [689/12942], Loss: 2.3826, Perplexity: 10.8325
Epoch [1/3], Step [690/12942], Loss: 2.2539, Perplexity: 9.5251
Epoch [1/3], Step [691/12942], Loss: 2.2912, Perplexity: 9.8868
Epoch [1/3], Step [692/12942], Loss: 2.0932, Perplexity: 8.1110
Epoch [1/3], Step [693/12942], Loss: 2.0348, Perplexity: 7.6510
Epoch [1/3], Step [694/12942], Loss: 1.9405, Perplexity: 6.9624
Epoch [1/3], Step [695/12942], Loss: 1.9667, Perplexity: 7.1468
Epoch [1/3], Step [696/12942], Loss: 2.4108, Perplexity: 11.1425
Epoch [1/3], Step [697/12942], Loss: 2.0478, Perplexity: 7.7509
Epoch [1/3], Step [698/12942], Loss: 2.1205, Perplexity: 8.3357
Epoch [1/3], Step [699/12942], Loss: 2.5408, Perplexity: 12.6899
Epoch [1/3], Step [700/12942], Loss: 2.0680, Perplexity: 7.9091
Epoch [1/3], Step [701/12942], Loss: 2.1320, Perplexity: 8.4319
Epoch [1/3], Step [702/12942], Loss: 2.2740, Perplexity: 9.7187
Epoch [1/3], Step [703/12942], Loss: 2.0610, Perplexity: 7.8535
Epoch [1/3], Step [704/12942], Loss: 2.0118, Perplexity: 7.4771
Epoch [1/3], Step [705/12942], Loss: 1.7543, Perplexity: 5.7793
Epoch [1/3], Step [706/12942], Loss: 2.4031, Perplexity: 11.0575
Epoch [1/3], Step [707/12942], Loss: 2.6006, Perplexity: 13.4714
Epoch [1/3], Step [708/12942], Loss: 2.0719, Perplexity: 7.9396
Epoch [1/3], Step [709/12942], Loss: 1.8448, Perplexity: 6.3271
Epoch [1/3], Step [710/12942], Loss: 2.3809, Perplexity: 10.8144
Epoch [1/3], Step [711/12942], Loss: 1.8827, Perplexity: 6.5713
Epoch [1/3], Step [712/12942], Loss: 2.2019, Perplexity: 9.0424
Epoch [1/3], Step [713/12942], Loss: 2.1471, Perplexity: 8.5601
Epoch [1/3], Step [714/12942], Loss: 1.9560, Perplexity: 7.0709
Epoch [1/3], Step [715/12942], Loss: 2.4279, Perplexity: 11.3345
Epoch [1/3], Step [716/12942], Loss: 2.1317, Perplexity: 8.4295
Epoch [1/3], Step [717/12942], Loss: 2.0654, Perplexity: 7.8885
Epoch [1/3], Step [718/12942], Loss: 1.8489, Perplexity: 6.3528
Epoch [1/3], Step [719/12942], Loss: 2.0812, Perplexity: 8.0137
Epoch [1/3], Step [720/12942], Loss: 2.2523, Perplexity: 9.5100
Epoch [1/3], Step [721/12942], Loss: 2.1583, Perplexity: 8.6567
Epoch [1/3], Step [722/12942], Loss: 1.8077, Perplexity: 6.0967
Epoch [1/3], Step [723/12942], Loss: 2.1492, Perplexity: 8.5783
Epoch [1/3], Step [724/12942], Loss: 2.1950, Perplexity: 8.9802
Epoch [1/3], Step [725/12942], Loss: 2.1082, Perplexity: 8.2338
Epoch [1/3], Step [726/12942], Loss: 1.9038, Perplexity: 6.7111
Epoch [1/3], Step [727/12942], Loss: 2.0364, Perplexity: 7.6632
Epoch [1/3], Step [728/12942], Loss: 2.2593, Perplexity: 9.5760
Epoch [1/3], Step [729/12942], Loss: 1.8352, Perplexity: 6.2663
Epoch [1/3], Step [730/12942], Loss: 2.0627, Perplexity: 7.8675
Epoch [1/3], Step [731/12942], Loss: 2.4871, Perplexity: 12.0263
Epoch [1/3], Step [732/12942], Loss: 2.3203, Perplexity: 10.1790
Epoch [1/3], Step [733/12942], Loss: 2.0012, Perplexity: 7.3976
Epoch [1/3], Step [734/12942], Loss: 1.9706, Perplexity: 7.1751
Epoch [1/3], Step [735/12942], Loss: 2.0105, Perplexity: 7.4669
Epoch [1/3], Step [736/12942], Loss: 2.5133, Perplexity: 12.3453
Epoch [1/3], Step [737/12942], Loss: 2.1256, Perplexity: 8.3782
Epoch [1/3], Step [738/12942], Loss: 2.0173, Perplexity: 7.5181
Epoch [1/3], Step [739/12942], Loss: 1.9199, Perplexity: 6.8203
Epoch [1/3], Step [740/12942], Loss: 2.1916, Perplexity: 8.9497
Epoch [1/3], Step [741/12942], Loss: 1.9668, Perplexity: 7.1474
Epoch [1/3], Step [742/12942], Loss: 2.0978, Perplexity: 8.1480
Epoch [1/3], Step [743/12942], Loss: 1.8879, Perplexity: 6.6053
Epoch [1/3], Step [744/12942], Loss: 1.6715, Perplexity: 5.3202
Epoch [1/3], Step [745/12942], Loss: 1.9435, Perplexity: 6.9831
Epoch [1/3], Step [746/12942], Loss: 1.8943, Perplexity: 6.6480
Epoch [1/3], Step [747/12942], Loss: 2.1285, Perplexity: 8.4022
Epoch [1/3], Step [748/12942], Loss: 1.9821, Perplexity: 7.2579
Epoch [1/3], Step [749/12942], Loss: 2.0826, Perplexity: 8.0251
Epoch [1/3], Step [750/12942], Loss: 1.8372, Perplexity: 6.2787
Epoch [1/3], Step [751/12942], Loss: 1.9557, Perplexity: 7.0688
Epoch [1/3], Step [752/12942], Loss: 1.9253, Perplexity: 6.8569
Epoch [1/3], Step [753/12942], Loss: 1.7579, Perplexity: 5.8004
Epoch [1/3], Step [754/12942], Loss: 1.9383, Perplexity: 6.9469
Epoch [1/3], Step [755/12942], Loss: 1.9940, Perplexity: 7.3448
Epoch [1/3], Step [756/12942], Loss: 2.5052, Perplexity: 12.2456
Epoch [1/3], Step [757/12942], Loss: 2.0181, Perplexity: 7.5237
Epoch [1/3], Step [758/12942], Loss: 2.0801, Perplexity: 8.0057
Epoch [1/3], Step [759/12942], Loss: 1.7793, Perplexity: 5.9255
Epoch [1/3], Step [760/12942], Loss: 2.0129, Perplexity: 7.4848
Epoch [1/3], Step [761/12942], Loss: 2.2326, Perplexity: 9.3244
Epoch [1/3], Step [762/12942], Loss: 2.2126, Perplexity: 9.1391
Epoch [1/3], Step [763/12942], Loss: 2.2295, Perplexity: 9.2956
Epoch [1/3], Step [764/12942], Loss: 2.3395, Perplexity: 10.3756
Epoch [1/3], Step [765/12942], Loss: 1.7129, Perplexity: 5.5449
Epoch [1/3], Step [766/12942], Loss: 1.8797, Perplexity: 6.5515
Epoch [1/3], Step [767/12942], Loss: 2.0244, Perplexity: 7.5714
Epoch [1/3], Step [768/12942], Loss: 1.9473, Perplexity: 7.0099
Epoch [1/3], Step [769/12942], Loss: 2.2524, Perplexity: 9.5104
Epoch [1/3], Step [770/12942], Loss: 2.3580, Perplexity: 10.5698
Epoch [1/3], Step [771/12942], Loss: 2.3700, Perplexity: 10.6969
Epoch [1/3], Step [772/12942], Loss: 2.0658, Perplexity: 7.8917
Epoch [1/3], Step [773/12942], Loss: 1.9041, Perplexity: 6.7136
Epoch [1/3], Step [774/12942], Loss: 2.0243, Perplexity: 7.5711
Epoch [1/3], Step [775/12942], Loss: 1.6662, Perplexity: 5.2919
Epoch [1/3], Step [776/12942], Loss: 2.0570, Perplexity: 7.8226
Epoch [1/3], Step [777/12942], Loss: 1.7875, Perplexity: 5.9746
Epoch [1/3], Step [778/12942], Loss: 1.7783, Perplexity: 5.9200
Epoch [1/3], Step [779/12942], Loss: 2.3932, Perplexity: 10.9487
Epoch [1/3], Step [780/12942], Loss: 2.0971, Perplexity: 8.1422
Epoch [1/3], Step [781/12942], Loss: 1.9681, Perplexity: 7.1570
Epoch [1/3], Step [782/12942], Loss: 2.5551, Perplexity: 12.8720
Epoch [1/3], Step [783/12942], Loss: 1.9165, Perplexity: 6.7974
Epoch [1/3], Step [784/12942], Loss: 2.2723, Perplexity: 9.7016
Epoch [1/3], Step [785/12942], Loss: 1.9770, Perplexity: 7.2210
Epoch [1/3], Step [786/12942], Loss: 1.7304, Perplexity: 5.6432
Epoch [1/3], Step [787/12942], Loss: 2.6949, Perplexity: 14.8040
Epoch [1/3], Step [788/12942], Loss: 2.6523, Perplexity: 14.1860
Epoch [1/3], Step [789/12942], Loss: 1.6823, Perplexity: 5.3780
Epoch [1/3], Step [790/12942], Loss: 2.2723, Perplexity: 9.7021
Epoch [1/3], Step [791/12942], Loss: 2.2458, Perplexity: 9.4480
Epoch [1/3], Step [792/12942], Loss: 2.0147, Perplexity: 7.4984
Epoch [1/3], Step [793/12942], Loss: 2.4327, Perplexity: 11.3898
Epoch [1/3], Step [794/12942], Loss: 2.0119, Perplexity: 7.4773
Epoch [1/3], Step [795/12942], Loss: 2.1869, Perplexity: 8.9079
Epoch [1/3], Step [796/12942], Loss: 2.3621, Perplexity: 10.6134
Epoch [1/3], Step [797/12942], Loss: 1.9054, Perplexity: 6.7221
Epoch [1/3], Step [798/12942], Loss: 2.0464, Perplexity: 7.7401
Epoch [1/3], Step [799/12942], Loss: 1.8599, Perplexity: 6.4230
Epoch [1/3], Step [800/12942], Loss: 1.9262, Perplexity: 6.8632
Epoch [1/3], Step [801/12942], Loss: 1.9423, Perplexity: 6.9751
Epoch [1/3], Step [802/12942], Loss: 2.0217, Perplexity: 7.5509
Epoch [1/3], Step [803/12942], Loss: 1.9535, Perplexity: 7.0535
Epoch [1/3], Step [804/12942], Loss: 2.0813, Perplexity: 8.0152
Epoch [1/3], Step [805/12942], Loss: 1.8135, Perplexity: 6.1316
Epoch [1/3], Step [806/12942], Loss: 2.2511, Perplexity: 9.4979
Epoch [1/3], Step [807/12942], Loss: 1.9603, Perplexity: 7.1014
Epoch [1/3], Step [808/12942], Loss: 2.2620, Perplexity: 9.6021
Epoch [1/3], Step [809/12942], Loss: 2.1751, Perplexity: 8.8032
Epoch [1/3], Step [810/12942], Loss: 2.3780, Perplexity: 10.7833
Epoch [1/3], Step [811/12942], Loss: 2.2156, Perplexity: 9.1673
Epoch [1/3], Step [812/12942], Loss: 2.0359, Perplexity: 7.6590
Epoch [1/3], Step [813/12942], Loss: 2.0729, Perplexity: 7.9478
Epoch [1/3], Step [814/12942], Loss: 2.6969, Perplexity: 14.8334
Epoch [1/3], Step [815/12942], Loss: 1.8174, Perplexity: 6.1557
Epoch [1/3], Step [816/12942], Loss: 2.0082, Perplexity: 7.4498
Epoch [1/3], Step [817/12942], Loss: 2.5354, Perplexity: 12.6215
Epoch [1/3], Step [818/12942], Loss: 1.8340, Perplexity: 6.2589
Epoch [1/3], Step [819/12942], Loss: 1.8972, Perplexity: 6.6675
Epoch [1/3], Step [820/12942], Loss: 1.8320, Perplexity: 6.2465
Epoch [1/3], Step [821/12942], Loss: 1.9104, Perplexity: 6.7555
Epoch [1/3], Step [822/12942], Loss: 2.0363, Perplexity: 7.6624
Epoch [1/3], Step [823/12942], Loss: 1.7720, Perplexity: 5.8827
Epoch [1/3], Step [824/12942], Loss: 2.2620, Perplexity: 9.6022
Epoch [1/3], Step [825/12942], Loss: 2.0225, Perplexity: 7.5575
Epoch [1/3], Step [826/12942], Loss: 2.1250, Perplexity: 8.3733
Epoch [1/3], Step [827/12942], Loss: 2.0967, Perplexity: 8.1395
Epoch [1/3], Step [828/12942], Loss: 2.1350, Perplexity: 8.4571
Epoch [1/3], Step [829/12942], Loss: 2.0677, Perplexity: 7.9067
Epoch [1/3], Step [830/12942], Loss: 2.0246, Perplexity: 7.5734
Epoch [1/3], Step [831/12942], Loss: 1.9493, Perplexity: 7.0239
Epoch [1/3], Step [832/12942], Loss: 1.9493, Perplexity: 7.0241
Epoch [1/3], Step [833/12942], Loss: 1.8779, Perplexity: 6.5398
Epoch [1/3], Step [834/12942], Loss: 2.0995, Perplexity: 8.1621
Epoch [1/3], Step [835/12942], Loss: 1.9627, Perplexity: 7.1182
Epoch [1/3], Step [836/12942], Loss: 2.4411, Perplexity: 11.4858
Epoch [1/3], Step [837/12942], Loss: 1.9945, Perplexity: 7.3482
Epoch [1/3], Step [838/12942], Loss: 1.9295, Perplexity: 6.8861
Epoch [1/3], Step [839/12942], Loss: 2.2992, Perplexity: 9.9658
Epoch [1/3], Step [840/12942], Loss: 1.9951, Perplexity: 7.3531
Epoch [1/3], Step [841/12942], Loss: 2.0424, Perplexity: 7.7088
Epoch [1/3], Step [842/12942], Loss: 2.0050, Perplexity: 7.4259
Epoch [1/3], Step [843/12942], Loss: 2.1017, Perplexity: 8.1802
Epoch [1/3], Step [844/12942], Loss: 2.0548, Perplexity: 7.8054
Epoch [1/3], Step [845/12942], Loss: 2.2559, Perplexity: 9.5435
Epoch [1/3], Step [846/12942], Loss: 1.9152, Perplexity: 6.7885
Epoch [1/3], Step [847/12942], Loss: 2.2844, Perplexity: 9.8197
Epoch [1/3], Step [848/12942], Loss: 2.0880, Perplexity: 8.0688
Epoch [1/3], Step [849/12942], Loss: 1.8688, Perplexity: 6.4802
Epoch [1/3], Step [850/12942], Loss: 1.8617, Perplexity: 6.4347
Epoch [1/3], Step [851/12942], Loss: 2.1319, Perplexity: 8.4309
Epoch [1/3], Step [852/12942], Loss: 2.3876, Perplexity: 10.8874
Epoch [1/3], Step [853/12942], Loss: 2.0519, Perplexity: 7.7826
Epoch [1/3], Step [854/12942], Loss: 1.9650, Perplexity: 7.1352
Epoch [1/3], Step [855/12942], Loss: 2.1013, Perplexity: 8.1767
Epoch [1/3], Step [856/12942], Loss: 2.1841, Perplexity: 8.8826
Epoch [1/3], Step [857/12942], Loss: 1.7794, Perplexity: 5.9264
Epoch [1/3], Step [858/12942], Loss: 2.0199, Perplexity: 7.5376
Epoch [1/3], Step [859/12942], Loss: 2.2387, Perplexity: 9.3811
Epoch [1/3], Step [860/12942], Loss: 2.3403, Perplexity: 10.3839
Epoch [1/3], Step [861/12942], Loss: 1.8811, Perplexity: 6.5609
Epoch [1/3], Step [862/12942], Loss: 2.1806, Perplexity: 8.8520
Epoch [1/3], Step [863/12942], Loss: 2.1588, Perplexity: 8.6603
Epoch [1/3], Step [864/12942], Loss: 1.9122, Perplexity: 6.7679
Epoch [1/3], Step [865/12942], Loss: 1.9732, Perplexity: 7.1937
Epoch [1/3], Step [866/12942], Loss: 2.0118, Perplexity: 7.4764
Epoch [1/3], Step [867/12942], Loss: 1.9784, Perplexity: 7.2313
Epoch [1/3], Step [868/12942], Loss: 2.2544, Perplexity: 9.5296
Epoch [1/3], Step [869/12942], Loss: 2.0087, Perplexity: 7.4538
Epoch [1/3], Step [870/12942], Loss: 2.1327, Perplexity: 8.4376
Epoch [1/3], Step [871/12942], Loss: 1.8829, Perplexity: 6.5726
Epoch [1/3], Step [872/12942], Loss: 2.0905, Perplexity: 8.0890
Epoch [1/3], Step [873/12942], Loss: 2.1185, Perplexity: 8.3183
Epoch [1/3], Step [874/12942], Loss: 1.9254, Perplexity: 6.8576
Epoch [1/3], Step [875/12942], Loss: 2.1746, Perplexity: 8.7984
Epoch [1/3], Step [876/12942], Loss: 2.0224, Perplexity: 7.5567
Epoch [1/3], Step [877/12942], Loss: 1.9728, Perplexity: 7.1910
Epoch [1/3], Step [878/12942], Loss: 2.6664, Perplexity: 14.3874
Epoch [1/3], Step [879/12942], Loss: 1.9573, Perplexity: 7.0800
Epoch [1/3], Step [880/12942], Loss: 1.9220, Perplexity: 6.8343
Epoch [1/3], Step [881/12942], Loss: 2.1103, Perplexity: 8.2504
Epoch [1/3], Step [882/12942], Loss: 2.4514, Perplexity: 11.6050
Epoch [1/3], Step [883/12942], Loss: 1.9784, Perplexity: 7.2313
Epoch [1/3], Step [884/12942], Loss: 2.0835, Perplexity: 8.0325
Epoch [1/3], Step [885/12942], Loss: 2.1944, Perplexity: 8.9745
Epoch [1/3], Step [886/12942], Loss: 2.3158, Perplexity: 10.1334
Epoch [1/3], Step [887/12942], Loss: 2.6616, Perplexity: 14.3198
Epoch [1/3], Step [888/12942], Loss: 2.0107, Perplexity: 7.4684
Epoch [1/3], Step [889/12942], Loss: 1.9592, Perplexity: 7.0935
Epoch [1/3], Step [890/12942], Loss: 2.0101, Perplexity: 7.4641
Epoch [1/3], Step [891/12942], Loss: 1.8093, Perplexity: 6.1060
Epoch [1/3], Step [892/12942], Loss: 2.0225, Perplexity: 7.5571
Epoch [1/3], Step [893/12942], Loss: 2.6567, Perplexity: 14.2487
Epoch [1/3], Step [894/12942], Loss: 1.9898, Perplexity: 7.3144
Epoch [1/3], Step [895/12942], Loss: 2.2170, Perplexity: 9.1799
Epoch [1/3], Step [896/12942], Loss: 1.9955, Perplexity: 7.3557
Epoch [1/3], Step [897/12942], Loss: 1.9142, Perplexity: 6.7814
Epoch [1/3], Step [898/12942], Loss: 2.1618, Perplexity: 8.6869
Epoch [1/3], Step [899/12942], Loss: 2.4513, Perplexity: 11.6037
Epoch [1/3], Step [900/12942], Loss: 2.2911, Perplexity: 9.8863
Epoch [1/3], Step [901/12942], Loss: 2.2856, Perplexity: 9.8312
Epoch [1/3], Step [902/12942], Loss: 2.3536, Perplexity: 10.5233
Epoch [1/3], Step [903/12942], Loss: 2.2246, Perplexity: 9.2500
Epoch [1/3], Step [904/12942], Loss: 1.7516, Perplexity: 5.7639
Epoch [1/3], Step [905/12942], Loss: 2.3450, Perplexity: 10.4328
Epoch [1/3], Step [906/12942], Loss: 1.8556, Perplexity: 6.3957
Epoch [1/3], Step [907/12942], Loss: 1.9905, Perplexity: 7.3195
Epoch [1/3], Step [908/12942], Loss: 2.1691, Perplexity: 8.7505
Epoch [1/3], Step [909/12942], Loss: 1.9686, Perplexity: 7.1610
Epoch [1/3], Step [910/12942], Loss: 1.9587, Perplexity: 7.0903
Epoch [1/3], Step [911/12942], Loss: 2.0181, Perplexity: 7.5240
Epoch [1/3], Step [912/12942], Loss: 2.0300, Perplexity: 7.6140
Epoch [1/3], Step [913/12942], Loss: 2.0218, Perplexity: 7.5523
Epoch [1/3], Step [914/12942], Loss: 1.8958, Perplexity: 6.6580
Epoch [1/3], Step [915/12942], Loss: 1.8856, Perplexity: 6.5904
Epoch [1/3], Step [916/12942], Loss: 1.9504, Perplexity: 7.0314
Epoch [1/3], Step [917/12942], Loss: 1.9326, Perplexity: 6.9073
Epoch [1/3], Step [918/12942], Loss: 2.1227, Perplexity: 8.3535
Epoch [1/3], Step [919/12942], Loss: 1.9951, Perplexity: 7.3533
Epoch [1/3], Step [920/12942], Loss: 2.1623, Perplexity: 8.6914
Epoch [1/3], Step [921/12942], Loss: 2.5067, Perplexity: 12.2650
Epoch [1/3], Step [922/12942], Loss: 2.2236, Perplexity: 9.2409
Epoch [1/3], Step [923/12942], Loss: 1.9525, Perplexity: 7.0463
Epoch [1/3], Step [924/12942], Loss: 2.1288, Perplexity: 8.4047
Epoch [1/3], Step [925/12942], Loss: 2.0117, Perplexity: 7.4758
Epoch [1/3], Step [926/12942], Loss: 2.0266, Perplexity: 7.5881
Epoch [1/3], Step [927/12942], Loss: 1.6712, Perplexity: 5.3188
Epoch [1/3], Step [928/12942], Loss: 2.5722, Perplexity: 13.0945
Epoch [1/3], Step [929/12942], Loss: 1.8927, Perplexity: 6.6374
Epoch [1/3], Step [930/12942], Loss: 2.3449, Perplexity: 10.4322
Epoch [1/3], Step [931/12942], Loss: 1.9295, Perplexity: 6.8862
Epoch [1/3], Step [932/12942], Loss: 2.3004, Perplexity: 9.9780
Epoch [1/3], Step [933/12942], Loss: 2.0529, Perplexity: 7.7902
Epoch [1/3], Step [934/12942], Loss: 1.8862, Perplexity: 6.5940
Epoch [1/3], Step [935/12942], Loss: 1.7719, Perplexity: 5.8819
Epoch [1/3], Step [936/12942], Loss: 1.8038, Perplexity: 6.0729
Epoch [1/3], Step [937/12942], Loss: 2.2578, Perplexity: 9.5621
Epoch [1/3], Step [938/12942], Loss: 2.1032, Perplexity: 8.1920
Epoch [1/3], Step [939/12942], Loss: 2.2762, Perplexity: 9.7395
Epoch [1/3], Step [940/12942], Loss: 1.9325, Perplexity: 6.9071
Epoch [1/3], Step [941/12942], Loss: 1.8166, Perplexity: 6.1506
Epoch [1/3], Step [942/12942], Loss: 2.0070, Perplexity: 7.4406
Epoch [1/3], Step [943/12942], Loss: 1.9551, Perplexity: 7.0649
Epoch [1/3], Step [944/12942], Loss: 2.0836, Perplexity: 8.0330
Epoch [1/3], Step [945/12942], Loss: 2.6456, Perplexity: 14.0912
Epoch [1/3], Step [946/12942], Loss: 1.9710, Perplexity: 7.1777
Epoch [1/3], Step [947/12942], Loss: 2.2672, Perplexity: 9.6528
Epoch [1/3], Step [948/12942], Loss: 1.9403, Perplexity: 6.9606
Epoch [1/3], Step [949/12942], Loss: 2.0865, Perplexity: 8.0567
Epoch [1/3], Step [950/12942], Loss: 1.9409, Perplexity: 6.9647
Epoch [1/3], Step [951/12942], Loss: 2.0562, Perplexity: 7.8164
Epoch [1/3], Step [952/12942], Loss: 2.0470, Perplexity: 7.7445
Epoch [1/3], Step [953/12942], Loss: 1.9191, Perplexity: 6.8150
Epoch [1/3], Step [954/12942], Loss: 2.0118, Perplexity: 7.4764
Epoch [1/3], Step [955/12942], Loss: 2.1949, Perplexity: 8.9790
Epoch [1/3], Step [956/12942], Loss: 1.8973, Perplexity: 6.6677
Epoch [1/3], Step [957/12942], Loss: 2.6709, Perplexity: 14.4534
Epoch [1/3], Step [958/12942], Loss: 2.0098, Perplexity: 7.4619
Epoch [1/3], Step [959/12942], Loss: 1.8452, Perplexity: 6.3293
Epoch [1/3], Step [960/12942], Loss: 2.1723, Perplexity: 8.7786
Epoch [1/3], Step [961/12942], Loss: 2.0581, Perplexity: 7.8309
Epoch [1/3], Step [962/12942], Loss: 2.1521, Perplexity: 8.6030
Epoch [1/3], Step [963/12942], Loss: 1.9529, Perplexity: 7.0493
Epoch [1/3], Step [964/12942], Loss: 2.3302, Perplexity: 10.2801
Epoch [1/3], Step [965/12942], Loss: 2.2610, Perplexity: 9.5926
Epoch [1/3], Step [966/12942], Loss: 2.0648, Perplexity: 7.8841
Epoch [1/3], Step [967/12942], Loss: 1.8239, Perplexity: 6.1960
Epoch [1/3], Step [968/12942], Loss: 2.2121, Perplexity: 9.1347
Epoch [1/3], Step [969/12942], Loss: 2.0576, Perplexity: 7.8269
Epoch [1/3], Step [970/12942], Loss: 2.0046, Perplexity: 7.4234
Epoch [1/3], Step [971/12942], Loss: 1.9322, Perplexity: 6.9044
Epoch [1/3], Step [972/12942], Loss: 1.7197, Perplexity: 5.5829
Epoch [1/3], Step [973/12942], Loss: 1.9338, Perplexity: 6.9154
Epoch [1/3], Step [974/12942], Loss: 2.1533, Perplexity: 8.6134
Epoch [1/3], Step [975/12942], Loss: 2.3018, Perplexity: 9.9925
Epoch [1/3], Step [976/12942], Loss: 2.0303, Perplexity: 7.6165
Epoch [1/3], Step [977/12942], Loss: 1.9323, Perplexity: 6.9055
Epoch [1/3], Step [978/12942], Loss: 2.1489, Perplexity: 8.5757
Epoch [1/3], Step [979/12942], Loss: 1.7325, Perplexity: 5.6549
Epoch [1/3], Step [980/12942], Loss: 1.7873, Perplexity: 5.9730
Epoch [1/3], Step [981/12942], Loss: 2.1512, Perplexity: 8.5954
Epoch [1/3], Step [982/12942], Loss: 1.9317, Perplexity: 6.9012
Epoch [1/3], Step [983/12942], Loss: 2.3693, Perplexity: 10.6901
Epoch [1/3], Step [984/12942], Loss: 2.0941, Perplexity: 8.1180
Epoch [1/3], Step [985/12942], Loss: 2.0165, Perplexity: 7.5122
Epoch [1/3], Step [986/12942], Loss: 2.0875, Perplexity: 8.0644
Epoch [1/3], Step [987/12942], Loss: 2.2753, Perplexity: 9.7308
Epoch [1/3], Step [988/12942], Loss: 2.2109, Perplexity: 9.1236
Epoch [1/3], Step [989/12942], Loss: 2.7867, Perplexity: 16.2281
Epoch [1/3], Step [990/12942], Loss: 1.9014, Perplexity: 6.6956
Epoch [1/3], Step [991/12942], Loss: 2.0873, Perplexity: 8.0633
Epoch [1/3], Step [992/12942], Loss: 1.9075, Perplexity: 6.7361
Epoch [1/3], Step [993/12942], Loss: 1.9326, Perplexity: 6.9072
Epoch [1/3], Step [994/12942], Loss: 2.6165, Perplexity: 13.6878
Epoch [1/3], Step [995/12942], Loss: 1.8332, Perplexity: 6.2536
Epoch [1/3], Step [996/12942], Loss: 1.8320, Perplexity: 6.2466
Epoch [1/3], Step [997/12942], Loss: 2.5652, Perplexity: 13.0027
Epoch [1/3], Step [998/12942], Loss: 2.0072, Perplexity: 7.4428
Epoch [1/3], Step [999/12942], Loss: 2.1030, Perplexity: 8.1905
Epoch [1/3], Step [1000/12942], Loss: 2.0789, Perplexity: 7.9957