Comparison of CBOW, SkipGram and SkipGram with Subword Information.ipynb

Kernel: Python 3

Comparison of CBOW, SkipGram and SkipGram with Subword Information

Imports

import gzip
import gensim 
import logging
import warnings

logging.basicConfig(format='%(asctime)s : %(levelname)s : %(message)s', level=logging.INFO)
warnings.filterwarnings('ignore')

Dataset

Let's take a closer look at the dataset that we will be using. We will print the first line.

data_file="../word2vec/reviews_data.txt.gz"

with gzip.open (data_file, 'rb') as f:
    for i,line in enumerate (f):
        
        #print only two lines
        if i==0:
            print(line)
            break
        
        

b"Oct 12 2009 \tNice trendy hotel location not too bad.\tI stayed in this hotel for one night. As this is a fairly new place some of the taxi drivers did not know where it was and/or did not want to drive there. Once I have eventually arrived at the hotel, I was very pleasantly surprised with the decor of the lobby/ground floor area. It was very stylish and modern. I found the reception's staff geeting me with 'Aloha' a bit out of place, but I guess they are briefed to say that to keep up the coroporate image.As I have a Starwood Preferred Guest member, I was given a small gift upon-check in. It was only a couple of fridge magnets in a gift box, but nevertheless a nice gesture.My room was nice and roomy, there are tea and coffee facilities in each room and you get two complimentary bottles of water plus some toiletries by 'bliss'.The location is not great. It is at the last metro stop and you then need to take a taxi, but if you are not planning on going to see the historic sites in Beijing, then you will be ok.I chose to have some breakfast in the hotel, which was really tasty and there was a good selection of dishes. There are a couple of computers to use in the communal area, as well as a pool table. There is also a small swimming pool and a gym area.I would definitely stay in this hotel again, but only if I did not plan to travel to central Beijing, as it can take a long time. The location is ok if you plan to do a lot of shopping, as there is a big shopping centre just few minutes away from the hotel and there are plenty of eating options around, including restaurants that serve a dog meat!\t\r\n"

Read files into a list

Now that we've had a sneak peak of our dataset, we can read it into a list so that we can pass this on to the Word2Vec model. Notice in the code below, that I am directly reading the compressed file. I'm also doing a mild pre-processing of the reviews using gensim.utils.simple_preprocess (line). This does some basic pre-processing such as tokenization, lowercasing, etc and returns back a list of tokens (words). Documentation of this pre-processing method can be found on the official Gensim documentation site.

def read_input(input_file):
    """This method reads the input file which is in gzip format"""
    
    with gzip.open (input_file, 'rb') as f:
        for i, line in enumerate (f): 

            if (i%10000==0):
                logging.info ("read {0} reviews".format (i))
            # do some pre-processing and return a list of words for each review text
            yield gensim.utils.simple_preprocess (line)

# read the tokenized reviews into a list
# each review item becomes a series of words
# so this becomes a list of lists
documents = list (read_input (data_file))

2020-04-16 17:40:24,107 : INFO : read 0 reviews
2020-04-16 17:40:26,237 : INFO : read 10000 reviews
2020-04-16 17:40:28,448 : INFO : read 20000 reviews
2020-04-16 17:40:31,011 : INFO : read 30000 reviews
2020-04-16 17:40:33,289 : INFO : read 40000 reviews
2020-04-16 17:40:35,953 : INFO : read 50000 reviews
2020-04-16 17:40:38,366 : INFO : read 60000 reviews
2020-04-16 17:40:40,406 : INFO : read 70000 reviews
2020-04-16 17:40:42,259 : INFO : read 80000 reviews
2020-04-16 17:40:44,251 : INFO : read 90000 reviews
2020-04-16 17:40:46,164 : INFO : read 100000 reviews
2020-04-16 17:40:48,051 : INFO : read 110000 reviews
2020-04-16 17:40:49,945 : INFO : read 120000 reviews
2020-04-16 17:40:51,898 : INFO : read 130000 reviews
2020-04-16 17:40:54,444 : INFO : read 140000 reviews
2020-04-16 17:40:56,368 : INFO : read 150000 reviews
2020-04-16 17:40:58,353 : INFO : read 160000 reviews
2020-04-16 17:41:00,284 : INFO : read 170000 reviews
2020-04-16 17:41:02,330 : INFO : read 180000 reviews
2020-04-16 17:41:04,333 : INFO : read 190000 reviews
2020-04-16 17:41:06,480 : INFO : read 200000 reviews
2020-04-16 17:41:08,668 : INFO : read 210000 reviews
2020-04-16 17:41:10,773 : INFO : read 220000 reviews
2020-04-16 17:41:12,730 : INFO : read 230000 reviews
2020-04-16 17:41:15,507 : INFO : read 240000 reviews
2020-04-16 17:41:17,657 : INFO : read 250000 reviews

Training the CBOW, SkipGram and SkipGram with Subword Information Models

Train a CBOW model

model_cbow = gensim.models.Word2Vec (documents, size=150, window=10, min_count=2, workers=10)
%time model_cbow.train(documents,total_examples=len(documents),epochs=10)

2020-04-16 17:41:18,800 : WARNING : consider setting layer size to a multiple of 4 for greater performance
2020-04-16 17:41:18,809 : INFO : collecting all words and their counts
2020-04-16 17:41:18,810 : INFO : PROGRESS: at sentence #0, processed 0 words, keeping 0 word types
2020-04-16 17:41:19,056 : INFO : PROGRESS: at sentence #10000, processed 1655714 words, keeping 25777 word types
2020-04-16 17:41:19,364 : INFO : PROGRESS: at sentence #20000, processed 3317863 words, keeping 35016 word types
2020-04-16 17:41:19,674 : INFO : PROGRESS: at sentence #30000, processed 5264072 words, keeping 47518 word types
2020-04-16 17:41:19,979 : INFO : PROGRESS: at sentence #40000, processed 7081746 words, keeping 56675 word types
2020-04-16 17:41:20,310 : INFO : PROGRESS: at sentence #50000, processed 9089491 words, keeping 63744 word types
2020-04-16 17:41:20,618 : INFO : PROGRESS: at sentence #60000, processed 11013723 words, keeping 76781 word types
2020-04-16 17:41:20,918 : INFO : PROGRESS: at sentence #70000, processed 12637525 words, keeping 83194 word types
2020-04-16 17:41:21,181 : INFO : PROGRESS: at sentence #80000, processed 14099751 words, keeping 88454 word types
2020-04-16 17:41:21,431 : INFO : PROGRESS: at sentence #90000, processed 15662149 words, keeping 93352 word types
2020-04-16 17:41:21,715 : INFO : PROGRESS: at sentence #100000, processed 17164487 words, keeping 97881 word types
2020-04-16 17:41:21,986 : INFO : PROGRESS: at sentence #110000, processed 18652292 words, keeping 102127 word types
2020-04-16 17:41:22,262 : INFO : PROGRESS: at sentence #120000, processed 20152529 words, keeping 105918 word types
2020-04-16 17:41:22,521 : INFO : PROGRESS: at sentence #130000, processed 21684330 words, keeping 110099 word types
2020-04-16 17:41:22,805 : INFO : PROGRESS: at sentence #140000, processed 23330206 words, keeping 114103 word types
2020-04-16 17:41:23,052 : INFO : PROGRESS: at sentence #150000, processed 24838754 words, keeping 118169 word types
2020-04-16 17:41:23,322 : INFO : PROGRESS: at sentence #160000, processed 26390910 words, keeping 118665 word types
2020-04-16 17:41:23,570 : INFO : PROGRESS: at sentence #170000, processed 27913916 words, keeping 123350 word types
2020-04-16 17:41:23,842 : INFO : PROGRESS: at sentence #180000, processed 29535612 words, keeping 126742 word types
2020-04-16 17:41:24,111 : INFO : PROGRESS: at sentence #190000, processed 31096459 words, keeping 129841 word types
2020-04-16 17:41:24,389 : INFO : PROGRESS: at sentence #200000, processed 32805271 words, keeping 133249 word types
2020-04-16 17:41:24,700 : INFO : PROGRESS: at sentence #210000, processed 34434198 words, keeping 136358 word types
2020-04-16 17:41:24,951 : INFO : PROGRESS: at sentence #220000, processed 36083482 words, keeping 139412 word types
2020-04-16 17:41:25,205 : INFO : PROGRESS: at sentence #230000, processed 37571762 words, keeping 142393 word types
2020-04-16 17:41:25,458 : INFO : PROGRESS: at sentence #240000, processed 39138190 words, keeping 145226 word types
2020-04-16 17:41:25,726 : INFO : PROGRESS: at sentence #250000, processed 40695049 words, keeping 147960 word types
2020-04-16 17:41:25,858 : INFO : collected 150053 word types from a corpus of 41519355 raw words and 255404 sentences
2020-04-16 17:41:25,859 : INFO : Loading a fresh vocabulary
2020-04-16 17:41:26,800 : INFO : effective_min_count=2 retains 70538 unique words (47% of original 150053, drops 79515)
2020-04-16 17:41:26,800 : INFO : effective_min_count=2 leaves 41439840 word corpus (99% of original 41519355, drops 79515)
2020-04-16 17:41:27,005 : INFO : deleting the raw counts dictionary of 150053 items
2020-04-16 17:41:27,009 : INFO : sample=0.001 downsamples 55 most-common words
2020-04-16 17:41:27,010 : INFO : downsampling leaves estimated 30349255 word corpus (73.2% of prior 41439840)
2020-04-16 17:41:27,234 : INFO : estimated required memory for 70538 words and 150 dimensions: 119914600 bytes
2020-04-16 17:41:27,235 : INFO : resetting layer weights
2020-04-16 17:41:40,319 : INFO : training model with 10 workers on 70538 vocabulary and 150 features, using sg=0 hs=0 sample=0.001 negative=5 window=10
2020-04-16 17:41:41,330 : INFO : EPOCH 1 - PROGRESS: at 5.30% examples, 1632264 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:42,335 : INFO : EPOCH 1 - PROGRESS: at 10.38% examples, 1652744 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:43,341 : INFO : EPOCH 1 - PROGRESS: at 14.94% examples, 1642742 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:41:44,350 : INFO : EPOCH 1 - PROGRESS: at 19.53% examples, 1647573 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:41:45,357 : INFO : EPOCH 1 - PROGRESS: at 24.12% examples, 1648307 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:41:46,359 : INFO : EPOCH 1 - PROGRESS: at 30.04% examples, 1653134 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:41:47,374 : INFO : EPOCH 1 - PROGRESS: at 35.91% examples, 1651934 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:48,383 : INFO : EPOCH 1 - PROGRESS: at 41.92% examples, 1650836 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:41:49,384 : INFO : EPOCH 1 - PROGRESS: at 47.72% examples, 1649750 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:41:50,391 : INFO : EPOCH 1 - PROGRESS: at 53.21% examples, 1646951 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:41:51,409 : INFO : EPOCH 1 - PROGRESS: at 58.98% examples, 1645091 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:52,421 : INFO : EPOCH 1 - PROGRESS: at 64.81% examples, 1641998 words/s, in_qsize 19, out_qsize 2
2020-04-16 17:41:53,434 : INFO : EPOCH 1 - PROGRESS: at 70.14% examples, 1640450 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:41:54,450 : INFO : EPOCH 1 - PROGRESS: at 75.50% examples, 1634297 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:55,453 : INFO : EPOCH 1 - PROGRESS: at 80.47% examples, 1629210 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:41:56,454 : INFO : EPOCH 1 - PROGRESS: at 85.01% examples, 1614575 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:57,472 : INFO : EPOCH 1 - PROGRESS: at 90.81% examples, 1614300 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:41:58,474 : INFO : EPOCH 1 - PROGRESS: at 96.23% examples, 1613032 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:41:59,106 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:41:59,107 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:41:59,117 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:41:59,118 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:41:59,121 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:41:59,122 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:41:59,128 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:41:59,129 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:41:59,131 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:41:59,135 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:41:59,136 : INFO : EPOCH - 1 : training on 41519355 raw words (30350199 effective words) took 18.8s, 1613540 effective words/s
2020-04-16 17:42:00,143 : INFO : EPOCH 2 - PROGRESS: at 5.16% examples, 1590679 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:01,151 : INFO : EPOCH 2 - PROGRESS: at 10.08% examples, 1597144 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:02,175 : INFO : EPOCH 2 - PROGRESS: at 14.01% examples, 1525436 words/s, in_qsize 14, out_qsize 5
2020-04-16 17:42:03,175 : INFO : EPOCH 2 - PROGRESS: at 18.31% examples, 1527740 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:04,176 : INFO : EPOCH 2 - PROGRESS: at 22.78% examples, 1539724 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:05,190 : INFO : EPOCH 2 - PROGRESS: at 27.87% examples, 1545100 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:42:06,190 : INFO : EPOCH 2 - PROGRESS: at 33.46% examples, 1548773 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:07,202 : INFO : EPOCH 2 - PROGRESS: at 39.00% examples, 1551372 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:42:08,203 : INFO : EPOCH 2 - PROGRESS: at 44.91% examples, 1558821 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:09,207 : INFO : EPOCH 2 - PROGRESS: at 50.32% examples, 1557968 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:42:10,212 : INFO : EPOCH 2 - PROGRESS: at 55.75% examples, 1561753 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:42:11,213 : INFO : EPOCH 2 - PROGRESS: at 61.31% examples, 1565980 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:12,232 : INFO : EPOCH 2 - PROGRESS: at 66.87% examples, 1566003 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:13,234 : INFO : EPOCH 2 - PROGRESS: at 72.20% examples, 1569353 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:14,237 : INFO : EPOCH 2 - PROGRESS: at 77.43% examples, 1570425 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:15,248 : INFO : EPOCH 2 - PROGRESS: at 82.71% examples, 1571582 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:16,249 : INFO : EPOCH 2 - PROGRESS: at 88.09% examples, 1572962 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:17,254 : INFO : EPOCH 2 - PROGRESS: at 93.69% examples, 1574929 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:18,264 : INFO : EPOCH 2 - PROGRESS: at 99.30% examples, 1576626 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:18,334 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:42:18,349 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:42:18,351 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:42:18,355 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:42:18,357 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:42:18,360 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:42:18,367 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:42:18,370 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:42:18,371 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:42:18,374 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:42:18,374 : INFO : EPOCH - 2 : training on 41519355 raw words (30349735 effective words) took 19.2s, 1577909 effective words/s
2020-04-16 17:42:19,386 : INFO : EPOCH 3 - PROGRESS: at 5.14% examples, 1576447 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:20,402 : INFO : EPOCH 3 - PROGRESS: at 10.03% examples, 1579601 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:42:21,407 : INFO : EPOCH 3 - PROGRESS: at 14.56% examples, 1590038 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:22,415 : INFO : EPOCH 3 - PROGRESS: at 18.89% examples, 1576552 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:23,420 : INFO : EPOCH 3 - PROGRESS: at 22.58% examples, 1526413 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:24,421 : INFO : EPOCH 3 - PROGRESS: at 26.86% examples, 1504996 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:25,425 : INFO : EPOCH 3 - PROGRESS: at 32.34% examples, 1503387 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:26,429 : INFO : EPOCH 3 - PROGRESS: at 37.14% examples, 1489994 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:27,442 : INFO : EPOCH 3 - PROGRESS: at 42.30% examples, 1479953 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:28,446 : INFO : EPOCH 3 - PROGRESS: at 47.25% examples, 1471285 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:29,446 : INFO : EPOCH 3 - PROGRESS: at 51.96% examples, 1460526 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:30,458 : INFO : EPOCH 3 - PROGRESS: at 56.85% examples, 1457807 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:31,460 : INFO : EPOCH 3 - PROGRESS: at 61.86% examples, 1457963 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:32,463 : INFO : EPOCH 3 - PROGRESS: at 66.85% examples, 1455209 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:33,467 : INFO : EPOCH 3 - PROGRESS: at 71.65% examples, 1454792 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:34,479 : INFO : EPOCH 3 - PROGRESS: at 76.53% examples, 1454570 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:35,480 : INFO : EPOCH 3 - PROGRESS: at 81.21% examples, 1454916 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:42:36,485 : INFO : EPOCH 3 - PROGRESS: at 86.15% examples, 1456735 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:37,490 : INFO : EPOCH 3 - PROGRESS: at 91.53% examples, 1459178 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:38,490 : INFO : EPOCH 3 - PROGRESS: at 96.58% examples, 1460491 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:39,125 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:42:39,131 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:42:39,133 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:42:39,135 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:42:39,136 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:42:39,147 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:42:39,149 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:42:39,152 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:42:39,154 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:42:39,154 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:42:39,155 : INFO : EPOCH - 3 : training on 41519355 raw words (30348826 effective words) took 20.8s, 1460731 effective words/s
2020-04-16 17:42:40,160 : INFO : EPOCH 4 - PROGRESS: at 4.81% examples, 1480629 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:41,170 : INFO : EPOCH 4 - PROGRESS: at 9.38% examples, 1455448 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:42,183 : INFO : EPOCH 4 - PROGRESS: at 13.26% examples, 1443803 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:43,192 : INFO : EPOCH 4 - PROGRESS: at 17.35% examples, 1441842 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:44,193 : INFO : EPOCH 4 - PROGRESS: at 21.45% examples, 1443601 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:45,194 : INFO : EPOCH 4 - PROGRESS: at 25.31% examples, 1436585 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:46,198 : INFO : EPOCH 4 - PROGRESS: at 30.47% examples, 1434494 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:47,202 : INFO : EPOCH 4 - PROGRESS: at 35.53% examples, 1434229 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:48,202 : INFO : EPOCH 4 - PROGRESS: at 40.78% examples, 1439694 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:49,203 : INFO : EPOCH 4 - PROGRESS: at 46.29% examples, 1445534 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:42:50,220 : INFO : EPOCH 4 - PROGRESS: at 51.27% examples, 1443442 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:42:51,229 : INFO : EPOCH 4 - PROGRESS: at 56.12% examples, 1441037 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:42:52,235 : INFO : EPOCH 4 - PROGRESS: at 61.10% examples, 1440879 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:53,245 : INFO : EPOCH 4 - PROGRESS: at 66.17% examples, 1440480 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:54,245 : INFO : EPOCH 4 - PROGRESS: at 70.89% examples, 1440207 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:55,251 : INFO : EPOCH 4 - PROGRESS: at 75.73% examples, 1438945 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:42:56,269 : INFO : EPOCH 4 - PROGRESS: at 80.36% examples, 1438323 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:57,273 : INFO : EPOCH 4 - PROGRESS: at 84.77% examples, 1433654 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:42:58,275 : INFO : EPOCH 4 - PROGRESS: at 89.59% examples, 1430200 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:42:59,277 : INFO : EPOCH 4 - PROGRESS: at 94.40% examples, 1428193 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:00,290 : INFO : EPOCH 4 - PROGRESS: at 99.26% examples, 1426252 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:43:00,393 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:43:00,396 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:43:00,402 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:43:00,405 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:43:00,415 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:43:00,416 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:43:00,419 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:43:00,421 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:43:00,422 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:43:00,424 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:43:00,424 : INFO : EPOCH - 4 : training on 41519355 raw words (30348500 effective words) took 21.3s, 1427210 effective words/s
2020-04-16 17:43:01,446 : INFO : EPOCH 5 - PROGRESS: at 4.47% examples, 1356235 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:02,449 : INFO : EPOCH 5 - PROGRESS: at 8.90% examples, 1369770 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:03,455 : INFO : EPOCH 5 - PROGRESS: at 12.70% examples, 1389447 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:04,469 : INFO : EPOCH 5 - PROGRESS: at 16.90% examples, 1393910 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:05,487 : INFO : EPOCH 5 - PROGRESS: at 20.57% examples, 1393040 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:06,495 : INFO : EPOCH 5 - PROGRESS: at 24.55% examples, 1395900 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:07,507 : INFO : EPOCH 5 - PROGRESS: at 29.80% examples, 1398276 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:08,519 : INFO : EPOCH 5 - PROGRESS: at 34.77% examples, 1399191 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:09,538 : INFO : EPOCH 5 - PROGRESS: at 39.57% examples, 1392189 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:10,543 : INFO : EPOCH 5 - PROGRESS: at 44.76% examples, 1392736 words/s, in_qsize 18, out_qsize 3
2020-04-16 17:43:11,554 : INFO : EPOCH 5 - PROGRESS: at 49.66% examples, 1393046 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:12,568 : INFO : EPOCH 5 - PROGRESS: at 54.05% examples, 1385756 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:13,569 : INFO : EPOCH 5 - PROGRESS: at 58.94% examples, 1386405 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:14,571 : INFO : EPOCH 5 - PROGRESS: at 63.90% examples, 1387514 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:15,572 : INFO : EPOCH 5 - PROGRESS: at 68.57% examples, 1387287 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:16,583 : INFO : EPOCH 5 - PROGRESS: at 73.29% examples, 1387844 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:17,601 : INFO : EPOCH 5 - PROGRESS: at 77.77% examples, 1386506 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:18,607 : INFO : EPOCH 5 - PROGRESS: at 82.04% examples, 1381862 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:19,608 : INFO : EPOCH 5 - PROGRESS: at 86.64% examples, 1382071 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:20,613 : INFO : EPOCH 5 - PROGRESS: at 91.51% examples, 1381257 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:21,620 : INFO : EPOCH 5 - PROGRESS: at 96.29% examples, 1382112 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:22,327 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:43:22,343 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:43:22,349 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:43:22,351 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:43:22,352 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:43:22,354 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:43:22,359 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:43:22,367 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:43:22,368 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:43:22,369 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:43:22,370 : INFO : EPOCH - 5 : training on 41519355 raw words (30349124 effective words) took 21.9s, 1383294 effective words/s
2020-04-16 17:43:22,370 : INFO : training on a 207596775 raw words (151746384 effective words) took 102.0s, 1486982 effective words/s
2020-04-16 17:43:22,372 : WARNING : Effective 'alpha' higher than previous training cycles
2020-04-16 17:43:22,372 : INFO : training model with 10 workers on 70538 vocabulary and 150 features, using sg=0 hs=0 sample=0.001 negative=5 window=10
2020-04-16 17:43:23,384 : INFO : EPOCH 1 - PROGRESS: at 4.43% examples, 1361552 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:24,393 : INFO : EPOCH 1 - PROGRESS: at 8.36% examples, 1285856 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:25,408 : INFO : EPOCH 1 - PROGRESS: at 11.61% examples, 1249162 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:26,415 : INFO : EPOCH 1 - PROGRESS: at 15.51% examples, 1272722 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:27,426 : INFO : EPOCH 1 - PROGRESS: at 19.30% examples, 1295642 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:28,429 : INFO : EPOCH 1 - PROGRESS: at 23.18% examples, 1310939 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:29,435 : INFO : EPOCH 1 - PROGRESS: at 27.63% examples, 1317090 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:30,446 : INFO : EPOCH 1 - PROGRESS: at 32.47% examples, 1318375 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:31,456 : INFO : EPOCH 1 - PROGRESS: at 37.14% examples, 1321982 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:32,459 : INFO : EPOCH 1 - PROGRESS: at 42.02% examples, 1322690 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:33,465 : INFO : EPOCH 1 - PROGRESS: at 46.89% examples, 1326698 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:34,481 : INFO : EPOCH 1 - PROGRESS: at 51.60% examples, 1327154 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:43:35,495 : INFO : EPOCH 1 - PROGRESS: at 56.26% examples, 1330219 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:43:36,511 : INFO : EPOCH 1 - PROGRESS: at 61.15% examples, 1334450 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:43:37,513 : INFO : EPOCH 1 - PROGRESS: at 66.01% examples, 1338051 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:38,521 : INFO : EPOCH 1 - PROGRESS: at 70.67% examples, 1341749 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:43:39,521 : INFO : EPOCH 1 - PROGRESS: at 75.26% examples, 1342036 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:40,534 : INFO : EPOCH 1 - PROGRESS: at 79.78% examples, 1345639 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:41,538 : INFO : EPOCH 1 - PROGRESS: at 84.12% examples, 1343953 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:42,541 : INFO : EPOCH 1 - PROGRESS: at 88.71% examples, 1343112 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:43,554 : INFO : EPOCH 1 - PROGRESS: at 93.33% examples, 1342592 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:44,565 : INFO : EPOCH 1 - PROGRESS: at 98.01% examples, 1342541 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:44,942 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:43:44,944 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:43:44,946 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:43:44,952 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:43:44,954 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:43:44,967 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:43:44,969 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:43:44,972 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:43:44,973 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:43:44,975 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:43:44,976 : INFO : EPOCH - 1 : training on 41519355 raw words (30349343 effective words) took 22.6s, 1343222 effective words/s
2020-04-16 17:43:45,988 : INFO : EPOCH 2 - PROGRESS: at 4.36% examples, 1334489 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:46,995 : INFO : EPOCH 2 - PROGRESS: at 8.67% examples, 1331424 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:48,012 : INFO : EPOCH 2 - PROGRESS: at 12.26% examples, 1332650 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:43:49,015 : INFO : EPOCH 2 - PROGRESS: at 16.26% examples, 1339089 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:50,018 : INFO : EPOCH 2 - PROGRESS: at 19.93% examples, 1346276 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:51,024 : INFO : EPOCH 2 - PROGRESS: at 23.75% examples, 1349026 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:52,033 : INFO : EPOCH 2 - PROGRESS: at 28.39% examples, 1347296 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:53,040 : INFO : EPOCH 2 - PROGRESS: at 32.58% examples, 1323749 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:54,048 : INFO : EPOCH 2 - PROGRESS: at 36.50% examples, 1301662 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:55,053 : INFO : EPOCH 2 - PROGRESS: at 40.64% examples, 1289018 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:56,054 : INFO : EPOCH 2 - PROGRESS: at 45.12% examples, 1281320 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:57,073 : INFO : EPOCH 2 - PROGRESS: at 49.53% examples, 1278197 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:43:58,092 : INFO : EPOCH 2 - PROGRESS: at 53.78% examples, 1277019 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:43:59,106 : INFO : EPOCH 2 - PROGRESS: at 58.20% examples, 1274835 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:00,115 : INFO : EPOCH 2 - PROGRESS: at 62.67% examples, 1275530 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:01,116 : INFO : EPOCH 2 - PROGRESS: at 67.13% examples, 1275223 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:02,121 : INFO : EPOCH 2 - PROGRESS: at 71.24% examples, 1274040 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:03,122 : INFO : EPOCH 2 - PROGRESS: at 75.58% examples, 1274066 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:04,122 : INFO : EPOCH 2 - PROGRESS: at 79.66% examples, 1274317 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:05,124 : INFO : EPOCH 2 - PROGRESS: at 83.72% examples, 1272065 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:06,128 : INFO : EPOCH 2 - PROGRESS: at 87.75% examples, 1267868 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:07,130 : INFO : EPOCH 2 - PROGRESS: at 92.07% examples, 1265924 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:08,134 : INFO : EPOCH 2 - PROGRESS: at 95.71% examples, 1257490 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:09,147 : INFO : EPOCH 2 - PROGRESS: at 99.44% examples, 1249549 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:09,222 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:44:09,238 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:44:09,249 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:44:09,251 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:44:09,252 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:44:09,253 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:44:09,264 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:44:09,271 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:44:09,272 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:44:09,275 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:44:09,276 : INFO : EPOCH - 2 : training on 41519355 raw words (30349149 effective words) took 24.3s, 1249209 effective words/s
2020-04-16 17:44:10,284 : INFO : EPOCH 3 - PROGRESS: at 3.48% examples, 1080778 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:11,284 : INFO : EPOCH 3 - PROGRESS: at 6.81% examples, 1048050 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:12,290 : INFO : EPOCH 3 - PROGRESS: at 9.41% examples, 977469 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:13,295 : INFO : EPOCH 3 - PROGRESS: at 11.54% examples, 933329 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:44:14,305 : INFO : EPOCH 3 - PROGRESS: at 13.89% examples, 914307 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:15,323 : INFO : EPOCH 3 - PROGRESS: at 15.91% examples, 873829 words/s, in_qsize 18, out_qsize 4
2020-04-16 17:44:16,342 : INFO : EPOCH 3 - PROGRESS: at 17.92% examples, 852767 words/s, in_qsize 14, out_qsize 5
2020-04-16 17:44:17,352 : INFO : EPOCH 3 - PROGRESS: at 19.98% examples, 842804 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:18,366 : INFO : EPOCH 3 - PROGRESS: at 22.79% examples, 854487 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:19,371 : INFO : EPOCH 3 - PROGRESS: at 26.03% examples, 879235 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:20,374 : INFO : EPOCH 3 - PROGRESS: at 30.36% examples, 907676 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:21,393 : INFO : EPOCH 3 - PROGRESS: at 34.67% examples, 931593 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:22,404 : INFO : EPOCH 3 - PROGRESS: at 39.13% examples, 955821 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:23,422 : INFO : EPOCH 3 - PROGRESS: at 43.97% examples, 981384 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:24,429 : INFO : EPOCH 3 - PROGRESS: at 48.65% examples, 1004149 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:25,432 : INFO : EPOCH 3 - PROGRESS: at 52.90% examples, 1020168 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:44:26,449 : INFO : EPOCH 3 - PROGRESS: at 56.84% examples, 1025367 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:27,471 : INFO : EPOCH 3 - PROGRESS: at 61.00% examples, 1034584 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:28,475 : INFO : EPOCH 3 - PROGRESS: at 65.79% examples, 1051506 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:29,488 : INFO : EPOCH 3 - PROGRESS: at 70.25% examples, 1065576 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:30,499 : INFO : EPOCH 3 - PROGRESS: at 74.98% examples, 1080028 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:31,502 : INFO : EPOCH 3 - PROGRESS: at 79.30% examples, 1092492 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:32,504 : INFO : EPOCH 3 - PROGRESS: at 83.71% examples, 1103367 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:33,508 : INFO : EPOCH 3 - PROGRESS: at 88.51% examples, 1115590 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:34,517 : INFO : EPOCH 3 - PROGRESS: at 93.30% examples, 1126197 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:35,524 : INFO : EPOCH 3 - PROGRESS: at 98.13% examples, 1136275 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:35,856 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:44:35,861 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:44:35,866 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:44:35,868 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:44:35,874 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:44:35,881 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:44:35,882 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:44:35,887 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:44:35,888 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:44:35,892 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:44:35,893 : INFO : EPOCH - 3 : training on 41519355 raw words (30347977 effective words) took 26.6s, 1140483 effective words/s
2020-04-16 17:44:36,918 : INFO : EPOCH 4 - PROGRESS: at 4.52% examples, 1373844 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:37,938 : INFO : EPOCH 4 - PROGRESS: at 9.08% examples, 1388387 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:38,944 : INFO : EPOCH 4 - PROGRESS: at 12.76% examples, 1384959 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:39,962 : INFO : EPOCH 4 - PROGRESS: at 16.72% examples, 1371111 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:40,976 : INFO : EPOCH 4 - PROGRESS: at 20.11% examples, 1350299 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:41,980 : INFO : EPOCH 4 - PROGRESS: at 23.85% examples, 1347194 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:42,985 : INFO : EPOCH 4 - PROGRESS: at 28.08% examples, 1327088 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:43,995 : INFO : EPOCH 4 - PROGRESS: at 31.89% examples, 1291674 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:44,999 : INFO : EPOCH 4 - PROGRESS: at 36.10% examples, 1284168 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:46,028 : INFO : EPOCH 4 - PROGRESS: at 39.79% examples, 1258066 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:47,043 : INFO : EPOCH 4 - PROGRESS: at 44.05% examples, 1247025 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:44:48,044 : INFO : EPOCH 4 - PROGRESS: at 47.99% examples, 1237379 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:49,045 : INFO : EPOCH 4 - PROGRESS: at 51.62% examples, 1221940 words/s, in_qsize 18, out_qsize 2
2020-04-16 17:44:50,048 : INFO : EPOCH 4 - PROGRESS: at 55.14% examples, 1210263 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:44:51,051 : INFO : EPOCH 4 - PROGRESS: at 59.35% examples, 1210229 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:52,054 : INFO : EPOCH 4 - PROGRESS: at 63.23% examples, 1204209 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:53,055 : INFO : EPOCH 4 - PROGRESS: at 67.40% examples, 1203818 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:54,057 : INFO : EPOCH 4 - PROGRESS: at 71.42% examples, 1204929 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:44:55,058 : INFO : EPOCH 4 - PROGRESS: at 75.19% examples, 1199451 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:56,073 : INFO : EPOCH 4 - PROGRESS: at 79.34% examples, 1204049 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:57,074 : INFO : EPOCH 4 - PROGRESS: at 83.67% examples, 1209342 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:58,093 : INFO : EPOCH 4 - PROGRESS: at 88.22% examples, 1214090 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:44:59,095 : INFO : EPOCH 4 - PROGRESS: at 92.87% examples, 1219254 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:00,113 : INFO : EPOCH 4 - PROGRESS: at 97.66% examples, 1226037 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:00,530 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:45:00,535 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:45:00,554 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:45:00,557 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:45:00,559 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:45:00,561 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:45:00,564 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:45:00,567 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:45:00,570 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:45:00,577 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:45:00,577 : INFO : EPOCH - 4 : training on 41519355 raw words (30349359 effective words) took 24.7s, 1229748 effective words/s
2020-04-16 17:45:01,583 : INFO : EPOCH 5 - PROGRESS: at 4.36% examples, 1341920 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:02,594 : INFO : EPOCH 5 - PROGRESS: at 8.81% examples, 1357570 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:03,602 : INFO : EPOCH 5 - PROGRESS: at 12.53% examples, 1370853 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:04,604 : INFO : EPOCH 5 - PROGRESS: at 16.49% examples, 1364316 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:05,605 : INFO : EPOCH 5 - PROGRESS: at 20.15% examples, 1368338 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:06,605 : INFO : EPOCH 5 - PROGRESS: at 23.68% examples, 1348535 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:07,614 : INFO : EPOCH 5 - PROGRESS: at 28.10% examples, 1338712 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:08,620 : INFO : EPOCH 5 - PROGRESS: at 31.51% examples, 1288659 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:45:09,624 : INFO : EPOCH 5 - PROGRESS: at 34.69% examples, 1248569 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:10,626 : INFO : EPOCH 5 - PROGRESS: at 36.99% examples, 1190147 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:11,643 : INFO : EPOCH 5 - PROGRESS: at 39.99% examples, 1156917 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:12,648 : INFO : EPOCH 5 - PROGRESS: at 42.94% examples, 1127917 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:13,664 : INFO : EPOCH 5 - PROGRESS: at 45.84% examples, 1099895 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:14,671 : INFO : EPOCH 5 - PROGRESS: at 48.61% examples, 1079066 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:15,710 : INFO : EPOCH 5 - PROGRESS: at 51.22% examples, 1054460 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:16,716 : INFO : EPOCH 5 - PROGRESS: at 53.57% examples, 1034133 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:17,725 : INFO : EPOCH 5 - PROGRESS: at 56.25% examples, 1017185 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:18,742 : INFO : EPOCH 5 - PROGRESS: at 58.74% examples, 999967 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:45:19,754 : INFO : EPOCH 5 - PROGRESS: at 61.10% examples, 982749 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:20,764 : INFO : EPOCH 5 - PROGRESS: at 63.59% examples, 968333 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:21,783 : INFO : EPOCH 5 - PROGRESS: at 66.70% examples, 964735 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:22,814 : INFO : EPOCH 5 - PROGRESS: at 69.67% examples, 960133 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:23,823 : INFO : EPOCH 5 - PROGRESS: at 72.65% examples, 956961 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:24,830 : INFO : EPOCH 5 - PROGRESS: at 76.13% examples, 960550 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:25,831 : INFO : EPOCH 5 - PROGRESS: at 80.07% examples, 971261 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:26,852 : INFO : EPOCH 5 - PROGRESS: at 83.84% examples, 976809 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:27,854 : INFO : EPOCH 5 - PROGRESS: at 86.78% examples, 973566 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:45:28,854 : INFO : EPOCH 5 - PROGRESS: at 89.89% examples, 969800 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:45:29,861 : INFO : EPOCH 5 - PROGRESS: at 93.38% examples, 971446 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:30,878 : INFO : EPOCH 5 - PROGRESS: at 98.01% examples, 983113 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:31,304 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:45:31,314 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:45:31,318 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:45:31,320 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:45:31,321 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:45:31,328 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:45:31,334 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:45:31,335 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:45:31,344 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:45:31,345 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:45:31,346 : INFO : EPOCH - 5 : training on 41519355 raw words (30350762 effective words) took 30.8s, 986570 effective words/s
2020-04-16 17:45:32,353 : INFO : EPOCH 6 - PROGRESS: at 4.09% examples, 1263004 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:33,358 : INFO : EPOCH 6 - PROGRESS: at 8.33% examples, 1285868 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:34,361 : INFO : EPOCH 6 - PROGRESS: at 11.83% examples, 1287353 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:35,364 : INFO : EPOCH 6 - PROGRESS: at 15.32% examples, 1265099 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:36,366 : INFO : EPOCH 6 - PROGRESS: at 18.78% examples, 1262288 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:45:37,375 : INFO : EPOCH 6 - PROGRESS: at 22.21% examples, 1252838 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:38,391 : INFO : EPOCH 6 - PROGRESS: at 25.88% examples, 1254191 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:39,392 : INFO : EPOCH 6 - PROGRESS: at 30.33% examples, 1251521 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:40,392 : INFO : EPOCH 6 - PROGRESS: at 34.87% examples, 1255326 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:41,412 : INFO : EPOCH 6 - PROGRESS: at 39.48% examples, 1256881 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:42,415 : INFO : EPOCH 6 - PROGRESS: at 43.96% examples, 1254328 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:43,433 : INFO : EPOCH 6 - PROGRESS: at 47.90% examples, 1241631 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:44,457 : INFO : EPOCH 6 - PROGRESS: at 51.32% examples, 1219203 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:45,460 : INFO : EPOCH 6 - PROGRESS: at 54.74% examples, 1207126 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:46,463 : INFO : EPOCH 6 - PROGRESS: at 58.53% examples, 1198211 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:45:47,476 : INFO : EPOCH 6 - PROGRESS: at 62.83% examples, 1199744 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:48,485 : INFO : EPOCH 6 - PROGRESS: at 66.92% examples, 1197448 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:45:49,498 : INFO : EPOCH 6 - PROGRESS: at 70.35% examples, 1188159 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:50,513 : INFO : EPOCH 6 - PROGRESS: at 73.27% examples, 1169635 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:51,521 : INFO : EPOCH 6 - PROGRESS: at 76.68% examples, 1163353 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:52,531 : INFO : EPOCH 6 - PROGRESS: at 80.29% examples, 1160915 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:53,534 : INFO : EPOCH 6 - PROGRESS: at 84.27% examples, 1162916 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:54,536 : INFO : EPOCH 6 - PROGRESS: at 88.82% examples, 1169186 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:55,537 : INFO : EPOCH 6 - PROGRESS: at 93.45% examples, 1176864 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:56,540 : INFO : EPOCH 6 - PROGRESS: at 98.17% examples, 1184361 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:56,845 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:45:56,867 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:45:56,870 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:45:56,871 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:45:56,872 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:45:56,873 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:45:56,882 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:45:56,889 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:45:56,889 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:45:56,891 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:45:56,891 : INFO : EPOCH - 6 : training on 41519355 raw words (30347540 effective words) took 25.5s, 1188271 effective words/s
2020-04-16 17:45:57,897 : INFO : EPOCH 7 - PROGRESS: at 4.52% examples, 1400186 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:45:58,900 : INFO : EPOCH 7 - PROGRESS: at 8.62% examples, 1331147 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:45:59,917 : INFO : EPOCH 7 - PROGRESS: at 12.28% examples, 1339449 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:00,924 : INFO : EPOCH 7 - PROGRESS: at 16.26% examples, 1341378 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:01,924 : INFO : EPOCH 7 - PROGRESS: at 19.85% examples, 1343162 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:02,932 : INFO : EPOCH 7 - PROGRESS: at 23.73% examples, 1349230 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:03,933 : INFO : EPOCH 7 - PROGRESS: at 28.24% examples, 1343878 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:46:04,941 : INFO : EPOCH 7 - PROGRESS: at 33.00% examples, 1339509 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:05,943 : INFO : EPOCH 7 - PROGRESS: at 37.53% examples, 1338078 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:06,943 : INFO : EPOCH 7 - PROGRESS: at 42.27% examples, 1334463 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:07,948 : INFO : EPOCH 7 - PROGRESS: at 47.02% examples, 1333859 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:08,955 : INFO : EPOCH 7 - PROGRESS: at 51.74% examples, 1335299 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:09,978 : INFO : EPOCH 7 - PROGRESS: at 55.87% examples, 1324117 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:10,996 : INFO : EPOCH 7 - PROGRESS: at 60.45% examples, 1323338 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:11,997 : INFO : EPOCH 7 - PROGRESS: at 65.07% examples, 1320305 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:12,997 : INFO : EPOCH 7 - PROGRESS: at 69.19% examples, 1315871 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:14,018 : INFO : EPOCH 7 - PROGRESS: at 72.87% examples, 1302282 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:15,039 : INFO : EPOCH 7 - PROGRESS: at 76.78% examples, 1294875 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:16,042 : INFO : EPOCH 7 - PROGRESS: at 80.92% examples, 1294721 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:17,044 : INFO : EPOCH 7 - PROGRESS: at 85.24% examples, 1296002 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:18,048 : INFO : EPOCH 7 - PROGRESS: at 89.26% examples, 1287739 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:19,058 : INFO : EPOCH 7 - PROGRESS: at 93.08% examples, 1279135 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:20,080 : INFO : EPOCH 7 - PROGRESS: at 97.43% examples, 1277203 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:20,628 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:46:20,633 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:46:20,643 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:46:20,645 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:46:20,648 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:46:20,649 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:46:20,651 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:46:20,654 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:46:20,661 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:46:20,662 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:46:20,663 : INFO : EPOCH - 7 : training on 41519355 raw words (30348549 effective words) took 23.8s, 1276996 effective words/s
2020-04-16 17:46:21,678 : INFO : EPOCH 8 - PROGRESS: at 3.92% examples, 1202726 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:22,685 : INFO : EPOCH 8 - PROGRESS: at 7.50% examples, 1148024 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:46:23,698 : INFO : EPOCH 8 - PROGRESS: at 10.64% examples, 1122829 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:24,701 : INFO : EPOCH 8 - PROGRESS: at 14.25% examples, 1169668 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:25,701 : INFO : EPOCH 8 - PROGRESS: at 17.78% examples, 1185450 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:26,704 : INFO : EPOCH 8 - PROGRESS: at 20.73% examples, 1177222 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:27,718 : INFO : EPOCH 8 - PROGRESS: at 23.96% examples, 1169664 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:28,727 : INFO : EPOCH 8 - PROGRESS: at 28.54% examples, 1184254 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:29,731 : INFO : EPOCH 8 - PROGRESS: at 32.98% examples, 1188394 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:30,735 : INFO : EPOCH 8 - PROGRESS: at 37.23% examples, 1194647 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:31,746 : INFO : EPOCH 8 - PROGRESS: at 42.32% examples, 1211744 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:32,746 : INFO : EPOCH 8 - PROGRESS: at 46.85% examples, 1216420 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:33,748 : INFO : EPOCH 8 - PROGRESS: at 51.51% examples, 1225600 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:34,751 : INFO : EPOCH 8 - PROGRESS: at 56.07% examples, 1234161 words/s, in_qsize 20, out_qsize 3
2020-04-16 17:46:35,760 : INFO : EPOCH 8 - PROGRESS: at 60.88% examples, 1244201 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:36,765 : INFO : EPOCH 8 - PROGRESS: at 65.77% examples, 1253462 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:37,777 : INFO : EPOCH 8 - PROGRESS: at 70.21% examples, 1257807 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:38,779 : INFO : EPOCH 8 - PROGRESS: at 74.82% examples, 1262265 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:39,784 : INFO : EPOCH 8 - PROGRESS: at 78.97% examples, 1265600 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:46:40,787 : INFO : EPOCH 8 - PROGRESS: at 83.54% examples, 1270894 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:41,811 : INFO : EPOCH 8 - PROGRESS: at 87.88% examples, 1269927 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:42,816 : INFO : EPOCH 8 - PROGRESS: at 91.69% examples, 1261182 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:43,822 : INFO : EPOCH 8 - PROGRESS: at 94.62% examples, 1243783 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:44,824 : INFO : EPOCH 8 - PROGRESS: at 97.99% examples, 1232726 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:45,282 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:46:45,286 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:46:45,288 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:46:45,291 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:46:45,296 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:46:45,299 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:46:45,301 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:46:45,305 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:46:45,310 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:46:45,313 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:46:45,314 : INFO : EPOCH - 8 : training on 41519355 raw words (30350354 effective words) took 24.6s, 1231546 effective words/s
2020-04-16 17:46:46,334 : INFO : EPOCH 9 - PROGRESS: at 3.70% examples, 1132048 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:47,336 : INFO : EPOCH 9 - PROGRESS: at 7.87% examples, 1208111 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:48,347 : INFO : EPOCH 9 - PROGRESS: at 11.49% examples, 1231890 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:49,367 : INFO : EPOCH 9 - PROGRESS: at 15.25% examples, 1248679 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:50,379 : INFO : EPOCH 9 - PROGRESS: at 18.63% examples, 1239619 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:51,390 : INFO : EPOCH 9 - PROGRESS: at 21.59% examples, 1205093 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:52,415 : INFO : EPOCH 9 - PROGRESS: at 23.75% examples, 1148644 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:53,417 : INFO : EPOCH 9 - PROGRESS: at 26.55% examples, 1111552 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:54,418 : INFO : EPOCH 9 - PROGRESS: at 29.94% examples, 1092332 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:55,431 : INFO : EPOCH 9 - PROGRESS: at 33.52% examples, 1081382 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:56,432 : INFO : EPOCH 9 - PROGRESS: at 37.40% examples, 1085929 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:46:57,449 : INFO : EPOCH 9 - PROGRESS: at 41.92% examples, 1096423 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:46:58,451 : INFO : EPOCH 9 - PROGRESS: at 46.42% examples, 1108823 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:46:59,452 : INFO : EPOCH 9 - PROGRESS: at 50.88% examples, 1121054 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:00,468 : INFO : EPOCH 9 - PROGRESS: at 55.60% examples, 1138562 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:01,469 : INFO : EPOCH 9 - PROGRESS: at 60.32% examples, 1153031 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:02,485 : INFO : EPOCH 9 - PROGRESS: at 65.17% examples, 1163449 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:03,494 : INFO : EPOCH 9 - PROGRESS: at 69.58% examples, 1172754 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:04,512 : INFO : EPOCH 9 - PROGRESS: at 73.57% examples, 1171426 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:05,525 : INFO : EPOCH 9 - PROGRESS: at 76.82% examples, 1163311 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:06,531 : INFO : EPOCH 9 - PROGRESS: at 79.25% examples, 1143723 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:07,531 : INFO : EPOCH 9 - PROGRESS: at 82.42% examples, 1136013 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:08,534 : INFO : EPOCH 9 - PROGRESS: at 86.17% examples, 1136446 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:09,545 : INFO : EPOCH 9 - PROGRESS: at 90.44% examples, 1138273 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:10,547 : INFO : EPOCH 9 - PROGRESS: at 94.87% examples, 1144258 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:11,550 : INFO : EPOCH 9 - PROGRESS: at 99.23% examples, 1148637 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:11,684 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:47:11,695 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:47:11,696 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:47:11,699 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:47:11,705 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:47:11,710 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:47:11,712 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:47:11,713 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:47:11,714 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:47:11,719 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:47:11,720 : INFO : EPOCH - 9 : training on 41519355 raw words (30347664 effective words) took 26.4s, 1149547 effective words/s
2020-04-16 17:47:12,725 : INFO : EPOCH 10 - PROGRESS: at 4.39% examples, 1348733 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:13,728 : INFO : EPOCH 10 - PROGRESS: at 8.71% examples, 1345239 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:14,728 : INFO : EPOCH 10 - PROGRESS: at 12.05% examples, 1315558 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:15,736 : INFO : EPOCH 10 - PROGRESS: at 15.58% examples, 1285233 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:16,736 : INFO : EPOCH 10 - PROGRESS: at 18.80% examples, 1264397 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:17,742 : INFO : EPOCH 10 - PROGRESS: at 21.76% examples, 1225382 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:18,751 : INFO : EPOCH 10 - PROGRESS: at 24.18% examples, 1184480 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:19,755 : INFO : EPOCH 10 - PROGRESS: at 27.53% examples, 1154206 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:20,759 : INFO : EPOCH 10 - PROGRESS: at 30.07% examples, 1104858 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:21,764 : INFO : EPOCH 10 - PROGRESS: at 33.33% examples, 1083392 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:22,774 : INFO : EPOCH 10 - PROGRESS: at 36.40% examples, 1065428 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:23,774 : INFO : EPOCH 10 - PROGRESS: at 40.10% examples, 1063678 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:24,784 : INFO : EPOCH 10 - PROGRESS: at 44.22% examples, 1067581 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:25,788 : INFO : EPOCH 10 - PROGRESS: at 47.91% examples, 1066600 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:26,793 : INFO : EPOCH 10 - PROGRESS: at 51.56% examples, 1064675 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:27,794 : INFO : EPOCH 10 - PROGRESS: at 55.78% examples, 1076422 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:28,815 : INFO : EPOCH 10 - PROGRESS: at 59.77% examples, 1079754 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:29,840 : INFO : EPOCH 10 - PROGRESS: at 62.97% examples, 1070272 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:30,874 : INFO : EPOCH 10 - PROGRESS: at 65.41% examples, 1047036 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:31,878 : INFO : EPOCH 10 - PROGRESS: at 67.67% examples, 1028664 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:32,895 : INFO : EPOCH 10 - PROGRESS: at 70.55% examples, 1021059 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:33,898 : INFO : EPOCH 10 - PROGRESS: at 74.23% examples, 1023007 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:34,901 : INFO : EPOCH 10 - PROGRESS: at 77.69% examples, 1026559 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:35,901 : INFO : EPOCH 10 - PROGRESS: at 81.50% examples, 1032628 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:36,916 : INFO : EPOCH 10 - PROGRESS: at 85.35% examples, 1037845 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:47:37,923 : INFO : EPOCH 10 - PROGRESS: at 89.97% examples, 1047276 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:38,942 : INFO : EPOCH 10 - PROGRESS: at 94.40% examples, 1055577 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:47:39,943 : INFO : EPOCH 10 - PROGRESS: at 98.92% examples, 1064352 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:47:40,126 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:47:40,151 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:47:40,155 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:47:40,156 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:47:40,157 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:47:40,158 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:47:40,168 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:47:40,174 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:47:40,175 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:47:40,177 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:47:40,177 : INFO : EPOCH - 10 : training on 41519355 raw words (30347920 effective words) took 28.5s, 1066612 effective words/s
2020-04-16 17:47:40,178 : INFO : training on a 415193550 raw words (303488617 effective words) took 257.8s, 1177206 effective words/s

CPU times: user 21min 51s, sys: 8.97 s, total: 22min
Wall time: 4min 17s

(303488617, 415193550)

Train a char n-gram model (subword information) with fastText

from gensim.models.fasttext import FastText
model_subword = FastText(documents, size=150, window=10, min_count=2, workers=10, min_n=3, max_n=6)  # instantiate
%time model_subword.train(documents,total_examples=len(documents),epochs=10)

2020-04-16 17:47:40,197 : INFO : resetting layer weights
2020-04-16 17:47:40,198 : INFO : Total number of ngrams is 0
2020-04-16 17:47:40,208 : WARNING : consider setting layer size to a multiple of 4 for greater performance
2020-04-16 17:47:40,210 : INFO : collecting all words and their counts
2020-04-16 17:47:40,211 : INFO : PROGRESS: at sentence #0, processed 0 words, keeping 0 word types
2020-04-16 17:47:40,505 : INFO : PROGRESS: at sentence #10000, processed 1655714 words, keeping 25777 word types
2020-04-16 17:47:40,783 : INFO : PROGRESS: at sentence #20000, processed 3317863 words, keeping 35016 word types
2020-04-16 17:47:41,092 : INFO : PROGRESS: at sentence #30000, processed 5264072 words, keeping 47518 word types
2020-04-16 17:47:41,363 : INFO : PROGRESS: at sentence #40000, processed 7081746 words, keeping 56675 word types
2020-04-16 17:47:41,652 : INFO : PROGRESS: at sentence #50000, processed 9089491 words, keeping 63744 word types
2020-04-16 17:47:41,945 : INFO : PROGRESS: at sentence #60000, processed 11013723 words, keeping 76781 word types
2020-04-16 17:47:42,182 : INFO : PROGRESS: at sentence #70000, processed 12637525 words, keeping 83194 word types
2020-04-16 17:47:42,393 : INFO : PROGRESS: at sentence #80000, processed 14099751 words, keeping 88454 word types
2020-04-16 17:47:42,611 : INFO : PROGRESS: at sentence #90000, processed 15662149 words, keeping 93352 word types
2020-04-16 17:47:42,827 : INFO : PROGRESS: at sentence #100000, processed 17164487 words, keeping 97881 word types
2020-04-16 17:47:43,031 : INFO : PROGRESS: at sentence #110000, processed 18652292 words, keeping 102127 word types
2020-04-16 17:47:43,236 : INFO : PROGRESS: at sentence #120000, processed 20152529 words, keeping 105918 word types
2020-04-16 17:47:43,448 : INFO : PROGRESS: at sentence #130000, processed 21684330 words, keeping 110099 word types
2020-04-16 17:47:43,666 : INFO : PROGRESS: at sentence #140000, processed 23330206 words, keeping 114103 word types
2020-04-16 17:47:43,864 : INFO : PROGRESS: at sentence #150000, processed 24838754 words, keeping 118169 word types
2020-04-16 17:47:44,072 : INFO : PROGRESS: at sentence #160000, processed 26390910 words, keeping 118665 word types
2020-04-16 17:47:44,277 : INFO : PROGRESS: at sentence #170000, processed 27913916 words, keeping 123350 word types
2020-04-16 17:47:44,494 : INFO : PROGRESS: at sentence #180000, processed 29535612 words, keeping 126742 word types
2020-04-16 17:47:44,705 : INFO : PROGRESS: at sentence #190000, processed 31096459 words, keeping 129841 word types
2020-04-16 17:47:44,930 : INFO : PROGRESS: at sentence #200000, processed 32805271 words, keeping 133249 word types
2020-04-16 17:47:45,143 : INFO : PROGRESS: at sentence #210000, processed 34434198 words, keeping 136358 word types
2020-04-16 17:47:45,352 : INFO : PROGRESS: at sentence #220000, processed 36083482 words, keeping 139412 word types
2020-04-16 17:47:45,543 : INFO : PROGRESS: at sentence #230000, processed 37571762 words, keeping 142393 word types
2020-04-16 17:47:45,746 : INFO : PROGRESS: at sentence #240000, processed 39138190 words, keeping 145226 word types
2020-04-16 17:47:45,986 : INFO : PROGRESS: at sentence #250000, processed 40695049 words, keeping 147960 word types
2020-04-16 17:47:46,103 : INFO : collected 150053 word types from a corpus of 41519355 raw words and 255404 sentences
2020-04-16 17:47:46,104 : INFO : Loading a fresh vocabulary
2020-04-16 17:47:46,248 : INFO : effective_min_count=2 retains 70538 unique words (47% of original 150053, drops 79515)
2020-04-16 17:47:46,249 : INFO : effective_min_count=2 leaves 41439840 word corpus (99% of original 41519355, drops 79515)
2020-04-16 17:47:46,443 : INFO : deleting the raw counts dictionary of 150053 items
2020-04-16 17:47:46,446 : INFO : sample=0.001 downsamples 55 most-common words
2020-04-16 17:47:46,447 : INFO : downsampling leaves estimated 30349255 word corpus (73.2% of prior 41439840)
2020-04-16 17:48:40,487 : INFO : estimated required memory for 70538 words, 298771 buckets and 150 dimensions: 316011760 bytes
2020-04-16 17:48:40,498 : INFO : resetting layer weights
2020-04-16 17:49:42,716 : INFO : Total number of ngrams is 298771
2020-04-16 17:49:43,764 : INFO : training model with 10 workers on 70538 vocabulary and 150 features, using sg=0 hs=0 sample=0.001 negative=5 window=10
2020-04-16 17:49:44,773 : INFO : EPOCH 1 - PROGRESS: at 0.74% examples, 244546 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:49:45,777 : INFO : EPOCH 1 - PROGRESS: at 1.76% examples, 276954 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:46,785 : INFO : EPOCH 1 - PROGRESS: at 2.77% examples, 287062 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:47,793 : INFO : EPOCH 1 - PROGRESS: at 3.57% examples, 276037 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:49:48,811 : INFO : EPOCH 1 - PROGRESS: at 4.48% examples, 274779 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:49:49,862 : INFO : EPOCH 1 - PROGRESS: at 5.25% examples, 266466 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:50,871 : INFO : EPOCH 1 - PROGRESS: at 6.01% examples, 260905 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:51,901 : INFO : EPOCH 1 - PROGRESS: at 6.77% examples, 256118 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:52,904 : INFO : EPOCH 1 - PROGRESS: at 7.56% examples, 255574 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:49:53,904 : INFO : EPOCH 1 - PROGRESS: at 8.26% examples, 252348 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:49:54,912 : INFO : EPOCH 1 - PROGRESS: at 8.97% examples, 250827 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:55,954 : INFO : EPOCH 1 - PROGRESS: at 9.61% examples, 247617 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:56,965 : INFO : EPOCH 1 - PROGRESS: at 10.07% examples, 242808 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:49:57,985 : INFO : EPOCH 1 - PROGRESS: at 10.69% examples, 240623 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:49:58,999 : INFO : EPOCH 1 - PROGRESS: at 11.30% examples, 239626 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:00,009 : INFO : EPOCH 1 - PROGRESS: at 11.77% examples, 237153 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:01,112 : INFO : EPOCH 1 - PROGRESS: at 12.21% examples, 231986 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:02,144 : INFO : EPOCH 1 - PROGRESS: at 12.76% examples, 229536 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:03,157 : INFO : EPOCH 1 - PROGRESS: at 13.31% examples, 225755 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:04,161 : INFO : EPOCH 1 - PROGRESS: at 13.83% examples, 224098 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:05,182 : INFO : EPOCH 1 - PROGRESS: at 14.36% examples, 221815 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:06,187 : INFO : EPOCH 1 - PROGRESS: at 15.07% examples, 222828 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:50:07,222 : INFO : EPOCH 1 - PROGRESS: at 15.69% examples, 221028 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:50:08,278 : INFO : EPOCH 1 - PROGRESS: at 16.31% examples, 221211 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:09,305 : INFO : EPOCH 1 - PROGRESS: at 16.81% examples, 219356 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:50:10,314 : INFO : EPOCH 1 - PROGRESS: at 17.28% examples, 217852 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:11,336 : INFO : EPOCH 1 - PROGRESS: at 17.74% examples, 216292 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:12,364 : INFO : EPOCH 1 - PROGRESS: at 18.15% examples, 213284 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:50:13,453 : INFO : EPOCH 1 - PROGRESS: at 18.64% examples, 211520 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:50:14,459 : INFO : EPOCH 1 - PROGRESS: at 19.02% examples, 209458 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:15,490 : INFO : EPOCH 1 - PROGRESS: at 19.38% examples, 207386 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:16,509 : INFO : EPOCH 1 - PROGRESS: at 19.81% examples, 205768 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:17,519 : INFO : EPOCH 1 - PROGRESS: at 20.20% examples, 204253 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:50:18,535 : INFO : EPOCH 1 - PROGRESS: at 20.75% examples, 204511 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:19,548 : INFO : EPOCH 1 - PROGRESS: at 21.65% examples, 205082 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:20,585 : INFO : EPOCH 1 - PROGRESS: at 22.28% examples, 205745 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:21,591 : INFO : EPOCH 1 - PROGRESS: at 22.83% examples, 205615 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:22,619 : INFO : EPOCH 1 - PROGRESS: at 23.25% examples, 204819 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:23,646 : INFO : EPOCH 1 - PROGRESS: at 23.64% examples, 203320 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:24,653 : INFO : EPOCH 1 - PROGRESS: at 24.00% examples, 201997 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:25,663 : INFO : EPOCH 1 - PROGRESS: at 24.41% examples, 200731 words/s, in_qsize 17, out_qsize 1
2020-04-16 17:50:26,691 : INFO : EPOCH 1 - PROGRESS: at 25.10% examples, 200627 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:27,699 : INFO : EPOCH 1 - PROGRESS: at 25.82% examples, 200622 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:28,703 : INFO : EPOCH 1 - PROGRESS: at 26.70% examples, 201283 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:29,710 : INFO : EPOCH 1 - PROGRESS: at 27.54% examples, 201748 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:30,729 : INFO : EPOCH 1 - PROGRESS: at 28.46% examples, 202752 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:31,740 : INFO : EPOCH 1 - PROGRESS: at 29.27% examples, 203274 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:50:32,758 : INFO : EPOCH 1 - PROGRESS: at 30.14% examples, 204194 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:33,811 : INFO : EPOCH 1 - PROGRESS: at 31.13% examples, 205116 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:34,819 : INFO : EPOCH 1 - PROGRESS: at 31.95% examples, 205291 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:35,871 : INFO : EPOCH 1 - PROGRESS: at 32.66% examples, 205142 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:36,949 : INFO : EPOCH 1 - PROGRESS: at 33.42% examples, 205050 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:37,953 : INFO : EPOCH 1 - PROGRESS: at 34.15% examples, 205538 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:38,957 : INFO : EPOCH 1 - PROGRESS: at 34.89% examples, 205737 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:39,992 : INFO : EPOCH 1 - PROGRESS: at 35.70% examples, 205926 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:41,030 : INFO : EPOCH 1 - PROGRESS: at 36.48% examples, 205963 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:42,059 : INFO : EPOCH 1 - PROGRESS: at 37.05% examples, 205305 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:43,156 : INFO : EPOCH 1 - PROGRESS: at 37.65% examples, 204415 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:50:44,156 : INFO : EPOCH 1 - PROGRESS: at 38.27% examples, 203760 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:45,165 : INFO : EPOCH 1 - PROGRESS: at 38.79% examples, 202763 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:50:46,166 : INFO : EPOCH 1 - PROGRESS: at 39.48% examples, 202645 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:47,201 : INFO : EPOCH 1 - PROGRESS: at 40.21% examples, 202509 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:48,202 : INFO : EPOCH 1 - PROGRESS: at 40.92% examples, 202613 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:49,223 : INFO : EPOCH 1 - PROGRESS: at 41.63% examples, 201991 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:50,297 : INFO : EPOCH 1 - PROGRESS: at 42.32% examples, 201741 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:51,315 : INFO : EPOCH 1 - PROGRESS: at 42.87% examples, 201153 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:52,335 : INFO : EPOCH 1 - PROGRESS: at 43.41% examples, 200266 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:53,336 : INFO : EPOCH 1 - PROGRESS: at 44.03% examples, 199781 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:54,473 : INFO : EPOCH 1 - PROGRESS: at 44.51% examples, 198303 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:55,532 : INFO : EPOCH 1 - PROGRESS: at 45.04% examples, 197377 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:50:56,576 : INFO : EPOCH 1 - PROGRESS: at 45.58% examples, 196530 words/s, in_qsize 20, out_qsize 3
2020-04-16 17:50:57,677 : INFO : EPOCH 1 - PROGRESS: at 46.09% examples, 195561 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:58,677 : INFO : EPOCH 1 - PROGRESS: at 46.54% examples, 194874 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:50:59,709 : INFO : EPOCH 1 - PROGRESS: at 47.04% examples, 194201 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:00,783 : INFO : EPOCH 1 - PROGRESS: at 47.53% examples, 193366 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:01,809 : INFO : EPOCH 1 - PROGRESS: at 48.13% examples, 193047 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:02,827 : INFO : EPOCH 1 - PROGRESS: at 48.73% examples, 192662 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:03,870 : INFO : EPOCH 1 - PROGRESS: at 49.29% examples, 192037 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:04,877 : INFO : EPOCH 1 - PROGRESS: at 49.61% examples, 190896 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:05,893 : INFO : EPOCH 1 - PROGRESS: at 50.29% examples, 190897 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:06,970 : INFO : EPOCH 1 - PROGRESS: at 51.04% examples, 191025 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:08,017 : INFO : EPOCH 1 - PROGRESS: at 51.77% examples, 191199 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:09,054 : INFO : EPOCH 1 - PROGRESS: at 52.47% examples, 191400 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:10,123 : INFO : EPOCH 1 - PROGRESS: at 53.13% examples, 191610 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:11,162 : INFO : EPOCH 1 - PROGRESS: at 53.96% examples, 192143 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:12,250 : INFO : EPOCH 1 - PROGRESS: at 54.82% examples, 192735 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:13,326 : INFO : EPOCH 1 - PROGRESS: at 55.68% examples, 192838 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:51:14,335 : INFO : EPOCH 1 - PROGRESS: at 56.53% examples, 193480 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:15,389 : INFO : EPOCH 1 - PROGRESS: at 57.41% examples, 193950 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:16,474 : INFO : EPOCH 1 - PROGRESS: at 58.15% examples, 194085 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:17,486 : INFO : EPOCH 1 - PROGRESS: at 58.93% examples, 194381 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:18,498 : INFO : EPOCH 1 - PROGRESS: at 59.72% examples, 194673 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:19,515 : INFO : EPOCH 1 - PROGRESS: at 60.45% examples, 194886 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:51:20,517 : INFO : EPOCH 1 - PROGRESS: at 61.26% examples, 195259 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:21,559 : INFO : EPOCH 1 - PROGRESS: at 62.05% examples, 195630 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:22,596 : INFO : EPOCH 1 - PROGRESS: at 62.85% examples, 195833 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:23,634 : INFO : EPOCH 1 - PROGRESS: at 63.81% examples, 196254 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:24,692 : INFO : EPOCH 1 - PROGRESS: at 64.81% examples, 196765 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:25,751 : INFO : EPOCH 1 - PROGRESS: at 65.57% examples, 197119 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:26,796 : INFO : EPOCH 1 - PROGRESS: at 66.33% examples, 197412 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:27,825 : INFO : EPOCH 1 - PROGRESS: at 67.13% examples, 197730 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:28,829 : INFO : EPOCH 1 - PROGRESS: at 67.71% examples, 197419 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:29,833 : INFO : EPOCH 1 - PROGRESS: at 68.26% examples, 197116 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:30,865 : INFO : EPOCH 1 - PROGRESS: at 68.80% examples, 196695 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:31,919 : INFO : EPOCH 1 - PROGRESS: at 69.47% examples, 196763 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:32,928 : INFO : EPOCH 1 - PROGRESS: at 70.14% examples, 196990 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:33,938 : INFO : EPOCH 1 - PROGRESS: at 70.86% examples, 197156 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:34,973 : INFO : EPOCH 1 - PROGRESS: at 71.61% examples, 197269 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:36,020 : INFO : EPOCH 1 - PROGRESS: at 72.37% examples, 197491 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:37,113 : INFO : EPOCH 1 - PROGRESS: at 73.11% examples, 197359 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:38,213 : INFO : EPOCH 1 - PROGRESS: at 73.82% examples, 197096 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:39,347 : INFO : EPOCH 1 - PROGRESS: at 74.38% examples, 196659 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:51:40,381 : INFO : EPOCH 1 - PROGRESS: at 75.00% examples, 196577 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:41,397 : INFO : EPOCH 1 - PROGRESS: at 75.61% examples, 196547 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:42,423 : INFO : EPOCH 1 - PROGRESS: at 76.20% examples, 196477 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:51:43,456 : INFO : EPOCH 1 - PROGRESS: at 76.97% examples, 196770 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:44,495 : INFO : EPOCH 1 - PROGRESS: at 77.63% examples, 196914 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:51:45,495 : INFO : EPOCH 1 - PROGRESS: at 78.43% examples, 197308 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:46,533 : INFO : EPOCH 1 - PROGRESS: at 79.16% examples, 197454 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:47,580 : INFO : EPOCH 1 - PROGRESS: at 79.93% examples, 197707 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:48,624 : INFO : EPOCH 1 - PROGRESS: at 80.68% examples, 197956 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:49,671 : INFO : EPOCH 1 - PROGRESS: at 81.41% examples, 198081 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:51:50,675 : INFO : EPOCH 1 - PROGRESS: at 82.23% examples, 198387 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:51,676 : INFO : EPOCH 1 - PROGRESS: at 83.00% examples, 198587 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:52,700 : INFO : EPOCH 1 - PROGRESS: at 83.71% examples, 198739 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:53,713 : INFO : EPOCH 1 - PROGRESS: at 84.47% examples, 199066 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:54,741 : INFO : EPOCH 1 - PROGRESS: at 85.17% examples, 199205 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:55,748 : INFO : EPOCH 1 - PROGRESS: at 85.98% examples, 199485 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:56,800 : INFO : EPOCH 1 - PROGRESS: at 86.81% examples, 199640 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:57,815 : INFO : EPOCH 1 - PROGRESS: at 87.64% examples, 199805 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:51:58,832 : INFO : EPOCH 1 - PROGRESS: at 88.43% examples, 199951 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:51:59,871 : INFO : EPOCH 1 - PROGRESS: at 88.96% examples, 199493 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:52:00,961 : INFO : EPOCH 1 - PROGRESS: at 89.66% examples, 199382 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:01,984 : INFO : EPOCH 1 - PROGRESS: at 90.39% examples, 199424 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:03,002 : INFO : EPOCH 1 - PROGRESS: at 91.14% examples, 199470 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:04,033 : INFO : EPOCH 1 - PROGRESS: at 91.91% examples, 199600 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:05,042 : INFO : EPOCH 1 - PROGRESS: at 92.64% examples, 199701 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:52:06,102 : INFO : EPOCH 1 - PROGRESS: at 93.36% examples, 199787 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:07,128 : INFO : EPOCH 1 - PROGRESS: at 94.19% examples, 199970 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:08,155 : INFO : EPOCH 1 - PROGRESS: at 94.95% examples, 200098 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:09,170 : INFO : EPOCH 1 - PROGRESS: at 95.71% examples, 200195 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:10,174 : INFO : EPOCH 1 - PROGRESS: at 96.47% examples, 200350 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:11,243 : INFO : EPOCH 1 - PROGRESS: at 97.29% examples, 200504 words/s, in_qsize 19, out_qsize 2
2020-04-16 17:52:12,263 : INFO : EPOCH 1 - PROGRESS: at 97.95% examples, 200431 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:13,295 : INFO : EPOCH 1 - PROGRESS: at 98.69% examples, 200497 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:52:14,298 : INFO : EPOCH 1 - PROGRESS: at 99.50% examples, 200701 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:14,655 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:52:14,697 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:52:14,701 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:52:14,735 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:52:14,778 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:52:14,784 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:52:14,815 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:52:14,865 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:52:14,866 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:52:14,878 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:52:14,878 : INFO : EPOCH - 1 : training on 41519355 raw words (30351751 effective words) took 151.1s, 200858 effective words/s
2020-04-16 17:52:16,154 : INFO : EPOCH 2 - PROGRESS: at 0.47% examples, 119991 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:17,160 : INFO : EPOCH 2 - PROGRESS: at 0.97% examples, 139918 words/s, in_qsize 18, out_qsize 0
2020-04-16 17:52:18,164 : INFO : EPOCH 2 - PROGRESS: at 1.40% examples, 136850 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:19,204 : INFO : EPOCH 2 - PROGRESS: at 2.08% examples, 152083 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:20,208 : INFO : EPOCH 2 - PROGRESS: at 2.74% examples, 161323 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:21,214 : INFO : EPOCH 2 - PROGRESS: at 3.46% examples, 169863 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:52:22,227 : INFO : EPOCH 2 - PROGRESS: at 4.12% examples, 173024 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:52:23,237 : INFO : EPOCH 2 - PROGRESS: at 4.83% examples, 178135 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:52:24,245 : INFO : EPOCH 2 - PROGRESS: at 5.52% examples, 181898 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:52:25,284 : INFO : EPOCH 2 - PROGRESS: at 6.20% examples, 184463 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:52:26,294 : INFO : EPOCH 2 - PROGRESS: at 7.01% examples, 188949 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:27,305 : INFO : EPOCH 2 - PROGRESS: at 7.64% examples, 190315 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:28,318 : INFO : EPOCH 2 - PROGRESS: at 8.23% examples, 189873 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:29,344 : INFO : EPOCH 2 - PROGRESS: at 8.69% examples, 185869 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:30,365 : INFO : EPOCH 2 - PROGRESS: at 9.10% examples, 183366 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:31,388 : INFO : EPOCH 2 - PROGRESS: at 9.69% examples, 184124 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:52:32,450 : INFO : EPOCH 2 - PROGRESS: at 10.18% examples, 185273 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:33,481 : INFO : EPOCH 2 - PROGRESS: at 10.80% examples, 186605 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:52:34,491 : INFO : EPOCH 2 - PROGRESS: at 11.42% examples, 188706 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:35,527 : INFO : EPOCH 2 - PROGRESS: at 12.03% examples, 191059 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:36,548 : INFO : EPOCH 2 - PROGRESS: at 12.64% examples, 192703 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:37,589 : INFO : EPOCH 2 - PROGRESS: at 13.40% examples, 194024 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:38,601 : INFO : EPOCH 2 - PROGRESS: at 13.87% examples, 193296 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:39,605 : INFO : EPOCH 2 - PROGRESS: at 14.48% examples, 193600 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:40,635 : INFO : EPOCH 2 - PROGRESS: at 15.13% examples, 194834 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:41,635 : INFO : EPOCH 2 - PROGRESS: at 15.89% examples, 197035 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:42,662 : INFO : EPOCH 2 - PROGRESS: at 16.53% examples, 198038 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:43,702 : INFO : EPOCH 2 - PROGRESS: at 17.16% examples, 199139 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:44,708 : INFO : EPOCH 2 - PROGRESS: at 17.85% examples, 200907 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:45,748 : INFO : EPOCH 2 - PROGRESS: at 18.34% examples, 199929 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:46,791 : INFO : EPOCH 2 - PROGRESS: at 18.89% examples, 199446 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:47,862 : INFO : EPOCH 2 - PROGRESS: at 19.26% examples, 197729 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:48,934 : INFO : EPOCH 2 - PROGRESS: at 19.66% examples, 196153 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:50,023 : INFO : EPOCH 2 - PROGRESS: at 20.20% examples, 196160 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:51,111 : INFO : EPOCH 2 - PROGRESS: at 20.77% examples, 196440 words/s, in_qsize 16, out_qsize 3
2020-04-16 17:52:52,141 : INFO : EPOCH 2 - PROGRESS: at 21.77% examples, 198066 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:53,152 : INFO : EPOCH 2 - PROGRESS: at 22.42% examples, 199235 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:54,155 : INFO : EPOCH 2 - PROGRESS: at 22.99% examples, 199823 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:55,181 : INFO : EPOCH 2 - PROGRESS: at 23.59% examples, 200812 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:56,224 : INFO : EPOCH 2 - PROGRESS: at 24.27% examples, 201982 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:52:57,252 : INFO : EPOCH 2 - PROGRESS: at 25.03% examples, 202701 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:58,263 : INFO : EPOCH 2 - PROGRESS: at 25.91% examples, 203633 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:52:59,279 : INFO : EPOCH 2 - PROGRESS: at 26.81% examples, 204514 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:00,324 : INFO : EPOCH 2 - PROGRESS: at 27.75% examples, 205055 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:01,339 : INFO : EPOCH 2 - PROGRESS: at 28.58% examples, 205713 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:02,349 : INFO : EPOCH 2 - PROGRESS: at 29.44% examples, 206323 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:53:03,407 : INFO : EPOCH 2 - PROGRESS: at 30.23% examples, 206730 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:04,493 : INFO : EPOCH 2 - PROGRESS: at 31.11% examples, 206740 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:05,521 : INFO : EPOCH 2 - PROGRESS: at 32.02% examples, 207374 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:53:06,540 : INFO : EPOCH 2 - PROGRESS: at 32.93% examples, 208165 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:07,695 : INFO : EPOCH 2 - PROGRESS: at 33.64% examples, 207844 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:53:08,710 : INFO : EPOCH 2 - PROGRESS: at 34.53% examples, 208771 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:09,715 : INFO : EPOCH 2 - PROGRESS: at 35.27% examples, 209029 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:10,766 : INFO : EPOCH 2 - PROGRESS: at 36.15% examples, 209371 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:11,769 : INFO : EPOCH 2 - PROGRESS: at 36.95% examples, 209721 words/s, in_qsize 18, out_qsize 3
2020-04-16 17:53:12,876 : INFO : EPOCH 2 - PROGRESS: at 37.90% examples, 210428 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:13,950 : INFO : EPOCH 2 - PROGRESS: at 38.81% examples, 210864 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:15,026 : INFO : EPOCH 2 - PROGRESS: at 39.67% examples, 211299 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:16,039 : INFO : EPOCH 2 - PROGRESS: at 40.51% examples, 211679 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:17,105 : INFO : EPOCH 2 - PROGRESS: at 41.44% examples, 211772 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:18,120 : INFO : EPOCH 2 - PROGRESS: at 42.30% examples, 212116 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:19,124 : INFO : EPOCH 2 - PROGRESS: at 43.07% examples, 212277 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:20,172 : INFO : EPOCH 2 - PROGRESS: at 43.97% examples, 212536 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:53:21,193 : INFO : EPOCH 2 - PROGRESS: at 44.86% examples, 212846 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:22,228 : INFO : EPOCH 2 - PROGRESS: at 45.72% examples, 213105 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:53:23,281 : INFO : EPOCH 2 - PROGRESS: at 46.54% examples, 213411 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:24,299 : INFO : EPOCH 2 - PROGRESS: at 47.35% examples, 213795 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:25,302 : INFO : EPOCH 2 - PROGRESS: at 48.18% examples, 214131 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:26,363 : INFO : EPOCH 2 - PROGRESS: at 49.08% examples, 214280 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:53:27,366 : INFO : EPOCH 2 - PROGRESS: at 49.91% examples, 214784 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:28,407 : INFO : EPOCH 2 - PROGRESS: at 50.77% examples, 215077 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:29,443 : INFO : EPOCH 2 - PROGRESS: at 51.54% examples, 215062 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:30,450 : INFO : EPOCH 2 - PROGRESS: at 52.25% examples, 215139 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:31,454 : INFO : EPOCH 2 - PROGRESS: at 52.91% examples, 215145 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:53:32,486 : INFO : EPOCH 2 - PROGRESS: at 53.70% examples, 215431 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:33,587 : INFO : EPOCH 2 - PROGRESS: at 54.57% examples, 215648 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:34,612 : INFO : EPOCH 2 - PROGRESS: at 55.47% examples, 215859 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:35,633 : INFO : EPOCH 2 - PROGRESS: at 56.30% examples, 216081 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:53:36,687 : INFO : EPOCH 2 - PROGRESS: at 57.18% examples, 216303 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:37,691 : INFO : EPOCH 2 - PROGRESS: at 57.91% examples, 216376 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:38,694 : INFO : EPOCH 2 - PROGRESS: at 58.81% examples, 216888 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:39,763 : INFO : EPOCH 2 - PROGRESS: at 59.58% examples, 216717 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:53:40,852 : INFO : EPOCH 2 - PROGRESS: at 60.30% examples, 216506 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:41,873 : INFO : EPOCH 2 - PROGRESS: at 61.08% examples, 216468 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:42,882 : INFO : EPOCH 2 - PROGRESS: at 61.86% examples, 216702 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:43,889 : INFO : EPOCH 2 - PROGRESS: at 62.64% examples, 216761 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:53:44,891 : INFO : EPOCH 2 - PROGRESS: at 63.62% examples, 217168 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:45,909 : INFO : EPOCH 2 - PROGRESS: at 64.57% examples, 217425 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:46,935 : INFO : EPOCH 2 - PROGRESS: at 65.35% examples, 217577 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:47,948 : INFO : EPOCH 2 - PROGRESS: at 66.06% examples, 217680 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:53:48,951 : INFO : EPOCH 2 - PROGRESS: at 66.95% examples, 218159 words/s, in_qsize 16, out_qsize 0
2020-04-16 17:53:49,959 : INFO : EPOCH 2 - PROGRESS: at 67.73% examples, 218192 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:50,989 : INFO : EPOCH 2 - PROGRESS: at 68.47% examples, 218180 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:51,992 : INFO : EPOCH 2 - PROGRESS: at 69.25% examples, 218368 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:52,999 : INFO : EPOCH 2 - PROGRESS: at 70.00% examples, 218619 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:54,001 : INFO : EPOCH 2 - PROGRESS: at 70.81% examples, 218888 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:55,006 : INFO : EPOCH 2 - PROGRESS: at 71.59% examples, 218997 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:56,012 : INFO : EPOCH 2 - PROGRESS: at 72.44% examples, 219320 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:53:57,054 : INFO : EPOCH 2 - PROGRESS: at 73.33% examples, 219469 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:58,062 : INFO : EPOCH 2 - PROGRESS: at 74.19% examples, 219697 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:53:59,111 : INFO : EPOCH 2 - PROGRESS: at 75.02% examples, 219966 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:00,132 : INFO : EPOCH 2 - PROGRESS: at 75.77% examples, 220105 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:01,198 : INFO : EPOCH 2 - PROGRESS: at 76.58% examples, 220392 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:02,211 : INFO : EPOCH 2 - PROGRESS: at 77.35% examples, 220593 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:03,226 : INFO : EPOCH 2 - PROGRESS: at 78.14% examples, 220853 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:04,240 : INFO : EPOCH 2 - PROGRESS: at 78.88% examples, 220901 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:05,271 : INFO : EPOCH 2 - PROGRESS: at 79.72% examples, 221065 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:06,279 : INFO : EPOCH 2 - PROGRESS: at 80.51% examples, 221331 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:07,281 : INFO : EPOCH 2 - PROGRESS: at 81.31% examples, 221531 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:08,360 : INFO : EPOCH 2 - PROGRESS: at 82.10% examples, 221459 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:09,390 : INFO : EPOCH 2 - PROGRESS: at 82.88% examples, 221480 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:54:10,507 : INFO : EPOCH 2 - PROGRESS: at 83.76% examples, 221707 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:11,547 : INFO : EPOCH 2 - PROGRESS: at 84.56% examples, 222004 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:54:12,620 : INFO : EPOCH 2 - PROGRESS: at 85.33% examples, 221991 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:13,645 : INFO : EPOCH 2 - PROGRESS: at 86.24% examples, 222313 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:54:14,741 : INFO : EPOCH 2 - PROGRESS: at 87.14% examples, 222275 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:15,757 : INFO : EPOCH 2 - PROGRESS: at 88.09% examples, 222611 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:54:16,844 : INFO : EPOCH 2 - PROGRESS: at 88.96% examples, 222590 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:17,848 : INFO : EPOCH 2 - PROGRESS: at 89.84% examples, 222882 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:18,954 : INFO : EPOCH 2 - PROGRESS: at 90.74% examples, 222882 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:19,972 : INFO : EPOCH 2 - PROGRESS: at 91.63% examples, 223142 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:21,049 : INFO : EPOCH 2 - PROGRESS: at 92.49% examples, 223181 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:22,051 : INFO : EPOCH 2 - PROGRESS: at 93.27% examples, 223402 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:23,061 : INFO : EPOCH 2 - PROGRESS: at 94.11% examples, 223445 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:54:24,070 : INFO : EPOCH 2 - PROGRESS: at 94.79% examples, 223267 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:54:25,073 : INFO : EPOCH 2 - PROGRESS: at 95.48% examples, 222987 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:26,129 : INFO : EPOCH 2 - PROGRESS: at 96.17% examples, 222841 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:27,155 : INFO : EPOCH 2 - PROGRESS: at 96.92% examples, 222746 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:28,241 : INFO : EPOCH 2 - PROGRESS: at 97.62% examples, 222486 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:29,251 : INFO : EPOCH 2 - PROGRESS: at 98.35% examples, 222372 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:30,260 : INFO : EPOCH 2 - PROGRESS: at 98.97% examples, 221945 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:31,275 : INFO : EPOCH 2 - PROGRESS: at 99.68% examples, 221823 words/s, in_qsize 13, out_qsize 0
2020-04-16 17:54:31,406 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:54:31,420 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:54:31,422 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:54:31,433 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:54:31,451 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:54:31,495 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:54:31,505 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:54:31,537 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:54:31,568 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:54:31,571 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:54:31,572 : INFO : EPOCH - 2 : training on 41519355 raw words (30344888 effective words) took 136.7s, 222003 effective words/s
2020-04-16 17:54:32,592 : INFO : EPOCH 3 - PROGRESS: at 0.54% examples, 171763 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:33,643 : INFO : EPOCH 3 - PROGRESS: at 0.97% examples, 154076 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:54:34,839 : INFO : EPOCH 3 - PROGRESS: at 1.38% examples, 135432 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:35,853 : INFO : EPOCH 3 - PROGRESS: at 1.74% examples, 128526 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:36,860 : INFO : EPOCH 3 - PROGRESS: at 2.16% examples, 129902 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:37,879 : INFO : EPOCH 3 - PROGRESS: at 2.71% examples, 135186 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:38,925 : INFO : EPOCH 3 - PROGRESS: at 3.46% examples, 146436 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:54:39,932 : INFO : EPOCH 3 - PROGRESS: at 4.25% examples, 156430 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:40,992 : INFO : EPOCH 3 - PROGRESS: at 4.96% examples, 162681 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:42,014 : INFO : EPOCH 3 - PROGRESS: at 5.38% examples, 159072 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:43,057 : INFO : EPOCH 3 - PROGRESS: at 5.83% examples, 157116 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:44,128 : INFO : EPOCH 3 - PROGRESS: at 6.46% examples, 158631 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:45,129 : INFO : EPOCH 3 - PROGRESS: at 7.14% examples, 162343 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:46,264 : INFO : EPOCH 3 - PROGRESS: at 7.52% examples, 158102 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:54:47,300 : INFO : EPOCH 3 - PROGRESS: at 8.02% examples, 158195 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:48,411 : INFO : EPOCH 3 - PROGRESS: at 8.67% examples, 159277 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:49,500 : INFO : EPOCH 3 - PROGRESS: at 9.28% examples, 161613 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:54:50,525 : INFO : EPOCH 3 - PROGRESS: at 9.85% examples, 165011 words/s, in_qsize 18, out_qsize 2
2020-04-16 17:54:51,566 : INFO : EPOCH 3 - PROGRESS: at 10.55% examples, 169053 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:52,615 : INFO : EPOCH 3 - PROGRESS: at 11.08% examples, 170137 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:54:53,664 : INFO : EPOCH 3 - PROGRESS: at 11.42% examples, 167597 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:54:54,672 : INFO : EPOCH 3 - PROGRESS: at 11.94% examples, 169295 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:55,703 : INFO : EPOCH 3 - PROGRESS: at 12.50% examples, 171288 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:56,723 : INFO : EPOCH 3 - PROGRESS: at 13.28% examples, 173836 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:54:57,737 : INFO : EPOCH 3 - PROGRESS: at 13.98% examples, 176428 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:54:58,793 : INFO : EPOCH 3 - PROGRESS: at 14.67% examples, 178297 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:54:59,830 : INFO : EPOCH 3 - PROGRESS: at 15.43% examples, 180719 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:55:00,868 : INFO : EPOCH 3 - PROGRESS: at 16.14% examples, 182974 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:01,906 : INFO : EPOCH 3 - PROGRESS: at 16.90% examples, 185701 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:02,920 : INFO : EPOCH 3 - PROGRESS: at 17.55% examples, 187778 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:55:03,980 : INFO : EPOCH 3 - PROGRESS: at 18.28% examples, 189824 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:05,009 : INFO : EPOCH 3 - PROGRESS: at 18.93% examples, 191061 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:06,017 : INFO : EPOCH 3 - PROGRESS: at 19.48% examples, 192107 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:55:07,079 : INFO : EPOCH 3 - PROGRESS: at 20.16% examples, 193805 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:08,085 : INFO : EPOCH 3 - PROGRESS: at 20.78% examples, 195185 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:09,086 : INFO : EPOCH 3 - PROGRESS: at 21.76% examples, 196608 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:10,111 : INFO : EPOCH 3 - PROGRESS: at 22.42% examples, 197913 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:11,148 : INFO : EPOCH 3 - PROGRESS: at 23.04% examples, 198919 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:12,213 : INFO : EPOCH 3 - PROGRESS: at 23.71% examples, 200254 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:55:13,225 : INFO : EPOCH 3 - PROGRESS: at 24.34% examples, 201246 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:14,227 : INFO : EPOCH 3 - PROGRESS: at 25.19% examples, 202429 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:15,242 : INFO : EPOCH 3 - PROGRESS: at 26.00% examples, 203022 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:16,257 : INFO : EPOCH 3 - PROGRESS: at 26.90% examples, 203757 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:17,279 : INFO : EPOCH 3 - PROGRESS: at 27.87% examples, 204567 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:55:18,297 : INFO : EPOCH 3 - PROGRESS: at 28.71% examples, 205366 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:19,305 : INFO : EPOCH 3 - PROGRESS: at 29.53% examples, 205842 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:20,309 : INFO : EPOCH 3 - PROGRESS: at 30.36% examples, 206631 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:21,358 : INFO : EPOCH 3 - PROGRESS: at 31.37% examples, 207373 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:22,377 : INFO : EPOCH 3 - PROGRESS: at 32.16% examples, 207588 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:23,393 : INFO : EPOCH 3 - PROGRESS: at 33.07% examples, 208523 words/s, in_qsize 17, out_qsize 1
2020-04-16 17:55:24,531 : INFO : EPOCH 3 - PROGRESS: at 33.84% examples, 208682 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:25,541 : INFO : EPOCH 3 - PROGRESS: at 34.74% examples, 209610 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:26,636 : INFO : EPOCH 3 - PROGRESS: at 35.61% examples, 209909 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:27,640 : INFO : EPOCH 3 - PROGRESS: at 36.52% examples, 210629 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:28,647 : INFO : EPOCH 3 - PROGRESS: at 37.33% examples, 211092 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:29,693 : INFO : EPOCH 3 - PROGRESS: at 38.19% examples, 211367 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:30,717 : INFO : EPOCH 3 - PROGRESS: at 39.13% examples, 212095 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:31,758 : INFO : EPOCH 3 - PROGRESS: at 39.92% examples, 212267 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:32,764 : INFO : EPOCH 3 - PROGRESS: at 40.73% examples, 212550 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:33,785 : INFO : EPOCH 3 - PROGRESS: at 41.71% examples, 212895 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:55:34,803 : INFO : EPOCH 3 - PROGRESS: at 42.53% examples, 213331 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:35,827 : INFO : EPOCH 3 - PROGRESS: at 43.41% examples, 213749 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:36,863 : INFO : EPOCH 3 - PROGRESS: at 44.29% examples, 213905 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:37,886 : INFO : EPOCH 3 - PROGRESS: at 45.23% examples, 214403 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:55:38,940 : INFO : EPOCH 3 - PROGRESS: at 46.09% examples, 214586 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:39,958 : INFO : EPOCH 3 - PROGRESS: at 46.83% examples, 214744 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:40,969 : INFO : EPOCH 3 - PROGRESS: at 47.63% examples, 215053 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:41,969 : INFO : EPOCH 3 - PROGRESS: at 48.39% examples, 215071 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:42,977 : INFO : EPOCH 3 - PROGRESS: at 49.29% examples, 215463 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:43,987 : INFO : EPOCH 3 - PROGRESS: at 50.00% examples, 215341 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:55:44,995 : INFO : EPOCH 3 - PROGRESS: at 50.65% examples, 214935 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:46,002 : INFO : EPOCH 3 - PROGRESS: at 51.34% examples, 214826 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:47,035 : INFO : EPOCH 3 - PROGRESS: at 52.17% examples, 215212 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:55:48,051 : INFO : EPOCH 3 - PROGRESS: at 52.91% examples, 215463 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:49,058 : INFO : EPOCH 3 - PROGRESS: at 53.66% examples, 215635 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:50,083 : INFO : EPOCH 3 - PROGRESS: at 54.52% examples, 216055 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:51,092 : INFO : EPOCH 3 - PROGRESS: at 55.47% examples, 216490 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:52,092 : INFO : EPOCH 3 - PROGRESS: at 56.27% examples, 216675 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:53,115 : INFO : EPOCH 3 - PROGRESS: at 57.09% examples, 216804 words/s, in_qsize 19, out_qsize 2
2020-04-16 17:55:54,138 : INFO : EPOCH 3 - PROGRESS: at 57.88% examples, 216995 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:55,143 : INFO : EPOCH 3 - PROGRESS: at 58.65% examples, 217063 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:56,153 : INFO : EPOCH 3 - PROGRESS: at 59.47% examples, 217209 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:55:57,191 : INFO : EPOCH 3 - PROGRESS: at 60.28% examples, 217378 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:58,223 : INFO : EPOCH 3 - PROGRESS: at 61.10% examples, 217464 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:55:59,245 : INFO : EPOCH 3 - PROGRESS: at 61.94% examples, 217821 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:00,248 : INFO : EPOCH 3 - PROGRESS: at 62.77% examples, 218041 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:01,280 : INFO : EPOCH 3 - PROGRESS: at 63.70% examples, 218196 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:02,300 : INFO : EPOCH 3 - PROGRESS: at 64.69% examples, 218524 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:03,325 : INFO : EPOCH 3 - PROGRESS: at 65.43% examples, 218665 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:04,347 : INFO : EPOCH 3 - PROGRESS: at 66.24% examples, 219031 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:05,381 : INFO : EPOCH 3 - PROGRESS: at 67.05% examples, 219133 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:06,386 : INFO : EPOCH 3 - PROGRESS: at 67.88% examples, 219318 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:07,399 : INFO : EPOCH 3 - PROGRESS: at 68.75% examples, 219700 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:08,427 : INFO : EPOCH 3 - PROGRESS: at 69.49% examples, 219809 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:09,441 : INFO : EPOCH 3 - PROGRESS: at 70.25% examples, 220037 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:10,468 : INFO : EPOCH 3 - PROGRESS: at 71.03% examples, 220241 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:11,477 : INFO : EPOCH 3 - PROGRESS: at 71.81% examples, 220332 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:12,503 : INFO : EPOCH 3 - PROGRESS: at 72.74% examples, 220663 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:13,513 : INFO : EPOCH 3 - PROGRESS: at 73.48% examples, 220382 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:14,566 : INFO : EPOCH 3 - PROGRESS: at 74.15% examples, 220013 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:15,568 : INFO : EPOCH 3 - PROGRESS: at 74.88% examples, 220033 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:16,570 : INFO : EPOCH 3 - PROGRESS: at 75.54% examples, 220004 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:56:17,581 : INFO : EPOCH 3 - PROGRESS: at 76.24% examples, 220069 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:18,595 : INFO : EPOCH 3 - PROGRESS: at 77.05% examples, 220341 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:19,598 : INFO : EPOCH 3 - PROGRESS: at 77.69% examples, 220287 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:20,766 : INFO : EPOCH 3 - PROGRESS: at 78.43% examples, 219974 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:21,803 : INFO : EPOCH 3 - PROGRESS: at 79.25% examples, 220122 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:22,806 : INFO : EPOCH 3 - PROGRESS: at 79.98% examples, 220213 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:23,855 : INFO : EPOCH 3 - PROGRESS: at 80.75% examples, 220332 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:24,881 : INFO : EPOCH 3 - PROGRESS: at 81.59% examples, 220564 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:25,908 : INFO : EPOCH 3 - PROGRESS: at 82.38% examples, 220598 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:26,910 : INFO : EPOCH 3 - PROGRESS: at 83.17% examples, 220683 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:27,917 : INFO : EPOCH 3 - PROGRESS: at 83.88% examples, 220688 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:28,946 : INFO : EPOCH 3 - PROGRESS: at 84.65% examples, 220952 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:29,976 : INFO : EPOCH 3 - PROGRESS: at 85.39% examples, 220963 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:30,995 : INFO : EPOCH 3 - PROGRESS: at 86.22% examples, 221067 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:56:32,047 : INFO : EPOCH 3 - PROGRESS: at 87.16% examples, 221241 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:33,051 : INFO : EPOCH 3 - PROGRESS: at 88.05% examples, 221431 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:34,065 : INFO : EPOCH 3 - PROGRESS: at 88.88% examples, 221488 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:35,080 : INFO : EPOCH 3 - PROGRESS: at 89.72% examples, 221657 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:56:36,114 : INFO : EPOCH 3 - PROGRESS: at 90.54% examples, 221676 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:56:37,154 : INFO : EPOCH 3 - PROGRESS: at 91.41% examples, 221790 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:38,172 : INFO : EPOCH 3 - PROGRESS: at 92.31% examples, 222003 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:39,211 : INFO : EPOCH 3 - PROGRESS: at 93.02% examples, 222000 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:40,305 : INFO : EPOCH 3 - PROGRESS: at 93.85% examples, 221962 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:41,322 : INFO : EPOCH 3 - PROGRESS: at 94.64% examples, 222010 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:42,374 : INFO : EPOCH 3 - PROGRESS: at 95.52% examples, 222104 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:56:43,496 : INFO : EPOCH 3 - PROGRESS: at 96.35% examples, 222131 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:44,502 : INFO : EPOCH 3 - PROGRESS: at 97.13% examples, 222174 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:56:45,524 : INFO : EPOCH 3 - PROGRESS: at 97.95% examples, 222194 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:46,570 : INFO : EPOCH 3 - PROGRESS: at 98.64% examples, 221973 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:47,588 : INFO : EPOCH 3 - PROGRESS: at 99.40% examples, 221913 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:48,022 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:56:48,024 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:56:48,025 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:56:48,103 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:56:48,104 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:56:48,110 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:56:48,135 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:56:48,160 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:56:48,173 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:56:48,182 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:56:48,183 : INFO : EPOCH - 3 : training on 41519355 raw words (30350684 effective words) took 136.6s, 222180 effective words/s
2020-04-16 17:56:49,197 : INFO : EPOCH 4 - PROGRESS: at 0.66% examples, 208585 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:50,265 : INFO : EPOCH 4 - PROGRESS: at 1.38% examples, 212642 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:51,267 : INFO : EPOCH 4 - PROGRESS: at 2.14% examples, 220433 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:52,270 : INFO : EPOCH 4 - PROGRESS: at 2.98% examples, 226266 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:53,361 : INFO : EPOCH 4 - PROGRESS: at 3.77% examples, 225999 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:56:54,395 : INFO : EPOCH 4 - PROGRESS: at 4.60% examples, 229126 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:55,494 : INFO : EPOCH 4 - PROGRESS: at 5.42% examples, 229079 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:56:56,503 : INFO : EPOCH 4 - PROGRESS: at 6.24% examples, 231538 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:57,506 : INFO : EPOCH 4 - PROGRESS: at 7.03% examples, 232107 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:58,555 : INFO : EPOCH 4 - PROGRESS: at 7.73% examples, 230799 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:56:59,594 : INFO : EPOCH 4 - PROGRESS: at 8.48% examples, 229946 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:00,617 : INFO : EPOCH 4 - PROGRESS: at 9.22% examples, 231245 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:01,682 : INFO : EPOCH 4 - PROGRESS: at 9.81% examples, 230555 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:02,755 : INFO : EPOCH 4 - PROGRESS: at 10.45% examples, 229416 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:03,764 : INFO : EPOCH 4 - PROGRESS: at 11.13% examples, 231115 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:57:04,839 : INFO : EPOCH 4 - PROGRESS: at 11.74% examples, 230886 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:05,873 : INFO : EPOCH 4 - PROGRESS: at 12.44% examples, 231978 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:06,942 : INFO : EPOCH 4 - PROGRESS: at 13.21% examples, 231848 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:07,942 : INFO : EPOCH 4 - PROGRESS: at 13.96% examples, 233195 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:09,021 : INFO : EPOCH 4 - PROGRESS: at 14.67% examples, 232866 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:10,040 : INFO : EPOCH 4 - PROGRESS: at 15.45% examples, 233921 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:11,137 : INFO : EPOCH 4 - PROGRESS: at 16.13% examples, 233447 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:12,144 : INFO : EPOCH 4 - PROGRESS: at 16.86% examples, 234404 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:13,250 : INFO : EPOCH 4 - PROGRESS: at 17.49% examples, 233886 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:14,265 : INFO : EPOCH 4 - PROGRESS: at 18.15% examples, 233870 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:15,317 : INFO : EPOCH 4 - PROGRESS: at 18.89% examples, 234576 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:16,319 : INFO : EPOCH 4 - PROGRESS: at 19.42% examples, 234348 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:17,337 : INFO : EPOCH 4 - PROGRESS: at 20.13% examples, 235476 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:18,365 : INFO : EPOCH 4 - PROGRESS: at 20.70% examples, 235106 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:19,412 : INFO : EPOCH 4 - PROGRESS: at 21.74% examples, 235865 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:57:20,447 : INFO : EPOCH 4 - PROGRESS: at 22.42% examples, 236337 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:21,460 : INFO : EPOCH 4 - PROGRESS: at 23.04% examples, 236506 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:22,464 : INFO : EPOCH 4 - PROGRESS: at 23.66% examples, 236719 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:23,524 : INFO : EPOCH 4 - PROGRESS: at 24.32% examples, 236934 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:24,555 : INFO : EPOCH 4 - PROGRESS: at 25.14% examples, 236946 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:25,618 : INFO : EPOCH 4 - PROGRESS: at 26.00% examples, 236774 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:26,688 : INFO : EPOCH 4 - PROGRESS: at 26.89% examples, 236397 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:27,722 : INFO : EPOCH 4 - PROGRESS: at 27.87% examples, 236417 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:28,733 : INFO : EPOCH 4 - PROGRESS: at 28.68% examples, 236404 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:29,747 : INFO : EPOCH 4 - PROGRESS: at 29.50% examples, 236166 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:30,800 : INFO : EPOCH 4 - PROGRESS: at 30.26% examples, 235575 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:31,806 : INFO : EPOCH 4 - PROGRESS: at 31.25% examples, 235968 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:32,868 : INFO : EPOCH 4 - PROGRESS: at 32.16% examples, 235968 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:33,895 : INFO : EPOCH 4 - PROGRESS: at 32.96% examples, 235554 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:57:34,910 : INFO : EPOCH 4 - PROGRESS: at 33.82% examples, 236303 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:35,952 : INFO : EPOCH 4 - PROGRESS: at 34.63% examples, 235865 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:36,998 : INFO : EPOCH 4 - PROGRESS: at 35.48% examples, 235982 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:38,077 : INFO : EPOCH 4 - PROGRESS: at 36.40% examples, 235927 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:39,102 : INFO : EPOCH 4 - PROGRESS: at 37.14% examples, 235578 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:40,115 : INFO : EPOCH 4 - PROGRESS: at 37.99% examples, 235546 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:41,163 : INFO : EPOCH 4 - PROGRESS: at 38.89% examples, 235506 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:42,221 : INFO : EPOCH 4 - PROGRESS: at 39.67% examples, 235181 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:43,233 : INFO : EPOCH 4 - PROGRESS: at 40.47% examples, 234897 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:44,246 : INFO : EPOCH 4 - PROGRESS: at 41.36% examples, 234665 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:45,264 : INFO : EPOCH 4 - PROGRESS: at 42.30% examples, 234998 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:46,371 : INFO : EPOCH 4 - PROGRESS: at 43.16% examples, 234742 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:47,386 : INFO : EPOCH 4 - PROGRESS: at 44.03% examples, 234750 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:48,476 : INFO : EPOCH 4 - PROGRESS: at 44.86% examples, 234086 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:49,496 : INFO : EPOCH 4 - PROGRESS: at 45.64% examples, 233708 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:50,504 : INFO : EPOCH 4 - PROGRESS: at 46.48% examples, 233870 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:57:51,558 : INFO : EPOCH 4 - PROGRESS: at 47.27% examples, 233830 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:52,597 : INFO : EPOCH 4 - PROGRESS: at 48.08% examples, 233766 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:53,707 : INFO : EPOCH 4 - PROGRESS: at 49.10% examples, 233874 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:54,737 : INFO : EPOCH 4 - PROGRESS: at 49.86% examples, 233712 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:55,843 : INFO : EPOCH 4 - PROGRESS: at 50.83% examples, 233944 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:56,854 : INFO : EPOCH 4 - PROGRESS: at 51.60% examples, 233832 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:57,865 : INFO : EPOCH 4 - PROGRESS: at 52.33% examples, 233738 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:57:58,881 : INFO : EPOCH 4 - PROGRESS: at 53.01% examples, 233539 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:57:59,897 : INFO : EPOCH 4 - PROGRESS: at 53.85% examples, 233752 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:00,956 : INFO : EPOCH 4 - PROGRESS: at 54.63% examples, 233545 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:01,985 : INFO : EPOCH 4 - PROGRESS: at 55.55% examples, 233508 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:02,999 : INFO : EPOCH 4 - PROGRESS: at 56.39% examples, 233620 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:04,007 : INFO : EPOCH 4 - PROGRESS: at 57.22% examples, 233577 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:05,012 : INFO : EPOCH 4 - PROGRESS: at 57.98% examples, 233522 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:06,027 : INFO : EPOCH 4 - PROGRESS: at 58.81% examples, 233539 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:07,030 : INFO : EPOCH 4 - PROGRESS: at 59.65% examples, 233599 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:08,105 : INFO : EPOCH 4 - PROGRESS: at 60.45% examples, 233457 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:58:09,110 : INFO : EPOCH 4 - PROGRESS: at 61.28% examples, 233509 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:10,114 : INFO : EPOCH 4 - PROGRESS: at 62.05% examples, 233482 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:11,119 : INFO : EPOCH 4 - PROGRESS: at 62.89% examples, 233518 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:12,155 : INFO : EPOCH 4 - PROGRESS: at 63.81% examples, 233387 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:13,164 : INFO : EPOCH 4 - PROGRESS: at 64.82% examples, 233670 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:14,311 : INFO : EPOCH 4 - PROGRESS: at 65.57% examples, 233397 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:15,350 : INFO : EPOCH 4 - PROGRESS: at 66.41% examples, 233574 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:16,413 : INFO : EPOCH 4 - PROGRESS: at 67.23% examples, 233519 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:17,419 : INFO : EPOCH 4 - PROGRESS: at 68.04% examples, 233551 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:18,432 : INFO : EPOCH 4 - PROGRESS: at 68.85% examples, 233561 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:19,442 : INFO : EPOCH 4 - PROGRESS: at 69.56% examples, 233485 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:20,442 : INFO : EPOCH 4 - PROGRESS: at 70.27% examples, 233453 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:21,480 : INFO : EPOCH 4 - PROGRESS: at 71.00% examples, 233337 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:22,482 : INFO : EPOCH 4 - PROGRESS: at 71.71% examples, 233000 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:23,512 : INFO : EPOCH 4 - PROGRESS: at 72.51% examples, 232909 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:24,520 : INFO : EPOCH 4 - PROGRESS: at 73.33% examples, 232780 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:25,535 : INFO : EPOCH 4 - PROGRESS: at 74.15% examples, 232720 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:26,557 : INFO : EPOCH 4 - PROGRESS: at 74.98% examples, 232927 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:27,638 : INFO : EPOCH 4 - PROGRESS: at 75.70% examples, 232733 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:28,653 : INFO : EPOCH 4 - PROGRESS: at 76.40% examples, 232734 words/s, in_qsize 15, out_qsize 4
2020-04-16 17:58:29,691 : INFO : EPOCH 4 - PROGRESS: at 77.25% examples, 232982 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:30,747 : INFO : EPOCH 4 - PROGRESS: at 78.03% examples, 233034 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:31,783 : INFO : EPOCH 4 - PROGRESS: at 78.86% examples, 233136 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:32,861 : INFO : EPOCH 4 - PROGRESS: at 79.72% examples, 233150 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:33,917 : INFO : EPOCH 4 - PROGRESS: at 80.54% examples, 233278 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:34,973 : INFO : EPOCH 4 - PROGRESS: at 81.32% examples, 233258 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:35,985 : INFO : EPOCH 4 - PROGRESS: at 82.13% examples, 233269 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:37,046 : INFO : EPOCH 4 - PROGRESS: at 82.94% examples, 233185 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:58:38,140 : INFO : EPOCH 4 - PROGRESS: at 83.76% examples, 233157 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:39,163 : INFO : EPOCH 4 - PROGRESS: at 84.47% examples, 233073 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:40,215 : INFO : EPOCH 4 - PROGRESS: at 85.25% examples, 233065 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:41,228 : INFO : EPOCH 4 - PROGRESS: at 86.11% examples, 233259 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:42,230 : INFO : EPOCH 4 - PROGRESS: at 87.00% examples, 233305 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:43,242 : INFO : EPOCH 4 - PROGRESS: at 87.89% examples, 233325 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:44,254 : INFO : EPOCH 4 - PROGRESS: at 88.77% examples, 233403 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:45,268 : INFO : EPOCH 4 - PROGRESS: at 89.58% examples, 233421 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:46,355 : INFO : EPOCH 4 - PROGRESS: at 90.47% examples, 233418 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:47,375 : INFO : EPOCH 4 - PROGRESS: at 91.37% examples, 233538 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:48,393 : INFO : EPOCH 4 - PROGRESS: at 92.21% examples, 233544 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:58:49,409 : INFO : EPOCH 4 - PROGRESS: at 92.83% examples, 233189 words/s, in_qsize 17, out_qsize 2
2020-04-16 17:58:50,425 : INFO : EPOCH 4 - PROGRESS: at 93.55% examples, 233024 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:51,437 : INFO : EPOCH 4 - PROGRESS: at 94.33% examples, 232932 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:52,511 : INFO : EPOCH 4 - PROGRESS: at 95.21% examples, 232948 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:53,564 : INFO : EPOCH 4 - PROGRESS: at 96.01% examples, 232898 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:54,577 : INFO : EPOCH 4 - PROGRESS: at 96.86% examples, 233020 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:58:55,669 : INFO : EPOCH 4 - PROGRESS: at 97.72% examples, 232989 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:56,674 : INFO : EPOCH 4 - PROGRESS: at 98.64% examples, 233194 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:58:57,679 : INFO : EPOCH 4 - PROGRESS: at 99.42% examples, 233125 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:58:58,117 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 17:58:58,135 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 17:58:58,164 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 17:58:58,176 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 17:58:58,185 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 17:58:58,190 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 17:58:58,196 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 17:58:58,221 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 17:58:58,226 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 17:58:58,229 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 17:58:58,230 : INFO : EPOCH - 4 : training on 41519355 raw words (30348395 effective words) took 130.0s, 233375 effective words/s
2020-04-16 17:58:59,258 : INFO : EPOCH 5 - PROGRESS: at 0.66% examples, 205740 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:00,323 : INFO : EPOCH 5 - PROGRESS: at 1.38% examples, 211613 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:01,325 : INFO : EPOCH 5 - PROGRESS: at 2.11% examples, 215165 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:02,333 : INFO : EPOCH 5 - PROGRESS: at 2.86% examples, 218447 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:03,340 : INFO : EPOCH 5 - PROGRESS: at 3.68% examples, 223449 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:04,349 : INFO : EPOCH 5 - PROGRESS: at 4.41% examples, 222024 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:59:05,414 : INFO : EPOCH 5 - PROGRESS: at 5.19% examples, 223363 words/s, in_qsize 19, out_qsize 1
2020-04-16 17:59:06,432 : INFO : EPOCH 5 - PROGRESS: at 5.98% examples, 225410 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:07,433 : INFO : EPOCH 5 - PROGRESS: at 6.81% examples, 228222 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:08,444 : INFO : EPOCH 5 - PROGRESS: at 7.54% examples, 228200 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:09,465 : INFO : EPOCH 5 - PROGRESS: at 8.23% examples, 227295 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:10,488 : INFO : EPOCH 5 - PROGRESS: at 8.99% examples, 228848 words/s, in_qsize 20, out_qsize 2
2020-04-16 17:59:11,556 : INFO : EPOCH 5 - PROGRESS: at 9.72% examples, 229305 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:12,596 : INFO : EPOCH 5 - PROGRESS: at 10.35% examples, 230782 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:13,601 : INFO : EPOCH 5 - PROGRESS: at 11.02% examples, 231576 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:14,608 : INFO : EPOCH 5 - PROGRESS: at 11.65% examples, 232322 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:15,618 : INFO : EPOCH 5 - PROGRESS: at 12.25% examples, 232387 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:16,642 : INFO : EPOCH 5 - PROGRESS: at 12.96% examples, 232384 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:17,654 : INFO : EPOCH 5 - PROGRESS: at 13.69% examples, 232138 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:18,660 : INFO : EPOCH 5 - PROGRESS: at 14.34% examples, 232298 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:19,719 : INFO : EPOCH 5 - PROGRESS: at 15.07% examples, 232613 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:20,755 : INFO : EPOCH 5 - PROGRESS: at 15.79% examples, 232221 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:21,835 : INFO : EPOCH 5 - PROGRESS: at 16.53% examples, 233192 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:22,841 : INFO : EPOCH 5 - PROGRESS: at 17.18% examples, 233625 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:23,957 : INFO : EPOCH 5 - PROGRESS: at 17.92% examples, 234128 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:24,961 : INFO : EPOCH 5 - PROGRESS: at 18.69% examples, 235556 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:25,990 : INFO : EPOCH 5 - PROGRESS: at 19.26% examples, 235033 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:27,146 : INFO : EPOCH 5 - PROGRESS: at 20.00% examples, 235540 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:28,162 : INFO : EPOCH 5 - PROGRESS: at 20.60% examples, 235956 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:29,165 : INFO : EPOCH 5 - PROGRESS: at 21.59% examples, 236583 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:30,207 : INFO : EPOCH 5 - PROGRESS: at 22.24% examples, 236513 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:31,208 : INFO : EPOCH 5 - PROGRESS: at 22.92% examples, 236986 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:32,211 : INFO : EPOCH 5 - PROGRESS: at 23.51% examples, 237197 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:33,226 : INFO : EPOCH 5 - PROGRESS: at 24.09% examples, 236888 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:34,230 : INFO : EPOCH 5 - PROGRESS: at 24.72% examples, 236678 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:35,254 : INFO : EPOCH 5 - PROGRESS: at 25.59% examples, 236341 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:36,263 : INFO : EPOCH 5 - PROGRESS: at 26.54% examples, 236562 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:37,314 : INFO : EPOCH 5 - PROGRESS: at 27.39% examples, 236287 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:59:38,323 : INFO : EPOCH 5 - PROGRESS: at 28.28% examples, 236298 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:39,343 : INFO : EPOCH 5 - PROGRESS: at 29.19% examples, 236561 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:40,409 : INFO : EPOCH 5 - PROGRESS: at 30.01% examples, 236370 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:41,426 : INFO : EPOCH 5 - PROGRESS: at 30.95% examples, 236681 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:42,454 : INFO : EPOCH 5 - PROGRESS: at 31.88% examples, 236394 words/s, in_qsize 20, out_qsize 1
2020-04-16 17:59:43,526 : INFO : EPOCH 5 - PROGRESS: at 32.66% examples, 236033 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:44,529 : INFO : EPOCH 5 - PROGRESS: at 33.48% examples, 236063 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:45,536 : INFO : EPOCH 5 - PROGRESS: at 34.33% examples, 236407 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:46,567 : INFO : EPOCH 5 - PROGRESS: at 35.08% examples, 236155 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:47,579 : INFO : EPOCH 5 - PROGRESS: at 35.89% examples, 235858 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:48,595 : INFO : EPOCH 5 - PROGRESS: at 36.72% examples, 235672 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:49,601 : INFO : EPOCH 5 - PROGRESS: at 37.55% examples, 235815 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:50,627 : INFO : EPOCH 5 - PROGRESS: at 38.44% examples, 235719 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:51,680 : INFO : EPOCH 5 - PROGRESS: at 39.16% examples, 234860 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:52,692 : INFO : EPOCH 5 - PROGRESS: at 39.82% examples, 234202 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:53,785 : INFO : EPOCH 5 - PROGRESS: at 40.73% examples, 234131 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:54,797 : INFO : EPOCH 5 - PROGRESS: at 41.73% examples, 234289 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:55,806 : INFO : EPOCH 5 - PROGRESS: at 42.55% examples, 234425 words/s, in_qsize 18, out_qsize 1
2020-04-16 17:59:56,863 : INFO : EPOCH 5 - PROGRESS: at 43.44% examples, 234377 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:57,883 : INFO : EPOCH 5 - PROGRESS: at 44.35% examples, 234371 words/s, in_qsize 19, out_qsize 0
2020-04-16 17:59:58,922 : INFO : EPOCH 5 - PROGRESS: at 45.30% examples, 234632 words/s, in_qsize 20, out_qsize 0
2020-04-16 17:59:59,946 : INFO : EPOCH 5 - PROGRESS: at 46.16% examples, 234594 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:00,955 : INFO : EPOCH 5 - PROGRESS: at 46.89% examples, 234473 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:01,971 : INFO : EPOCH 5 - PROGRESS: at 47.67% examples, 234254 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:03,020 : INFO : EPOCH 5 - PROGRESS: at 48.54% examples, 234354 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:04,023 : INFO : EPOCH 5 - PROGRESS: at 49.36% examples, 234171 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:05,033 : INFO : EPOCH 5 - PROGRESS: at 50.14% examples, 233973 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:06,037 : INFO : EPOCH 5 - PROGRESS: at 50.90% examples, 233807 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:07,044 : INFO : EPOCH 5 - PROGRESS: at 51.64% examples, 233606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:08,047 : INFO : EPOCH 5 - PROGRESS: at 52.36% examples, 233440 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:09,088 : INFO : EPOCH 5 - PROGRESS: at 53.05% examples, 233257 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:10,099 : INFO : EPOCH 5 - PROGRESS: at 53.85% examples, 233287 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:11,124 : INFO : EPOCH 5 - PROGRESS: at 54.67% examples, 233402 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:12,148 : INFO : EPOCH 5 - PROGRESS: at 55.60% examples, 233387 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:13,176 : INFO : EPOCH 5 - PROGRESS: at 56.42% examples, 233361 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:00:14,178 : INFO : EPOCH 5 - PROGRESS: at 57.31% examples, 233625 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:15,196 : INFO : EPOCH 5 - PROGRESS: at 58.10% examples, 233624 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:16,239 : INFO : EPOCH 5 - PROGRESS: at 58.91% examples, 233461 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:17,257 : INFO : EPOCH 5 - PROGRESS: at 59.72% examples, 233389 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:00:18,300 : INFO : EPOCH 5 - PROGRESS: at 60.56% examples, 233440 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:19,349 : INFO : EPOCH 5 - PROGRESS: at 61.35% examples, 233281 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:20,350 : INFO : EPOCH 5 - PROGRESS: at 62.08% examples, 233084 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:00:21,376 : INFO : EPOCH 5 - PROGRESS: at 62.95% examples, 233157 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:22,462 : INFO : EPOCH 5 - PROGRESS: at 63.99% examples, 233237 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:23,477 : INFO : EPOCH 5 - PROGRESS: at 64.92% examples, 233322 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:24,479 : INFO : EPOCH 5 - PROGRESS: at 65.65% examples, 233448 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:00:25,493 : INFO : EPOCH 5 - PROGRESS: at 66.45% examples, 233528 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:26,510 : INFO : EPOCH 5 - PROGRESS: at 67.30% examples, 233675 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:27,544 : INFO : EPOCH 5 - PROGRESS: at 68.13% examples, 233637 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:28,574 : INFO : EPOCH 5 - PROGRESS: at 69.00% examples, 233840 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:29,630 : INFO : EPOCH 5 - PROGRESS: at 69.77% examples, 233816 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:30,692 : INFO : EPOCH 5 - PROGRESS: at 70.58% examples, 233933 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:00:31,717 : INFO : EPOCH 5 - PROGRESS: at 71.38% examples, 234002 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:32,738 : INFO : EPOCH 5 - PROGRESS: at 72.16% examples, 233919 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:33,764 : INFO : EPOCH 5 - PROGRESS: at 73.05% examples, 233964 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:34,795 : INFO : EPOCH 5 - PROGRESS: at 73.90% examples, 233857 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:35,832 : INFO : EPOCH 5 - PROGRESS: at 74.64% examples, 233729 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:36,834 : INFO : EPOCH 5 - PROGRESS: at 75.38% examples, 233697 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:37,837 : INFO : EPOCH 5 - PROGRESS: at 76.09% examples, 233722 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:38,844 : INFO : EPOCH 5 - PROGRESS: at 76.83% examples, 233674 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:39,874 : INFO : EPOCH 5 - PROGRESS: at 77.59% examples, 233774 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:40,876 : INFO : EPOCH 5 - PROGRESS: at 78.37% examples, 233886 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:41,894 : INFO : EPOCH 5 - PROGRESS: at 79.16% examples, 233873 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:42,908 : INFO : EPOCH 5 - PROGRESS: at 79.98% examples, 234025 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:44,003 : INFO : EPOCH 5 - PROGRESS: at 80.73% examples, 233846 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:00:45,017 : INFO : EPOCH 5 - PROGRESS: at 81.43% examples, 233650 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:00:46,022 : INFO : EPOCH 5 - PROGRESS: at 82.19% examples, 233474 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:47,091 : INFO : EPOCH 5 - PROGRESS: at 82.93% examples, 233171 words/s, in_qsize 14, out_qsize 5
2020-04-16 18:00:48,178 : INFO : EPOCH 5 - PROGRESS: at 83.83% examples, 233414 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:49,230 : INFO : EPOCH 5 - PROGRESS: at 84.53% examples, 233268 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:50,251 : INFO : EPOCH 5 - PROGRESS: at 85.39% examples, 233576 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:51,263 : INFO : EPOCH 5 - PROGRESS: at 86.17% examples, 233459 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:52,263 : INFO : EPOCH 5 - PROGRESS: at 87.06% examples, 233506 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:53,265 : INFO : EPOCH 5 - PROGRESS: at 87.80% examples, 233235 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:54,271 : INFO : EPOCH 5 - PROGRESS: at 88.54% examples, 233011 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:55,306 : INFO : EPOCH 5 - PROGRESS: at 89.38% examples, 232993 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:00:56,315 : INFO : EPOCH 5 - PROGRESS: at 90.23% examples, 233021 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:00:57,348 : INFO : EPOCH 5 - PROGRESS: at 91.11% examples, 233126 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:58,356 : INFO : EPOCH 5 - PROGRESS: at 91.94% examples, 233157 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:00:59,368 : INFO : EPOCH 5 - PROGRESS: at 92.72% examples, 233108 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:01:00,414 : INFO : EPOCH 5 - PROGRESS: at 93.55% examples, 233177 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:01:01,415 : INFO : EPOCH 5 - PROGRESS: at 94.26% examples, 232928 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:01:02,483 : INFO : EPOCH 5 - PROGRESS: at 94.97% examples, 232611 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:01:03,545 : INFO : EPOCH 5 - PROGRESS: at 95.73% examples, 232373 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:01:04,550 : INFO : EPOCH 5 - PROGRESS: at 96.46% examples, 232239 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:01:05,557 : INFO : EPOCH 5 - PROGRESS: at 97.32% examples, 232316 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:01:06,601 : INFO : EPOCH 5 - PROGRESS: at 98.13% examples, 232328 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:01:07,619 : INFO : EPOCH 5 - PROGRESS: at 99.00% examples, 232401 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:01:08,580 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:01:08,603 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:01:08,611 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:01:08,619 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:01:08,631 : INFO : EPOCH 5 - PROGRESS: at 99.89% examples, 232529 words/s, in_qsize 5, out_qsize 1
2020-04-16 18:01:08,632 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:01:08,642 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:01:08,693 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:01:08,706 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:01:08,708 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:01:08,719 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:01:08,719 : INFO : EPOCH - 5 : training on 41519355 raw words (30353305 effective words) took 130.5s, 232622 effective words/s
2020-04-16 18:01:08,720 : INFO : training on a 207596775 raw words (151749023 effective words) took 685.0s, 221546 effective words/s
2020-04-16 18:02:47,990 : INFO : Number of new ngrams is 0
2020-04-16 18:02:48,252 : WARNING : Effective 'alpha' higher than previous training cycles
2020-04-16 18:02:48,252 : INFO : training model with 10 workers on 70538 vocabulary and 150 features, using sg=0 hs=0 sample=0.001 negative=5 window=10
2020-04-16 18:02:49,293 : INFO : EPOCH 1 - PROGRESS: at 0.84% examples, 272284 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:02:50,336 : INFO : EPOCH 1 - PROGRESS: at 1.86% examples, 281506 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:02:51,368 : INFO : EPOCH 1 - PROGRESS: at 2.87% examples, 287552 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:02:52,438 : INFO : EPOCH 1 - PROGRESS: at 3.96% examples, 293430 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:02:53,453 : INFO : EPOCH 1 - PROGRESS: at 5.01% examples, 297316 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:02:54,498 : INFO : EPOCH 1 - PROGRESS: at 5.94% examples, 294664 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:02:55,535 : INFO : EPOCH 1 - PROGRESS: at 6.91% examples, 292242 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:02:56,635 : INFO : EPOCH 1 - PROGRESS: at 7.79% examples, 288188 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:02:57,641 : INFO : EPOCH 1 - PROGRESS: at 8.80% examples, 290245 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:02:58,651 : INFO : EPOCH 1 - PROGRESS: at 9.63% examples, 291002 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:02:59,664 : INFO : EPOCH 1 - PROGRESS: at 10.38% examples, 291018 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:00,677 : INFO : EPOCH 1 - PROGRESS: at 11.11% examples, 289238 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:01,701 : INFO : EPOCH 1 - PROGRESS: at 11.86% examples, 288625 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:02,708 : INFO : EPOCH 1 - PROGRESS: at 12.59% examples, 287897 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:03,723 : INFO : EPOCH 1 - PROGRESS: at 13.52% examples, 287196 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:04,760 : INFO : EPOCH 1 - PROGRESS: at 14.30% examples, 286562 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:05,800 : INFO : EPOCH 1 - PROGRESS: at 15.12% examples, 286002 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:06,848 : INFO : EPOCH 1 - PROGRESS: at 15.98% examples, 285463 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:07,860 : INFO : EPOCH 1 - PROGRESS: at 16.78% examples, 285387 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:08,881 : INFO : EPOCH 1 - PROGRESS: at 17.49% examples, 284235 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:09,885 : INFO : EPOCH 1 - PROGRESS: at 18.28% examples, 284297 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:10,887 : INFO : EPOCH 1 - PROGRESS: at 19.04% examples, 284378 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:11,895 : INFO : EPOCH 1 - PROGRESS: at 19.79% examples, 284651 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:12,906 : INFO : EPOCH 1 - PROGRESS: at 20.52% examples, 284592 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:13,909 : INFO : EPOCH 1 - PROGRESS: at 21.54% examples, 284288 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:14,915 : INFO : EPOCH 1 - PROGRESS: at 22.28% examples, 284077 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:15,924 : INFO : EPOCH 1 - PROGRESS: at 22.98% examples, 283349 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:03:16,934 : INFO : EPOCH 1 - PROGRESS: at 23.69% examples, 283430 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:17,935 : INFO : EPOCH 1 - PROGRESS: at 24.38% examples, 282825 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:18,953 : INFO : EPOCH 1 - PROGRESS: at 25.29% examples, 282133 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:20,009 : INFO : EPOCH 1 - PROGRESS: at 26.30% examples, 281417 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:21,080 : INFO : EPOCH 1 - PROGRESS: at 27.37% examples, 281026 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:22,083 : INFO : EPOCH 1 - PROGRESS: at 28.39% examples, 280811 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:23,121 : INFO : EPOCH 1 - PROGRESS: at 29.28% examples, 279665 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:24,233 : INFO : EPOCH 1 - PROGRESS: at 30.26% examples, 279028 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:03:25,304 : INFO : EPOCH 1 - PROGRESS: at 31.39% examples, 278786 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:26,403 : INFO : EPOCH 1 - PROGRESS: at 32.43% examples, 278287 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:27,491 : INFO : EPOCH 1 - PROGRESS: at 33.42% examples, 277921 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:28,612 : INFO : EPOCH 1 - PROGRESS: at 34.39% examples, 277383 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:29,644 : INFO : EPOCH 1 - PROGRESS: at 35.32% examples, 277274 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:30,705 : INFO : EPOCH 1 - PROGRESS: at 36.31% examples, 276628 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:03:31,737 : INFO : EPOCH 1 - PROGRESS: at 37.14% examples, 275865 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:03:32,760 : INFO : EPOCH 1 - PROGRESS: at 38.14% examples, 275656 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:33,770 : INFO : EPOCH 1 - PROGRESS: at 39.13% examples, 275565 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:34,806 : INFO : EPOCH 1 - PROGRESS: at 39.94% examples, 274538 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:35,822 : INFO : EPOCH 1 - PROGRESS: at 40.84% examples, 273983 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:03:36,882 : INFO : EPOCH 1 - PROGRESS: at 41.92% examples, 273493 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:03:37,886 : INFO : EPOCH 1 - PROGRESS: at 42.82% examples, 273461 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:38,969 : INFO : EPOCH 1 - PROGRESS: at 43.77% examples, 272612 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:03:39,973 : INFO : EPOCH 1 - PROGRESS: at 44.79% examples, 272464 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:40,993 : INFO : EPOCH 1 - PROGRESS: at 45.69% examples, 271974 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:03:42,031 : INFO : EPOCH 1 - PROGRESS: at 46.56% examples, 271554 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:03:43,094 : INFO : EPOCH 1 - PROGRESS: at 47.51% examples, 271412 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:44,147 : INFO : EPOCH 1 - PROGRESS: at 48.49% examples, 271329 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:45,201 : INFO : EPOCH 1 - PROGRESS: at 49.39% examples, 270604 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:46,257 : INFO : EPOCH 1 - PROGRESS: at 50.29% examples, 270263 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:47,287 : INFO : EPOCH 1 - PROGRESS: at 51.09% examples, 269570 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:03:48,337 : INFO : EPOCH 1 - PROGRESS: at 51.99% examples, 269270 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:49,346 : INFO : EPOCH 1 - PROGRESS: at 52.75% examples, 268717 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:03:50,380 : INFO : EPOCH 1 - PROGRESS: at 53.56% examples, 268528 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:51,410 : INFO : EPOCH 1 - PROGRESS: at 54.45% examples, 268170 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:52,440 : INFO : EPOCH 1 - PROGRESS: at 55.42% examples, 267919 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:53,451 : INFO : EPOCH 1 - PROGRESS: at 56.30% examples, 267641 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:54,534 : INFO : EPOCH 1 - PROGRESS: at 57.19% examples, 267096 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:03:55,543 : INFO : EPOCH 1 - PROGRESS: at 58.10% examples, 267160 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:03:56,667 : INFO : EPOCH 1 - PROGRESS: at 58.91% examples, 266149 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:57,698 : INFO : EPOCH 1 - PROGRESS: at 59.68% examples, 265328 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:03:58,739 : INFO : EPOCH 1 - PROGRESS: at 60.45% examples, 264707 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:03:59,745 : INFO : EPOCH 1 - PROGRESS: at 61.34% examples, 264524 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:04:00,832 : INFO : EPOCH 1 - PROGRESS: at 62.18% examples, 264056 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:01,849 : INFO : EPOCH 1 - PROGRESS: at 63.11% examples, 263937 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:02,885 : INFO : EPOCH 1 - PROGRESS: at 64.11% examples, 263554 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:03,887 : INFO : EPOCH 1 - PROGRESS: at 65.05% examples, 263478 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:04,903 : INFO : EPOCH 1 - PROGRESS: at 65.77% examples, 263177 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:05,949 : INFO : EPOCH 1 - PROGRESS: at 66.63% examples, 262949 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:07,005 : INFO : EPOCH 1 - PROGRESS: at 67.50% examples, 262601 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:08,051 : INFO : EPOCH 1 - PROGRESS: at 68.37% examples, 262330 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:09,079 : INFO : EPOCH 1 - PROGRESS: at 69.19% examples, 262106 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:10,101 : INFO : EPOCH 1 - PROGRESS: at 69.95% examples, 261822 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:11,126 : INFO : EPOCH 1 - PROGRESS: at 70.74% examples, 261545 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:12,145 : INFO : EPOCH 1 - PROGRESS: at 71.59% examples, 261378 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:13,164 : INFO : EPOCH 1 - PROGRESS: at 72.37% examples, 261049 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:04:14,185 : INFO : EPOCH 1 - PROGRESS: at 73.33% examples, 260953 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:15,208 : INFO : EPOCH 1 - PROGRESS: at 74.17% examples, 260615 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:04:16,244 : INFO : EPOCH 1 - PROGRESS: at 75.00% examples, 260481 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:17,259 : INFO : EPOCH 1 - PROGRESS: at 75.74% examples, 260199 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:18,310 : INFO : EPOCH 1 - PROGRESS: at 76.53% examples, 260025 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:19,344 : INFO : EPOCH 1 - PROGRESS: at 77.31% examples, 259762 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:20,361 : INFO : EPOCH 1 - PROGRESS: at 78.12% examples, 259702 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:21,380 : INFO : EPOCH 1 - PROGRESS: at 78.90% examples, 259479 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:22,403 : INFO : EPOCH 1 - PROGRESS: at 79.74% examples, 259270 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:04:23,444 : INFO : EPOCH 1 - PROGRESS: at 80.51% examples, 259007 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:24,488 : INFO : EPOCH 1 - PROGRESS: at 81.35% examples, 258886 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:25,511 : INFO : EPOCH 1 - PROGRESS: at 82.16% examples, 258607 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:26,527 : INFO : EPOCH 1 - PROGRESS: at 83.02% examples, 258504 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:27,627 : INFO : EPOCH 1 - PROGRESS: at 83.83% examples, 258173 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:28,666 : INFO : EPOCH 1 - PROGRESS: at 84.57% examples, 257926 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:29,684 : INFO : EPOCH 1 - PROGRESS: at 85.35% examples, 257742 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:30,751 : INFO : EPOCH 1 - PROGRESS: at 86.19% examples, 257443 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:31,771 : INFO : EPOCH 1 - PROGRESS: at 87.06% examples, 257141 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:32,817 : INFO : EPOCH 1 - PROGRESS: at 87.91% examples, 256780 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:33,830 : INFO : EPOCH 1 - PROGRESS: at 88.76% examples, 256571 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:34,832 : INFO : EPOCH 1 - PROGRESS: at 89.53% examples, 256259 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:35,872 : INFO : EPOCH 1 - PROGRESS: at 90.39% examples, 256069 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:36,880 : INFO : EPOCH 1 - PROGRESS: at 91.20% examples, 255820 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:37,881 : INFO : EPOCH 1 - PROGRESS: at 91.98% examples, 255526 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:04:38,919 : INFO : EPOCH 1 - PROGRESS: at 92.87% examples, 255536 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:39,932 : INFO : EPOCH 1 - PROGRESS: at 93.63% examples, 255220 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:04:40,945 : INFO : EPOCH 1 - PROGRESS: at 94.48% examples, 255111 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:41,949 : INFO : EPOCH 1 - PROGRESS: at 95.26% examples, 254825 words/s, in_qsize 20, out_qsize 4
2020-04-16 18:04:42,967 : INFO : EPOCH 1 - PROGRESS: at 96.09% examples, 254765 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:43,977 : INFO : EPOCH 1 - PROGRESS: at 96.86% examples, 254468 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:45,019 : INFO : EPOCH 1 - PROGRESS: at 97.66% examples, 254219 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:46,045 : INFO : EPOCH 1 - PROGRESS: at 98.53% examples, 254096 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:47,060 : INFO : EPOCH 1 - PROGRESS: at 99.37% examples, 253940 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:04:47,580 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:04:47,583 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:04:47,606 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:04:47,648 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:04:47,649 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:04:47,683 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:04:47,706 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:04:47,745 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:04:47,746 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:04:47,752 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:04:47,753 : INFO : EPOCH - 1 : training on 41519355 raw words (30344443 effective words) took 119.5s, 253937 effective words/s
2020-04-16 18:04:48,827 : INFO : EPOCH 2 - PROGRESS: at 0.68% examples, 204031 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:49,838 : INFO : EPOCH 2 - PROGRESS: at 1.36% examples, 209216 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:50,845 : INFO : EPOCH 2 - PROGRESS: at 2.15% examples, 220208 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:51,905 : INFO : EPOCH 2 - PROGRESS: at 3.00% examples, 224733 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:52,916 : INFO : EPOCH 2 - PROGRESS: at 3.80% examples, 228188 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:53,958 : INFO : EPOCH 2 - PROGRESS: at 4.55% examples, 227199 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:55,019 : INFO : EPOCH 2 - PROGRESS: at 5.33% examples, 226779 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:56,031 : INFO : EPOCH 2 - PROGRESS: at 6.10% examples, 227615 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:04:57,093 : INFO : EPOCH 2 - PROGRESS: at 6.86% examples, 226389 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:58,114 : INFO : EPOCH 2 - PROGRESS: at 7.58% examples, 226330 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:04:59,208 : INFO : EPOCH 2 - PROGRESS: at 8.20% examples, 222267 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:00,292 : INFO : EPOCH 2 - PROGRESS: at 8.88% examples, 220260 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:01,295 : INFO : EPOCH 2 - PROGRESS: at 9.52% examples, 220379 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:05:02,357 : INFO : EPOCH 2 - PROGRESS: at 10.18% examples, 223024 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:03,386 : INFO : EPOCH 2 - PROGRESS: at 10.84% examples, 223094 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:04,410 : INFO : EPOCH 2 - PROGRESS: at 11.51% examples, 224466 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:05,427 : INFO : EPOCH 2 - PROGRESS: at 12.10% examples, 224932 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:06,483 : INFO : EPOCH 2 - PROGRESS: at 12.70% examples, 224558 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:07,510 : INFO : EPOCH 2 - PROGRESS: at 13.51% examples, 224922 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:05:08,548 : INFO : EPOCH 2 - PROGRESS: at 14.18% examples, 225456 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:09,588 : INFO : EPOCH 2 - PROGRESS: at 14.84% examples, 225280 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:05:10,605 : INFO : EPOCH 2 - PROGRESS: at 15.56% examples, 225384 words/s, in_qsize 17, out_qsize 1
2020-04-16 18:05:11,620 : INFO : EPOCH 2 - PROGRESS: at 16.26% examples, 226378 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:12,676 : INFO : EPOCH 2 - PROGRESS: at 16.90% examples, 226021 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:13,688 : INFO : EPOCH 2 - PROGRESS: at 17.54% examples, 226683 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:14,729 : INFO : EPOCH 2 - PROGRESS: at 18.23% examples, 227247 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:15,761 : INFO : EPOCH 2 - PROGRESS: at 18.91% examples, 227828 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:16,811 : INFO : EPOCH 2 - PROGRESS: at 19.55% examples, 228460 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:17,825 : INFO : EPOCH 2 - PROGRESS: at 20.16% examples, 228818 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:18,858 : INFO : EPOCH 2 - PROGRESS: at 20.82% examples, 229568 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:19,871 : INFO : EPOCH 2 - PROGRESS: at 21.77% examples, 229848 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:20,879 : INFO : EPOCH 2 - PROGRESS: at 22.45% examples, 230461 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:05:21,943 : INFO : EPOCH 2 - PROGRESS: at 23.05% examples, 230440 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:22,991 : INFO : EPOCH 2 - PROGRESS: at 23.66% examples, 230341 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:23,998 : INFO : EPOCH 2 - PROGRESS: at 24.31% examples, 230869 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:25,009 : INFO : EPOCH 2 - PROGRESS: at 25.01% examples, 230610 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:26,016 : INFO : EPOCH 2 - PROGRESS: at 25.85% examples, 230576 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:27,054 : INFO : EPOCH 2 - PROGRESS: at 26.72% examples, 230371 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:28,073 : INFO : EPOCH 2 - PROGRESS: at 27.66% examples, 230644 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:29,160 : INFO : EPOCH 2 - PROGRESS: at 28.49% examples, 230179 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:30,173 : INFO : EPOCH 2 - PROGRESS: at 29.43% examples, 230942 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:31,226 : INFO : EPOCH 2 - PROGRESS: at 30.21% examples, 230663 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:32,233 : INFO : EPOCH 2 - PROGRESS: at 31.17% examples, 230994 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:33,296 : INFO : EPOCH 2 - PROGRESS: at 32.07% examples, 231121 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:34,338 : INFO : EPOCH 2 - PROGRESS: at 32.94% examples, 231057 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:35,414 : INFO : EPOCH 2 - PROGRESS: at 33.70% examples, 230842 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:36,441 : INFO : EPOCH 2 - PROGRESS: at 34.55% examples, 231040 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:37,530 : INFO : EPOCH 2 - PROGRESS: at 35.29% examples, 230478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:38,551 : INFO : EPOCH 2 - PROGRESS: at 36.17% examples, 230537 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:05:39,551 : INFO : EPOCH 2 - PROGRESS: at 36.91% examples, 230253 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:40,636 : INFO : EPOCH 2 - PROGRESS: at 37.80% examples, 230436 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:41,748 : INFO : EPOCH 2 - PROGRESS: at 38.73% examples, 230215 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:05:42,800 : INFO : EPOCH 2 - PROGRESS: at 39.60% examples, 230543 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:43,842 : INFO : EPOCH 2 - PROGRESS: at 40.45% examples, 230489 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:44,844 : INFO : EPOCH 2 - PROGRESS: at 41.40% examples, 230757 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:45,867 : INFO : EPOCH 2 - PROGRESS: at 42.28% examples, 230764 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:46,904 : INFO : EPOCH 2 - PROGRESS: at 43.11% examples, 230741 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:47,952 : INFO : EPOCH 2 - PROGRESS: at 44.03% examples, 230931 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:49,000 : INFO : EPOCH 2 - PROGRESS: at 44.96% examples, 230977 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:50,008 : INFO : EPOCH 2 - PROGRESS: at 45.81% examples, 231056 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:51,063 : INFO : EPOCH 2 - PROGRESS: at 46.60% examples, 230851 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:52,068 : INFO : EPOCH 2 - PROGRESS: at 47.32% examples, 230705 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:53,125 : INFO : EPOCH 2 - PROGRESS: at 48.15% examples, 230620 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:05:54,209 : INFO : EPOCH 2 - PROGRESS: at 49.04% examples, 230438 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:55,262 : INFO : EPOCH 2 - PROGRESS: at 49.83% examples, 230358 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:05:56,345 : INFO : EPOCH 2 - PROGRESS: at 50.77% examples, 230610 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:05:57,349 : INFO : EPOCH 2 - PROGRESS: at 51.56% examples, 230574 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:05:58,377 : INFO : EPOCH 2 - PROGRESS: at 52.33% examples, 230671 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:05:59,434 : INFO : EPOCH 2 - PROGRESS: at 53.05% examples, 230578 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:00,464 : INFO : EPOCH 2 - PROGRESS: at 53.75% examples, 230188 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:01,481 : INFO : EPOCH 2 - PROGRESS: at 54.49% examples, 229968 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:02,526 : INFO : EPOCH 2 - PROGRESS: at 55.37% examples, 229847 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:03,536 : INFO : EPOCH 2 - PROGRESS: at 56.21% examples, 229934 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:04,548 : INFO : EPOCH 2 - PROGRESS: at 57.00% examples, 229924 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:05,565 : INFO : EPOCH 2 - PROGRESS: at 57.79% examples, 229879 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:06,581 : INFO : EPOCH 2 - PROGRESS: at 58.57% examples, 229845 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:07,607 : INFO : EPOCH 2 - PROGRESS: at 59.35% examples, 229700 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:08,624 : INFO : EPOCH 2 - PROGRESS: at 60.19% examples, 229868 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:09,708 : INFO : EPOCH 2 - PROGRESS: at 61.05% examples, 229755 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:10,740 : INFO : EPOCH 2 - PROGRESS: at 61.77% examples, 229514 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:06:11,787 : INFO : EPOCH 2 - PROGRESS: at 62.60% examples, 229485 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:12,811 : INFO : EPOCH 2 - PROGRESS: at 63.52% examples, 229622 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:13,881 : INFO : EPOCH 2 - PROGRESS: at 64.37% examples, 229190 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:06:14,882 : INFO : EPOCH 2 - PROGRESS: at 65.05% examples, 228783 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:15,887 : INFO : EPOCH 2 - PROGRESS: at 65.66% examples, 228541 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:16,956 : INFO : EPOCH 2 - PROGRESS: at 66.37% examples, 228206 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:06:17,983 : INFO : EPOCH 2 - PROGRESS: at 67.23% examples, 228393 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:19,025 : INFO : EPOCH 2 - PROGRESS: at 68.02% examples, 228311 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:20,094 : INFO : EPOCH 2 - PROGRESS: at 68.77% examples, 228088 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:21,122 : INFO : EPOCH 2 - PROGRESS: at 69.45% examples, 227872 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:22,171 : INFO : EPOCH 2 - PROGRESS: at 70.12% examples, 227705 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:23,174 : INFO : EPOCH 2 - PROGRESS: at 70.90% examples, 227813 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:24,192 : INFO : EPOCH 2 - PROGRESS: at 71.63% examples, 227580 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:06:25,206 : INFO : EPOCH 2 - PROGRESS: at 72.30% examples, 227290 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:06:26,217 : INFO : EPOCH 2 - PROGRESS: at 73.13% examples, 227290 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:27,229 : INFO : EPOCH 2 - PROGRESS: at 73.93% examples, 227077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:28,437 : INFO : EPOCH 2 - PROGRESS: at 74.82% examples, 227063 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:29,456 : INFO : EPOCH 2 - PROGRESS: at 75.54% examples, 227142 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:30,461 : INFO : EPOCH 2 - PROGRESS: at 76.20% examples, 227014 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:31,466 : INFO : EPOCH 2 - PROGRESS: at 76.87% examples, 226829 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:32,508 : INFO : EPOCH 2 - PROGRESS: at 77.59% examples, 226829 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:33,555 : INFO : EPOCH 2 - PROGRESS: at 78.35% examples, 226837 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:34,573 : INFO : EPOCH 2 - PROGRESS: at 79.16% examples, 226959 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:35,600 : INFO : EPOCH 2 - PROGRESS: at 79.98% examples, 227142 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:36,613 : INFO : EPOCH 2 - PROGRESS: at 80.68% examples, 227074 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:37,636 : INFO : EPOCH 2 - PROGRESS: at 81.49% examples, 227190 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:06:38,645 : INFO : EPOCH 2 - PROGRESS: at 82.33% examples, 227330 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:39,687 : INFO : EPOCH 2 - PROGRESS: at 83.13% examples, 227276 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:40,778 : INFO : EPOCH 2 - PROGRESS: at 83.96% examples, 227379 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:41,848 : INFO : EPOCH 2 - PROGRESS: at 84.76% examples, 227566 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:42,870 : INFO : EPOCH 2 - PROGRESS: at 85.54% examples, 227667 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:43,874 : INFO : EPOCH 2 - PROGRESS: at 86.41% examples, 227806 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:44,912 : INFO : EPOCH 2 - PROGRESS: at 87.28% examples, 227821 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:45,923 : INFO : EPOCH 2 - PROGRESS: at 88.09% examples, 227760 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:46,941 : INFO : EPOCH 2 - PROGRESS: at 88.94% examples, 227762 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:47,995 : INFO : EPOCH 2 - PROGRESS: at 89.76% examples, 227805 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:49,006 : INFO : EPOCH 2 - PROGRESS: at 90.63% examples, 227877 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:50,036 : INFO : EPOCH 2 - PROGRESS: at 91.45% examples, 227903 words/s, in_qsize 16, out_qsize 3
2020-04-16 18:06:51,085 : INFO : EPOCH 2 - PROGRESS: at 92.39% examples, 228070 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:06:52,097 : INFO : EPOCH 2 - PROGRESS: at 93.11% examples, 228121 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:53,110 : INFO : EPOCH 2 - PROGRESS: at 93.96% examples, 228179 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:06:54,167 : INFO : EPOCH 2 - PROGRESS: at 94.79% examples, 228221 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:55,175 : INFO : EPOCH 2 - PROGRESS: at 95.68% examples, 228404 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:56,189 : INFO : EPOCH 2 - PROGRESS: at 96.47% examples, 228398 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:57,219 : INFO : EPOCH 2 - PROGRESS: at 97.24% examples, 228298 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:06:58,238 : INFO : EPOCH 2 - PROGRESS: at 98.03% examples, 228333 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:06:59,243 : INFO : EPOCH 2 - PROGRESS: at 98.89% examples, 228403 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:00,251 : INFO : EPOCH 2 - PROGRESS: at 99.68% examples, 228405 words/s, in_qsize 12, out_qsize 1
2020-04-16 18:07:00,359 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:07:00,365 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:07:00,398 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:07:00,426 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:07:00,433 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:07:00,437 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:07:00,479 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:07:00,481 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:07:00,484 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:07:00,487 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:07:00,488 : INFO : EPOCH - 2 : training on 41519355 raw words (30352224 effective words) took 132.7s, 228679 effective words/s
2020-04-16 18:07:01,516 : INFO : EPOCH 3 - PROGRESS: at 0.65% examples, 205635 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:02,526 : INFO : EPOCH 3 - PROGRESS: at 1.21% examples, 192356 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:07:03,542 : INFO : EPOCH 3 - PROGRESS: at 1.88% examples, 194414 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:04,542 : INFO : EPOCH 3 - PROGRESS: at 2.61% examples, 203212 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:07:05,638 : INFO : EPOCH 3 - PROGRESS: at 3.51% examples, 211843 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:06,659 : INFO : EPOCH 3 - PROGRESS: at 4.34% examples, 216540 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:07,667 : INFO : EPOCH 3 - PROGRESS: at 5.11% examples, 220410 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:08,675 : INFO : EPOCH 3 - PROGRESS: at 5.88% examples, 222200 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:09,677 : INFO : EPOCH 3 - PROGRESS: at 6.64% examples, 223067 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:10,695 : INFO : EPOCH 3 - PROGRESS: at 7.43% examples, 224730 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:11,698 : INFO : EPOCH 3 - PROGRESS: at 8.18% examples, 226401 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:12,744 : INFO : EPOCH 3 - PROGRESS: at 8.89% examples, 225887 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:13,749 : INFO : EPOCH 3 - PROGRESS: at 9.63% examples, 228254 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:14,829 : INFO : EPOCH 3 - PROGRESS: at 10.21% examples, 228116 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:15,837 : INFO : EPOCH 3 - PROGRESS: at 10.95% examples, 229988 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:16,941 : INFO : EPOCH 3 - PROGRESS: at 11.60% examples, 229434 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:07:17,957 : INFO : EPOCH 3 - PROGRESS: at 12.21% examples, 230435 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:07:19,049 : INFO : EPOCH 3 - PROGRESS: at 12.96% examples, 230440 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:20,056 : INFO : EPOCH 3 - PROGRESS: at 13.76% examples, 231838 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:21,128 : INFO : EPOCH 3 - PROGRESS: at 14.46% examples, 231609 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:07:22,287 : INFO : EPOCH 3 - PROGRESS: at 15.30% examples, 232556 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:23,414 : INFO : EPOCH 3 - PROGRESS: at 16.13% examples, 233754 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:24,451 : INFO : EPOCH 3 - PROGRESS: at 16.81% examples, 233807 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:25,533 : INFO : EPOCH 3 - PROGRESS: at 17.49% examples, 234120 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:26,542 : INFO : EPOCH 3 - PROGRESS: at 18.17% examples, 234412 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:27,547 : INFO : EPOCH 3 - PROGRESS: at 18.87% examples, 234993 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:28,576 : INFO : EPOCH 3 - PROGRESS: at 19.42% examples, 234768 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:29,577 : INFO : EPOCH 3 - PROGRESS: at 20.11% examples, 235787 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:30,607 : INFO : EPOCH 3 - PROGRESS: at 20.70% examples, 235634 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:31,646 : INFO : EPOCH 3 - PROGRESS: at 21.74% examples, 236450 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:07:32,673 : INFO : EPOCH 3 - PROGRESS: at 22.42% examples, 236955 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:33,734 : INFO : EPOCH 3 - PROGRESS: at 23.04% examples, 236759 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:34,738 : INFO : EPOCH 3 - PROGRESS: at 23.66% examples, 236955 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:35,783 : INFO : EPOCH 3 - PROGRESS: at 24.32% examples, 237268 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:36,794 : INFO : EPOCH 3 - PROGRESS: at 25.13% examples, 237403 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:37,801 : INFO : EPOCH 3 - PROGRESS: at 26.00% examples, 237573 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:38,861 : INFO : EPOCH 3 - PROGRESS: at 26.90% examples, 237235 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:39,876 : INFO : EPOCH 3 - PROGRESS: at 27.84% examples, 237167 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:40,908 : INFO : EPOCH 3 - PROGRESS: at 28.71% examples, 237368 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:41,922 : INFO : EPOCH 3 - PROGRESS: at 29.53% examples, 237105 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:42,926 : INFO : EPOCH 3 - PROGRESS: at 30.33% examples, 237115 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:44,040 : INFO : EPOCH 3 - PROGRESS: at 31.40% examples, 237199 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:45,045 : INFO : EPOCH 3 - PROGRESS: at 32.29% examples, 237495 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:46,130 : INFO : EPOCH 3 - PROGRESS: at 33.17% examples, 237364 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:47,143 : INFO : EPOCH 3 - PROGRESS: at 33.91% examples, 237333 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:48,188 : INFO : EPOCH 3 - PROGRESS: at 34.81% examples, 237600 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:49,197 : INFO : EPOCH 3 - PROGRESS: at 35.65% examples, 237421 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:50,240 : INFO : EPOCH 3 - PROGRESS: at 36.56% examples, 237499 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:51,273 : INFO : EPOCH 3 - PROGRESS: at 37.38% examples, 237507 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:52,336 : INFO : EPOCH 3 - PROGRESS: at 38.32% examples, 237602 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:53,353 : INFO : EPOCH 3 - PROGRESS: at 39.16% examples, 237402 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:07:54,413 : INFO : EPOCH 3 - PROGRESS: at 39.96% examples, 237145 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:07:55,422 : INFO : EPOCH 3 - PROGRESS: at 40.92% examples, 237654 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:56,499 : INFO : EPOCH 3 - PROGRESS: at 41.89% examples, 237332 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:07:57,513 : INFO : EPOCH 3 - PROGRESS: at 42.68% examples, 237396 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:07:58,517 : INFO : EPOCH 3 - PROGRESS: at 43.57% examples, 237403 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:07:59,518 : INFO : EPOCH 3 - PROGRESS: at 44.49% examples, 237414 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:00,567 : INFO : EPOCH 3 - PROGRESS: at 45.30% examples, 236983 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:08:01,579 : INFO : EPOCH 3 - PROGRESS: at 46.19% examples, 237074 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:02,595 : INFO : EPOCH 3 - PROGRESS: at 46.91% examples, 236884 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:03,633 : INFO : EPOCH 3 - PROGRESS: at 47.65% examples, 236430 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:04,650 : INFO : EPOCH 3 - PROGRESS: at 48.39% examples, 235936 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:05,704 : INFO : EPOCH 3 - PROGRESS: at 49.22% examples, 235555 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:06,762 : INFO : EPOCH 3 - PROGRESS: at 50.09% examples, 235588 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:07,795 : INFO : EPOCH 3 - PROGRESS: at 50.98% examples, 235830 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:08:08,806 : INFO : EPOCH 3 - PROGRESS: at 51.77% examples, 235795 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:09,865 : INFO : EPOCH 3 - PROGRESS: at 52.49% examples, 235410 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:10,869 : INFO : EPOCH 3 - PROGRESS: at 53.23% examples, 235629 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:11,942 : INFO : EPOCH 3 - PROGRESS: at 54.07% examples, 235532 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:13,005 : INFO : EPOCH 3 - PROGRESS: at 54.82% examples, 235186 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:14,021 : INFO : EPOCH 3 - PROGRESS: at 55.79% examples, 235270 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:15,034 : INFO : EPOCH 3 - PROGRESS: at 56.56% examples, 235173 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:08:16,120 : INFO : EPOCH 3 - PROGRESS: at 57.41% examples, 234959 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:17,132 : INFO : EPOCH 3 - PROGRESS: at 58.17% examples, 234857 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:18,155 : INFO : EPOCH 3 - PROGRESS: at 59.07% examples, 235026 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:19,176 : INFO : EPOCH 3 - PROGRESS: at 59.85% examples, 234925 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:20,203 : INFO : EPOCH 3 - PROGRESS: at 60.65% examples, 234823 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:21,223 : INFO : EPOCH 3 - PROGRESS: at 61.45% examples, 234718 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:22,243 : INFO : EPOCH 3 - PROGRESS: at 62.29% examples, 234797 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:08:23,255 : INFO : EPOCH 3 - PROGRESS: at 63.18% examples, 234896 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:24,361 : INFO : EPOCH 3 - PROGRESS: at 64.11% examples, 234545 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:08:25,362 : INFO : EPOCH 3 - PROGRESS: at 65.05% examples, 234826 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:26,440 : INFO : EPOCH 3 - PROGRESS: at 65.75% examples, 234641 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:27,449 : INFO : EPOCH 3 - PROGRESS: at 66.53% examples, 234546 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:28,485 : INFO : EPOCH 3 - PROGRESS: at 67.34% examples, 234470 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:29,531 : INFO : EPOCH 3 - PROGRESS: at 68.17% examples, 234470 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:30,540 : INFO : EPOCH 3 - PROGRESS: at 68.98% examples, 234480 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:31,552 : INFO : EPOCH 3 - PROGRESS: at 69.70% examples, 234476 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:32,555 : INFO : EPOCH 3 - PROGRESS: at 70.43% examples, 234424 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:33,574 : INFO : EPOCH 3 - PROGRESS: at 71.19% examples, 234428 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:34,582 : INFO : EPOCH 3 - PROGRESS: at 71.97% examples, 234369 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:08:35,613 : INFO : EPOCH 3 - PROGRESS: at 72.87% examples, 234407 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:08:36,661 : INFO : EPOCH 3 - PROGRESS: at 73.82% examples, 234545 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:37,697 : INFO : EPOCH 3 - PROGRESS: at 74.60% examples, 234564 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:38,788 : INFO : EPOCH 3 - PROGRESS: at 75.30% examples, 234159 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:39,796 : INFO : EPOCH 3 - PROGRESS: at 76.07% examples, 234318 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:40,835 : INFO : EPOCH 3 - PROGRESS: at 76.87% examples, 234406 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:41,867 : INFO : EPOCH 3 - PROGRESS: at 77.62% examples, 234421 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:42,914 : INFO : EPOCH 3 - PROGRESS: at 78.29% examples, 234143 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:43,976 : INFO : EPOCH 3 - PROGRESS: at 78.99% examples, 233812 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:08:45,016 : INFO : EPOCH 3 - PROGRESS: at 79.80% examples, 233768 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:08:46,020 : INFO : EPOCH 3 - PROGRESS: at 80.56% examples, 233795 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:47,031 : INFO : EPOCH 3 - PROGRESS: at 81.32% examples, 233804 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:48,036 : INFO : EPOCH 3 - PROGRESS: at 82.10% examples, 233693 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:49,085 : INFO : EPOCH 3 - PROGRESS: at 82.88% examples, 233566 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:50,092 : INFO : EPOCH 3 - PROGRESS: at 83.69% examples, 233719 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:51,141 : INFO : EPOCH 3 - PROGRESS: at 84.47% examples, 233768 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:52,170 : INFO : EPOCH 3 - PROGRESS: at 85.21% examples, 233735 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:53,193 : INFO : EPOCH 3 - PROGRESS: at 86.09% examples, 233908 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:54,245 : INFO : EPOCH 3 - PROGRESS: at 87.01% examples, 233902 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:08:55,260 : INFO : EPOCH 3 - PROGRESS: at 87.91% examples, 233975 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:56,267 : INFO : EPOCH 3 - PROGRESS: at 88.77% examples, 233994 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:08:57,271 : INFO : EPOCH 3 - PROGRESS: at 89.58% examples, 234029 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:08:58,284 : INFO : EPOCH 3 - PROGRESS: at 90.44% examples, 234105 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:08:59,292 : INFO : EPOCH 3 - PROGRESS: at 91.30% examples, 234184 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:00,319 : INFO : EPOCH 3 - PROGRESS: at 92.13% examples, 234107 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:01,361 : INFO : EPOCH 3 - PROGRESS: at 92.89% examples, 234052 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:02,412 : INFO : EPOCH 3 - PROGRESS: at 93.80% examples, 234224 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:03,480 : INFO : EPOCH 3 - PROGRESS: at 94.62% examples, 234131 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:04,567 : INFO : EPOCH 3 - PROGRESS: at 95.39% examples, 233825 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:05,574 : INFO : EPOCH 3 - PROGRESS: at 96.06% examples, 233615 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:06,586 : INFO : EPOCH 3 - PROGRESS: at 96.72% examples, 233226 words/s, in_qsize 17, out_qsize 1
2020-04-16 18:09:07,601 : INFO : EPOCH 3 - PROGRESS: at 97.45% examples, 233001 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:09:08,636 : INFO : EPOCH 3 - PROGRESS: at 98.28% examples, 233028 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:09,705 : INFO : EPOCH 3 - PROGRESS: at 99.10% examples, 232890 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:09:10,486 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:09:10,519 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:09:10,529 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:09:10,592 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:09:10,603 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:09:10,606 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:09:10,607 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:09:10,657 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:09:10,662 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:09:10,677 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:09:10,678 : INFO : EPOCH - 3 : training on 41519355 raw words (30348128 effective words) took 130.2s, 233116 effective words/s
2020-04-16 18:09:11,850 : INFO : EPOCH 4 - PROGRESS: at 0.69% examples, 192651 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:12,851 : INFO : EPOCH 4 - PROGRESS: at 1.45% examples, 213774 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:09:13,878 : INFO : EPOCH 4 - PROGRESS: at 2.18% examples, 216942 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:14,881 : INFO : EPOCH 4 - PROGRESS: at 3.03% examples, 223485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:15,910 : INFO : EPOCH 4 - PROGRESS: at 3.79% examples, 225093 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:16,950 : INFO : EPOCH 4 - PROGRESS: at 4.57% examples, 225759 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:17,966 : INFO : EPOCH 4 - PROGRESS: at 5.31% examples, 224950 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:09:18,978 : INFO : EPOCH 4 - PROGRESS: at 6.16% examples, 229483 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:20,046 : INFO : EPOCH 4 - PROGRESS: at 6.96% examples, 228682 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:21,058 : INFO : EPOCH 4 - PROGRESS: at 7.66% examples, 228535 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:22,096 : INFO : EPOCH 4 - PROGRESS: at 8.30% examples, 225379 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:23,115 : INFO : EPOCH 4 - PROGRESS: at 8.97% examples, 224850 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:24,122 : INFO : EPOCH 4 - PROGRESS: at 9.59% examples, 224005 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:09:25,132 : INFO : EPOCH 4 - PROGRESS: at 10.14% examples, 223745 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:26,176 : INFO : EPOCH 4 - PROGRESS: at 10.67% examples, 220351 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:27,190 : INFO : EPOCH 4 - PROGRESS: at 11.21% examples, 219793 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:28,227 : INFO : EPOCH 4 - PROGRESS: at 11.77% examples, 219539 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:29,248 : INFO : EPOCH 4 - PROGRESS: at 12.42% examples, 220571 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:30,296 : INFO : EPOCH 4 - PROGRESS: at 13.21% examples, 221678 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:31,332 : INFO : EPOCH 4 - PROGRESS: at 13.87% examples, 222004 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:32,334 : INFO : EPOCH 4 - PROGRESS: at 14.65% examples, 223723 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:33,336 : INFO : EPOCH 4 - PROGRESS: at 15.35% examples, 224362 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:34,358 : INFO : EPOCH 4 - PROGRESS: at 16.00% examples, 224462 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:09:35,378 : INFO : EPOCH 4 - PROGRESS: at 16.72% examples, 225658 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:36,416 : INFO : EPOCH 4 - PROGRESS: at 17.33% examples, 225566 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:37,429 : INFO : EPOCH 4 - PROGRESS: at 18.09% examples, 227217 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:38,451 : INFO : EPOCH 4 - PROGRESS: at 18.73% examples, 227125 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:39,460 : INFO : EPOCH 4 - PROGRESS: at 19.24% examples, 226346 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:40,468 : INFO : EPOCH 4 - PROGRESS: at 19.81% examples, 226161 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:41,552 : INFO : EPOCH 4 - PROGRESS: at 20.41% examples, 225631 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:42,574 : INFO : EPOCH 4 - PROGRESS: at 20.99% examples, 226088 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:43,601 : INFO : EPOCH 4 - PROGRESS: at 21.91% examples, 225920 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:44,602 : INFO : EPOCH 4 - PROGRESS: at 22.50% examples, 225834 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:45,615 : INFO : EPOCH 4 - PROGRESS: at 23.10% examples, 226085 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:46,622 : INFO : EPOCH 4 - PROGRESS: at 23.63% examples, 225550 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:47,632 : INFO : EPOCH 4 - PROGRESS: at 24.18% examples, 225190 words/s, in_qsize 18, out_qsize 3
2020-04-16 18:09:48,642 : INFO : EPOCH 4 - PROGRESS: at 24.86% examples, 225099 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:49,696 : INFO : EPOCH 4 - PROGRESS: at 25.65% examples, 224545 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:50,698 : INFO : EPOCH 4 - PROGRESS: at 26.48% examples, 224364 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:51,714 : INFO : EPOCH 4 - PROGRESS: at 27.27% examples, 224091 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:09:52,736 : INFO : EPOCH 4 - PROGRESS: at 28.11% examples, 223790 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:53,820 : INFO : EPOCH 4 - PROGRESS: at 28.77% examples, 222685 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:54,875 : INFO : EPOCH 4 - PROGRESS: at 29.48% examples, 221907 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:55,885 : INFO : EPOCH 4 - PROGRESS: at 30.06% examples, 220782 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:56,910 : INFO : EPOCH 4 - PROGRESS: at 30.82% examples, 220281 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:09:57,956 : INFO : EPOCH 4 - PROGRESS: at 31.68% examples, 219976 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:09:59,061 : INFO : EPOCH 4 - PROGRESS: at 32.43% examples, 219409 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:00,195 : INFO : EPOCH 4 - PROGRESS: at 33.17% examples, 218743 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:10:01,233 : INFO : EPOCH 4 - PROGRESS: at 33.80% examples, 218259 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:10:02,251 : INFO : EPOCH 4 - PROGRESS: at 34.45% examples, 217338 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:03,365 : INFO : EPOCH 4 - PROGRESS: at 35.08% examples, 216573 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:04,420 : INFO : EPOCH 4 - PROGRESS: at 35.76% examples, 215820 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:10:05,522 : INFO : EPOCH 4 - PROGRESS: at 36.56% examples, 215410 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:06,530 : INFO : EPOCH 4 - PROGRESS: at 37.12% examples, 214630 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:07,542 : INFO : EPOCH 4 - PROGRESS: at 37.65% examples, 213460 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:08,546 : INFO : EPOCH 4 - PROGRESS: at 38.32% examples, 212851 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:09,569 : INFO : EPOCH 4 - PROGRESS: at 38.97% examples, 212225 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:10,616 : INFO : EPOCH 4 - PROGRESS: at 39.66% examples, 211888 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:11,691 : INFO : EPOCH 4 - PROGRESS: at 40.43% examples, 211692 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:12,790 : INFO : EPOCH 4 - PROGRESS: at 41.27% examples, 211446 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:10:13,793 : INFO : EPOCH 4 - PROGRESS: at 42.05% examples, 211276 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:14,823 : INFO : EPOCH 4 - PROGRESS: at 42.70% examples, 211131 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:15,852 : INFO : EPOCH 4 - PROGRESS: at 43.44% examples, 210782 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:10:16,888 : INFO : EPOCH 4 - PROGRESS: at 44.22% examples, 210657 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:10:17,904 : INFO : EPOCH 4 - PROGRESS: at 44.96% examples, 210368 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:10:18,914 : INFO : EPOCH 4 - PROGRESS: at 45.70% examples, 210202 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:10:19,994 : INFO : EPOCH 4 - PROGRESS: at 46.42% examples, 210053 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:21,001 : INFO : EPOCH 4 - PROGRESS: at 47.08% examples, 209900 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:22,052 : INFO : EPOCH 4 - PROGRESS: at 47.79% examples, 209644 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:23,074 : INFO : EPOCH 4 - PROGRESS: at 48.52% examples, 209574 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:24,164 : INFO : EPOCH 4 - PROGRESS: at 49.31% examples, 209400 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:25,178 : INFO : EPOCH 4 - PROGRESS: at 50.06% examples, 209449 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:26,193 : INFO : EPOCH 4 - PROGRESS: at 50.69% examples, 209120 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:27,238 : INFO : EPOCH 4 - PROGRESS: at 51.39% examples, 208983 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:28,285 : INFO : EPOCH 4 - PROGRESS: at 52.05% examples, 208751 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:10:29,315 : INFO : EPOCH 4 - PROGRESS: at 52.69% examples, 208586 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:10:30,328 : INFO : EPOCH 4 - PROGRESS: at 53.31% examples, 208455 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:31,381 : INFO : EPOCH 4 - PROGRESS: at 54.05% examples, 208423 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:32,394 : INFO : EPOCH 4 - PROGRESS: at 54.75% examples, 208420 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:33,438 : INFO : EPOCH 4 - PROGRESS: at 55.60% examples, 208406 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:34,482 : INFO : EPOCH 4 - PROGRESS: at 56.32% examples, 208311 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:35,510 : INFO : EPOCH 4 - PROGRESS: at 57.02% examples, 208182 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:36,520 : INFO : EPOCH 4 - PROGRESS: at 57.71% examples, 208078 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:37,562 : INFO : EPOCH 4 - PROGRESS: at 58.37% examples, 207826 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:10:38,621 : INFO : EPOCH 4 - PROGRESS: at 59.14% examples, 207785 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:39,632 : INFO : EPOCH 4 - PROGRESS: at 59.85% examples, 207790 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:40,649 : INFO : EPOCH 4 - PROGRESS: at 60.53% examples, 207622 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:41,710 : INFO : EPOCH 4 - PROGRESS: at 61.15% examples, 207109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:42,769 : INFO : EPOCH 4 - PROGRESS: at 61.81% examples, 206930 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:43,779 : INFO : EPOCH 4 - PROGRESS: at 62.45% examples, 206626 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:44,786 : INFO : EPOCH 4 - PROGRESS: at 63.15% examples, 206489 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:10:45,797 : INFO : EPOCH 4 - PROGRESS: at 64.01% examples, 206562 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:46,876 : INFO : EPOCH 4 - PROGRESS: at 64.79% examples, 206344 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:47,934 : INFO : EPOCH 4 - PROGRESS: at 65.46% examples, 206324 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:48,974 : INFO : EPOCH 4 - PROGRESS: at 66.17% examples, 206403 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:49,987 : INFO : EPOCH 4 - PROGRESS: at 66.87% examples, 206444 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:51,015 : INFO : EPOCH 4 - PROGRESS: at 67.63% examples, 206480 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:52,016 : INFO : EPOCH 4 - PROGRESS: at 68.37% examples, 206584 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:53,075 : INFO : EPOCH 4 - PROGRESS: at 69.10% examples, 206618 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:54,093 : INFO : EPOCH 4 - PROGRESS: at 69.82% examples, 206739 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:55,136 : INFO : EPOCH 4 - PROGRESS: at 70.51% examples, 206812 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:10:56,137 : INFO : EPOCH 4 - PROGRESS: at 71.19% examples, 206914 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:57,168 : INFO : EPOCH 4 - PROGRESS: at 71.95% examples, 207075 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:10:58,216 : INFO : EPOCH 4 - PROGRESS: at 72.84% examples, 207267 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:10:59,223 : INFO : EPOCH 4 - PROGRESS: at 73.64% examples, 207335 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:00,235 : INFO : EPOCH 4 - PROGRESS: at 74.36% examples, 207390 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:01,239 : INFO : EPOCH 4 - PROGRESS: at 75.05% examples, 207455 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:02,239 : INFO : EPOCH 4 - PROGRESS: at 75.72% examples, 207547 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:03,249 : INFO : EPOCH 4 - PROGRESS: at 76.36% examples, 207595 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:04,263 : INFO : EPOCH 4 - PROGRESS: at 77.07% examples, 207648 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:05,319 : INFO : EPOCH 4 - PROGRESS: at 77.71% examples, 207612 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:11:06,345 : INFO : EPOCH 4 - PROGRESS: at 78.43% examples, 207638 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:11:07,346 : INFO : EPOCH 4 - PROGRESS: at 79.16% examples, 207763 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:08,366 : INFO : EPOCH 4 - PROGRESS: at 79.87% examples, 207804 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:11:09,402 : INFO : EPOCH 4 - PROGRESS: at 80.42% examples, 207449 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:10,465 : INFO : EPOCH 4 - PROGRESS: at 81.03% examples, 207224 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:11,488 : INFO : EPOCH 4 - PROGRESS: at 81.78% examples, 207259 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:11:12,490 : INFO : EPOCH 4 - PROGRESS: at 82.53% examples, 207390 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:13,555 : INFO : EPOCH 4 - PROGRESS: at 83.13% examples, 207001 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:14,586 : INFO : EPOCH 4 - PROGRESS: at 83.86% examples, 207137 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:15,610 : INFO : EPOCH 4 - PROGRESS: at 84.54% examples, 207279 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:16,629 : INFO : EPOCH 4 - PROGRESS: at 85.29% examples, 207427 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:17,640 : INFO : EPOCH 4 - PROGRESS: at 86.00% examples, 207416 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:11:18,656 : INFO : EPOCH 4 - PROGRESS: at 86.84% examples, 207574 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:19,662 : INFO : EPOCH 4 - PROGRESS: at 87.59% examples, 207530 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:11:20,676 : INFO : EPOCH 4 - PROGRESS: at 88.35% examples, 207571 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:21,691 : INFO : EPOCH 4 - PROGRESS: at 89.15% examples, 207677 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:22,728 : INFO : EPOCH 4 - PROGRESS: at 89.94% examples, 207741 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:23,792 : INFO : EPOCH 4 - PROGRESS: at 90.74% examples, 207764 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:24,822 : INFO : EPOCH 4 - PROGRESS: at 91.48% examples, 207779 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:25,828 : INFO : EPOCH 4 - PROGRESS: at 92.29% examples, 207892 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:26,904 : INFO : EPOCH 4 - PROGRESS: at 93.04% examples, 208045 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:27,918 : INFO : EPOCH 4 - PROGRESS: at 93.82% examples, 208136 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:28,946 : INFO : EPOCH 4 - PROGRESS: at 94.54% examples, 208109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:29,980 : INFO : EPOCH 4 - PROGRESS: at 95.30% examples, 208118 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:31,004 : INFO : EPOCH 4 - PROGRESS: at 96.03% examples, 208150 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:11:32,028 : INFO : EPOCH 4 - PROGRESS: at 96.79% examples, 208219 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:33,029 : INFO : EPOCH 4 - PROGRESS: at 97.50% examples, 208162 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:34,108 : INFO : EPOCH 4 - PROGRESS: at 98.13% examples, 207903 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:11:35,128 : INFO : EPOCH 4 - PROGRESS: at 98.83% examples, 207789 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:36,177 : INFO : EPOCH 4 - PROGRESS: at 99.43% examples, 207484 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:36,612 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:11:36,634 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:11:36,662 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:11:36,667 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:11:36,674 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:11:36,709 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:11:36,751 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:11:36,775 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:11:36,784 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:11:36,796 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:11:36,797 : INFO : EPOCH - 4 : training on 41519355 raw words (30349639 effective words) took 146.1s, 207714 effective words/s
2020-04-16 18:11:37,830 : INFO : EPOCH 5 - PROGRESS: at 0.51% examples, 162446 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:38,896 : INFO : EPOCH 5 - PROGRESS: at 1.14% examples, 176392 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:40,052 : INFO : EPOCH 5 - PROGRESS: at 1.86% examples, 180319 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:11:41,084 : INFO : EPOCH 5 - PROGRESS: at 2.59% examples, 190572 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:42,104 : INFO : EPOCH 5 - PROGRESS: at 3.34% examples, 196160 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:43,122 : INFO : EPOCH 5 - PROGRESS: at 4.06% examples, 198887 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:44,126 : INFO : EPOCH 5 - PROGRESS: at 4.78% examples, 201240 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:45,151 : INFO : EPOCH 5 - PROGRESS: at 5.48% examples, 202329 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:46,171 : INFO : EPOCH 5 - PROGRESS: at 6.16% examples, 203252 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:11:47,258 : INFO : EPOCH 5 - PROGRESS: at 6.94% examples, 204181 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:11:48,259 : INFO : EPOCH 5 - PROGRESS: at 7.60% examples, 205152 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:49,267 : INFO : EPOCH 5 - PROGRESS: at 8.25% examples, 205285 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:50,273 : INFO : EPOCH 5 - PROGRESS: at 8.91% examples, 205973 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:51,286 : INFO : EPOCH 5 - PROGRESS: at 9.56% examples, 206948 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:52,336 : INFO : EPOCH 5 - PROGRESS: at 10.10% examples, 207290 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:11:53,345 : INFO : EPOCH 5 - PROGRESS: at 10.72% examples, 207691 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:54,358 : INFO : EPOCH 5 - PROGRESS: at 11.33% examples, 208364 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:55,427 : INFO : EPOCH 5 - PROGRESS: at 11.86% examples, 208390 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:56,431 : INFO : EPOCH 5 - PROGRESS: at 12.42% examples, 208674 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:57,473 : INFO : EPOCH 5 - PROGRESS: at 13.11% examples, 209008 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:11:58,480 : INFO : EPOCH 5 - PROGRESS: at 13.76% examples, 209264 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:11:59,495 : INFO : EPOCH 5 - PROGRESS: at 14.38% examples, 209710 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:00,502 : INFO : EPOCH 5 - PROGRESS: at 15.03% examples, 210255 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:01,508 : INFO : EPOCH 5 - PROGRESS: at 15.75% examples, 210775 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:02,556 : INFO : EPOCH 5 - PROGRESS: at 16.33% examples, 210850 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:03,616 : INFO : EPOCH 5 - PROGRESS: at 16.85% examples, 209485 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:04,641 : INFO : EPOCH 5 - PROGRESS: at 17.30% examples, 208021 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:05,672 : INFO : EPOCH 5 - PROGRESS: at 17.78% examples, 206817 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:12:06,771 : INFO : EPOCH 5 - PROGRESS: at 18.39% examples, 206433 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:07,786 : INFO : EPOCH 5 - PROGRESS: at 19.00% examples, 207274 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:08,812 : INFO : EPOCH 5 - PROGRESS: at 19.58% examples, 207582 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:09,849 : INFO : EPOCH 5 - PROGRESS: at 20.13% examples, 207752 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:10,896 : INFO : EPOCH 5 - PROGRESS: at 20.57% examples, 206667 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:11,905 : INFO : EPOCH 5 - PROGRESS: at 21.30% examples, 206824 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:12,918 : INFO : EPOCH 5 - PROGRESS: at 21.94% examples, 206164 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:13,937 : INFO : EPOCH 5 - PROGRESS: at 22.54% examples, 206714 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:12:15,077 : INFO : EPOCH 5 - PROGRESS: at 23.16% examples, 206964 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:12:16,103 : INFO : EPOCH 5 - PROGRESS: at 23.76% examples, 207581 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:17,105 : INFO : EPOCH 5 - PROGRESS: at 24.32% examples, 207775 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:18,115 : INFO : EPOCH 5 - PROGRESS: at 25.03% examples, 207920 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:19,142 : INFO : EPOCH 5 - PROGRESS: at 25.75% examples, 207640 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:20,170 : INFO : EPOCH 5 - PROGRESS: at 26.58% examples, 207719 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:21,183 : INFO : EPOCH 5 - PROGRESS: at 27.37% examples, 207868 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:22,248 : INFO : EPOCH 5 - PROGRESS: at 28.23% examples, 207922 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:23,285 : INFO : EPOCH 5 - PROGRESS: at 28.99% examples, 207941 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:24,287 : INFO : EPOCH 5 - PROGRESS: at 29.75% examples, 208093 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:25,300 : INFO : EPOCH 5 - PROGRESS: at 30.42% examples, 207918 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:26,304 : INFO : EPOCH 5 - PROGRESS: at 31.22% examples, 207808 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:27,314 : INFO : EPOCH 5 - PROGRESS: at 32.02% examples, 207930 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:28,337 : INFO : EPOCH 5 - PROGRESS: at 32.73% examples, 207704 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:12:29,352 : INFO : EPOCH 5 - PROGRESS: at 33.44% examples, 207676 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:30,422 : INFO : EPOCH 5 - PROGRESS: at 34.15% examples, 207718 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:31,442 : INFO : EPOCH 5 - PROGRESS: at 34.91% examples, 207950 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:32,502 : INFO : EPOCH 5 - PROGRESS: at 35.76% examples, 208266 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:33,517 : INFO : EPOCH 5 - PROGRESS: at 36.43% examples, 207707 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:34,562 : INFO : EPOCH 5 - PROGRESS: at 37.14% examples, 207709 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:35,623 : INFO : EPOCH 5 - PROGRESS: at 37.91% examples, 207627 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:12:36,649 : INFO : EPOCH 5 - PROGRESS: at 38.72% examples, 207673 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:37,679 : INFO : EPOCH 5 - PROGRESS: at 39.49% examples, 207841 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:38,740 : INFO : EPOCH 5 - PROGRESS: at 40.27% examples, 207765 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:39,759 : INFO : EPOCH 5 - PROGRESS: at 41.06% examples, 207844 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:40,776 : INFO : EPOCH 5 - PROGRESS: at 41.92% examples, 207921 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:41,785 : INFO : EPOCH 5 - PROGRESS: at 42.63% examples, 208008 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:12:42,799 : INFO : EPOCH 5 - PROGRESS: at 43.41% examples, 208088 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:12:43,810 : INFO : EPOCH 5 - PROGRESS: at 44.24% examples, 208190 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:44,825 : INFO : EPOCH 5 - PROGRESS: at 45.03% examples, 208256 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:45,843 : INFO : EPOCH 5 - PROGRESS: at 45.81% examples, 208314 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:46,878 : INFO : EPOCH 5 - PROGRESS: at 46.54% examples, 208335 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:47,948 : INFO : EPOCH 5 - PROGRESS: at 47.27% examples, 208324 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:48,973 : INFO : EPOCH 5 - PROGRESS: at 48.05% examples, 208468 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:50,002 : INFO : EPOCH 5 - PROGRESS: at 48.84% examples, 208491 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:51,035 : INFO : EPOCH 5 - PROGRESS: at 49.57% examples, 208396 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:52,073 : INFO : EPOCH 5 - PROGRESS: at 50.31% examples, 208389 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:53,077 : INFO : EPOCH 5 - PROGRESS: at 51.06% examples, 208485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:54,098 : INFO : EPOCH 5 - PROGRESS: at 51.78% examples, 208509 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:55,133 : INFO : EPOCH 5 - PROGRESS: at 52.49% examples, 208507 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:56,163 : INFO : EPOCH 5 - PROGRESS: at 53.13% examples, 208517 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:57,166 : INFO : EPOCH 5 - PROGRESS: at 53.85% examples, 208611 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:12:58,238 : INFO : EPOCH 5 - PROGRESS: at 54.61% examples, 208631 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:12:59,284 : INFO : EPOCH 5 - PROGRESS: at 55.50% examples, 208780 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:00,318 : INFO : EPOCH 5 - PROGRESS: at 56.21% examples, 208616 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:13:01,341 : INFO : EPOCH 5 - PROGRESS: at 56.95% examples, 208668 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:02,388 : INFO : EPOCH 5 - PROGRESS: at 57.69% examples, 208647 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:13:03,432 : INFO : EPOCH 5 - PROGRESS: at 58.41% examples, 208627 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:13:04,438 : INFO : EPOCH 5 - PROGRESS: at 59.21% examples, 208786 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:05,503 : INFO : EPOCH 5 - PROGRESS: at 59.94% examples, 208733 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:06,576 : INFO : EPOCH 5 - PROGRESS: at 60.71% examples, 208670 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:07,577 : INFO : EPOCH 5 - PROGRESS: at 61.45% examples, 208757 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:13:08,590 : INFO : EPOCH 5 - PROGRESS: at 62.20% examples, 208901 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:13:09,617 : INFO : EPOCH 5 - PROGRESS: at 63.03% examples, 209078 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:13:10,637 : INFO : EPOCH 5 - PROGRESS: at 63.87% examples, 209037 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:13:11,676 : INFO : EPOCH 5 - PROGRESS: at 64.72% examples, 209027 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:13:12,786 : INFO : EPOCH 5 - PROGRESS: at 65.35% examples, 208702 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:13,949 : INFO : EPOCH 5 - PROGRESS: at 66.01% examples, 208425 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:14,981 : INFO : EPOCH 5 - PROGRESS: at 66.74% examples, 208485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:15,992 : INFO : EPOCH 5 - PROGRESS: at 67.50% examples, 208528 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:17,018 : INFO : EPOCH 5 - PROGRESS: at 68.28% examples, 208701 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:18,071 : INFO : EPOCH 5 - PROGRESS: at 69.03% examples, 208730 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:13:19,075 : INFO : EPOCH 5 - PROGRESS: at 69.73% examples, 208856 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:20,116 : INFO : EPOCH 5 - PROGRESS: at 70.43% examples, 208913 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:21,126 : INFO : EPOCH 5 - PROGRESS: at 71.11% examples, 208976 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:22,148 : INFO : EPOCH 5 - PROGRESS: at 71.85% examples, 209072 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:13:23,180 : INFO : EPOCH 5 - PROGRESS: at 72.72% examples, 209280 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:24,200 : INFO : EPOCH 5 - PROGRESS: at 73.58% examples, 209440 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:25,331 : INFO : EPOCH 5 - PROGRESS: at 74.36% examples, 209378 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:26,359 : INFO : EPOCH 5 - PROGRESS: at 75.07% examples, 209442 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:27,371 : INFO : EPOCH 5 - PROGRESS: at 75.74% examples, 209493 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:28,373 : INFO : EPOCH 5 - PROGRESS: at 76.38% examples, 209540 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:29,413 : INFO : EPOCH 5 - PROGRESS: at 77.09% examples, 209517 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:30,504 : INFO : EPOCH 5 - PROGRESS: at 77.82% examples, 209596 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:31,538 : INFO : EPOCH 5 - PROGRESS: at 78.52% examples, 209589 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:13:32,547 : INFO : EPOCH 5 - PROGRESS: at 79.25% examples, 209628 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:33,573 : INFO : EPOCH 5 - PROGRESS: at 79.93% examples, 209641 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:34,636 : INFO : EPOCH 5 - PROGRESS: at 80.62% examples, 209580 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:13:35,658 : INFO : EPOCH 5 - PROGRESS: at 81.32% examples, 209595 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:36,727 : INFO : EPOCH 5 - PROGRESS: at 82.07% examples, 209528 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:37,784 : INFO : EPOCH 5 - PROGRESS: at 82.88% examples, 209666 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:38,877 : INFO : EPOCH 5 - PROGRESS: at 83.61% examples, 209615 words/s, in_qsize 18, out_qsize 5
2020-04-16 18:13:39,890 : INFO : EPOCH 5 - PROGRESS: at 84.29% examples, 209643 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:40,902 : INFO : EPOCH 5 - PROGRESS: at 84.95% examples, 209723 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:41,928 : INFO : EPOCH 5 - PROGRESS: at 85.71% examples, 209785 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:13:42,931 : INFO : EPOCH 5 - PROGRESS: at 86.56% examples, 210002 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:43,937 : INFO : EPOCH 5 - PROGRESS: at 87.33% examples, 210045 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:44,941 : INFO : EPOCH 5 - PROGRESS: at 88.12% examples, 210086 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:45,953 : INFO : EPOCH 5 - PROGRESS: at 88.94% examples, 210182 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:46,968 : INFO : EPOCH 5 - PROGRESS: at 89.74% examples, 210373 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:47,985 : INFO : EPOCH 5 - PROGRESS: at 90.56% examples, 210507 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:48,989 : INFO : EPOCH 5 - PROGRESS: at 91.43% examples, 210761 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:50,041 : INFO : EPOCH 5 - PROGRESS: at 92.27% examples, 210834 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:51,069 : INFO : EPOCH 5 - PROGRESS: at 93.06% examples, 211148 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:52,175 : INFO : EPOCH 5 - PROGRESS: at 93.93% examples, 211234 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:53,197 : INFO : EPOCH 5 - PROGRESS: at 94.76% examples, 211458 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:13:54,197 : INFO : EPOCH 5 - PROGRESS: at 95.63% examples, 211708 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:13:55,202 : INFO : EPOCH 5 - PROGRESS: at 96.42% examples, 211839 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:56,232 : INFO : EPOCH 5 - PROGRESS: at 97.29% examples, 212076 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:13:57,307 : INFO : EPOCH 5 - PROGRESS: at 98.11% examples, 212190 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:58,330 : INFO : EPOCH 5 - PROGRESS: at 98.99% examples, 212397 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:13:59,267 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:13:59,286 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:13:59,287 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:13:59,330 : INFO : EPOCH 5 - PROGRESS: at 99.86% examples, 212670 words/s, in_qsize 6, out_qsize 1
2020-04-16 18:13:59,331 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:13:59,365 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:13:59,367 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:13:59,377 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:13:59,429 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:13:59,440 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:13:59,443 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:13:59,444 : INFO : EPOCH - 5 : training on 41519355 raw words (30351490 effective words) took 142.6s, 212782 effective words/s
2020-04-16 18:14:00,460 : INFO : EPOCH 6 - PROGRESS: at 0.68% examples, 215468 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:01,598 : INFO : EPOCH 6 - PROGRESS: at 1.38% examples, 205666 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:14:02,621 : INFO : EPOCH 6 - PROGRESS: at 2.14% examples, 214122 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:03,642 : INFO : EPOCH 6 - PROGRESS: at 2.89% examples, 215207 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:14:04,650 : INFO : EPOCH 6 - PROGRESS: at 3.63% examples, 216562 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:05,668 : INFO : EPOCH 6 - PROGRESS: at 4.34% examples, 214724 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:14:06,682 : INFO : EPOCH 6 - PROGRESS: at 5.03% examples, 214654 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:07,695 : INFO : EPOCH 6 - PROGRESS: at 5.73% examples, 214384 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:08,715 : INFO : EPOCH 6 - PROGRESS: at 6.45% examples, 214829 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:09,719 : INFO : EPOCH 6 - PROGRESS: at 7.14% examples, 214201 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:10,724 : INFO : EPOCH 6 - PROGRESS: at 7.79% examples, 214207 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:11,752 : INFO : EPOCH 6 - PROGRESS: at 8.57% examples, 215631 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:14:12,754 : INFO : EPOCH 6 - PROGRESS: at 9.28% examples, 217740 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:13,763 : INFO : EPOCH 6 - PROGRESS: at 9.88% examples, 219445 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:14,775 : INFO : EPOCH 6 - PROGRESS: at 10.43% examples, 217638 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:15,810 : INFO : EPOCH 6 - PROGRESS: at 10.99% examples, 216601 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:14:16,856 : INFO : EPOCH 6 - PROGRESS: at 11.64% examples, 218077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:17,861 : INFO : EPOCH 6 - PROGRESS: at 12.26% examples, 219391 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:18,917 : INFO : EPOCH 6 - PROGRESS: at 12.97% examples, 219725 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:14:19,940 : INFO : EPOCH 6 - PROGRESS: at 13.73% examples, 220693 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:20,961 : INFO : EPOCH 6 - PROGRESS: at 14.46% examples, 222246 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:22,001 : INFO : EPOCH 6 - PROGRESS: at 15.16% examples, 223210 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:23,016 : INFO : EPOCH 6 - PROGRESS: at 15.91% examples, 224040 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:24,019 : INFO : EPOCH 6 - PROGRESS: at 16.56% examples, 224541 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:25,075 : INFO : EPOCH 6 - PROGRESS: at 17.22% examples, 224870 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:14:26,088 : INFO : EPOCH 6 - PROGRESS: at 17.92% examples, 226039 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:27,108 : INFO : EPOCH 6 - PROGRESS: at 18.60% examples, 226303 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:28,110 : INFO : EPOCH 6 - PROGRESS: at 19.21% examples, 226828 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:29,141 : INFO : EPOCH 6 - PROGRESS: at 19.85% examples, 227435 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:30,170 : INFO : EPOCH 6 - PROGRESS: at 20.50% examples, 227964 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:14:31,173 : INFO : EPOCH 6 - PROGRESS: at 21.43% examples, 228843 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:32,211 : INFO : EPOCH 6 - PROGRESS: at 22.08% examples, 229047 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:33,222 : INFO : EPOCH 6 - PROGRESS: at 22.75% examples, 229446 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:34,253 : INFO : EPOCH 6 - PROGRESS: at 23.34% examples, 229684 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:35,325 : INFO : EPOCH 6 - PROGRESS: at 23.95% examples, 229612 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:36,398 : INFO : EPOCH 6 - PROGRESS: at 24.53% examples, 228973 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:14:37,449 : INFO : EPOCH 6 - PROGRESS: at 25.25% examples, 227760 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:38,465 : INFO : EPOCH 6 - PROGRESS: at 25.91% examples, 226450 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:39,518 : INFO : EPOCH 6 - PROGRESS: at 26.70% examples, 225736 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:14:40,553 : INFO : EPOCH 6 - PROGRESS: at 27.54% examples, 225497 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:41,560 : INFO : EPOCH 6 - PROGRESS: at 28.34% examples, 225253 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:42,579 : INFO : EPOCH 6 - PROGRESS: at 29.15% examples, 225108 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:43,613 : INFO : EPOCH 6 - PROGRESS: at 29.92% examples, 224880 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:44,631 : INFO : EPOCH 6 - PROGRESS: at 30.70% examples, 224779 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:14:45,648 : INFO : EPOCH 6 - PROGRESS: at 31.57% examples, 224508 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:46,684 : INFO : EPOCH 6 - PROGRESS: at 32.35% examples, 224303 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:14:47,705 : INFO : EPOCH 6 - PROGRESS: at 33.10% examples, 224024 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:14:48,716 : INFO : EPOCH 6 - PROGRESS: at 33.80% examples, 223981 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:49,727 : INFO : EPOCH 6 - PROGRESS: at 34.43% examples, 222939 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:14:50,747 : INFO : EPOCH 6 - PROGRESS: at 35.13% examples, 222730 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:51,749 : INFO : EPOCH 6 - PROGRESS: at 35.88% examples, 222471 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:52,788 : INFO : EPOCH 6 - PROGRESS: at 36.67% examples, 222185 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:53,789 : INFO : EPOCH 6 - PROGRESS: at 37.38% examples, 221945 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:54,823 : INFO : EPOCH 6 - PROGRESS: at 38.16% examples, 221676 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:14:55,878 : INFO : EPOCH 6 - PROGRESS: at 38.93% examples, 221363 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:56,900 : INFO : EPOCH 6 - PROGRESS: at 39.60% examples, 220830 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:57,912 : INFO : EPOCH 6 - PROGRESS: at 40.27% examples, 220080 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:14:59,102 : INFO : EPOCH 6 - PROGRESS: at 41.03% examples, 219193 words/s, in_qsize 16, out_qsize 3
2020-04-16 18:15:00,150 : INFO : EPOCH 6 - PROGRESS: at 41.77% examples, 218385 words/s, in_qsize 20, out_qsize 3
2020-04-16 18:15:01,173 : INFO : EPOCH 6 - PROGRESS: at 42.39% examples, 217775 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:02,196 : INFO : EPOCH 6 - PROGRESS: at 43.01% examples, 217097 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:15:03,239 : INFO : EPOCH 6 - PROGRESS: at 43.70% examples, 216505 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:04,262 : INFO : EPOCH 6 - PROGRESS: at 44.47% examples, 216086 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:05,300 : INFO : EPOCH 6 - PROGRESS: at 45.15% examples, 215521 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:06,307 : INFO : EPOCH 6 - PROGRESS: at 45.90% examples, 215404 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:07,411 : INFO : EPOCH 6 - PROGRESS: at 46.62% examples, 215078 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:15:08,478 : INFO : EPOCH 6 - PROGRESS: at 47.32% examples, 214879 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:09,514 : INFO : EPOCH 6 - PROGRESS: at 48.05% examples, 214693 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:10,550 : INFO : EPOCH 6 - PROGRESS: at 48.84% examples, 214603 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:11,596 : INFO : EPOCH 6 - PROGRESS: at 49.57% examples, 214381 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:12,612 : INFO : EPOCH 6 - PROGRESS: at 50.29% examples, 214256 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:13,632 : INFO : EPOCH 6 - PROGRESS: at 51.02% examples, 214132 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:14,652 : INFO : EPOCH 6 - PROGRESS: at 51.72% examples, 213984 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:15,720 : INFO : EPOCH 6 - PROGRESS: at 52.28% examples, 213348 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:16,766 : INFO : EPOCH 6 - PROGRESS: at 52.89% examples, 212980 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:17,797 : INFO : EPOCH 6 - PROGRESS: at 53.42% examples, 212284 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:18,827 : INFO : EPOCH 6 - PROGRESS: at 54.15% examples, 212263 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:19,846 : INFO : EPOCH 6 - PROGRESS: at 54.88% examples, 212280 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:20,851 : INFO : EPOCH 6 - PROGRESS: at 55.73% examples, 212321 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:21,894 : INFO : EPOCH 6 - PROGRESS: at 56.46% examples, 212258 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:22,901 : INFO : EPOCH 6 - PROGRESS: at 57.20% examples, 212130 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:23,945 : INFO : EPOCH 6 - PROGRESS: at 57.91% examples, 212073 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:25,018 : INFO : EPOCH 6 - PROGRESS: at 58.65% examples, 211944 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:26,033 : INFO : EPOCH 6 - PROGRESS: at 59.41% examples, 211962 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:27,054 : INFO : EPOCH 6 - PROGRESS: at 60.08% examples, 211733 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:28,060 : INFO : EPOCH 6 - PROGRESS: at 60.81% examples, 211626 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:29,078 : INFO : EPOCH 6 - PROGRESS: at 61.52% examples, 211644 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:30,093 : INFO : EPOCH 6 - PROGRESS: at 62.18% examples, 211431 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:31,147 : INFO : EPOCH 6 - PROGRESS: at 62.95% examples, 211365 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:32,225 : INFO : EPOCH 6 - PROGRESS: at 63.81% examples, 211243 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:33,258 : INFO : EPOCH 6 - PROGRESS: at 64.67% examples, 211227 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:34,291 : INFO : EPOCH 6 - PROGRESS: at 65.35% examples, 211193 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:35,346 : INFO : EPOCH 6 - PROGRESS: at 66.01% examples, 211117 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:36,411 : INFO : EPOCH 6 - PROGRESS: at 66.74% examples, 211073 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:37,450 : INFO : EPOCH 6 - PROGRESS: at 67.50% examples, 211033 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:38,451 : INFO : EPOCH 6 - PROGRESS: at 68.21% examples, 211017 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:39,484 : INFO : EPOCH 6 - PROGRESS: at 68.95% examples, 210997 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:40,497 : INFO : EPOCH 6 - PROGRESS: at 69.61% examples, 211009 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:41,508 : INFO : EPOCH 6 - PROGRESS: at 70.25% examples, 210964 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:42,510 : INFO : EPOCH 6 - PROGRESS: at 70.92% examples, 210947 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:43,537 : INFO : EPOCH 6 - PROGRESS: at 71.70% examples, 211016 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:44,592 : INFO : EPOCH 6 - PROGRESS: at 72.46% examples, 211025 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:45,623 : INFO : EPOCH 6 - PROGRESS: at 73.27% examples, 211072 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:46,630 : INFO : EPOCH 6 - PROGRESS: at 74.07% examples, 211106 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:47,691 : INFO : EPOCH 6 - PROGRESS: at 74.82% examples, 211159 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:48,694 : INFO : EPOCH 6 - PROGRESS: at 75.52% examples, 211346 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:49,720 : INFO : EPOCH 6 - PROGRESS: at 76.20% examples, 211393 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:50,772 : INFO : EPOCH 6 - PROGRESS: at 76.92% examples, 211403 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:15:51,792 : INFO : EPOCH 6 - PROGRESS: at 77.59% examples, 211458 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:52,809 : INFO : EPOCH 6 - PROGRESS: at 78.29% examples, 211536 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:15:53,809 : INFO : EPOCH 6 - PROGRESS: at 78.99% examples, 211564 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:54,849 : INFO : EPOCH 6 - PROGRESS: at 79.74% examples, 211538 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:15:55,853 : INFO : EPOCH 6 - PROGRESS: at 80.42% examples, 211574 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:15:56,896 : INFO : EPOCH 6 - PROGRESS: at 81.12% examples, 211591 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:57,943 : INFO : EPOCH 6 - PROGRESS: at 81.87% examples, 211548 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:58,954 : INFO : EPOCH 6 - PROGRESS: at 82.63% examples, 211628 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:15:59,993 : INFO : EPOCH 6 - PROGRESS: at 83.38% examples, 211655 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:01,009 : INFO : EPOCH 6 - PROGRESS: at 84.06% examples, 211661 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:02,032 : INFO : EPOCH 6 - PROGRESS: at 84.78% examples, 211822 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:03,084 : INFO : EPOCH 6 - PROGRESS: at 85.48% examples, 211820 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:16:04,130 : INFO : EPOCH 6 - PROGRESS: at 86.37% examples, 212008 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:05,156 : INFO : EPOCH 6 - PROGRESS: at 87.16% examples, 212003 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:06,173 : INFO : EPOCH 6 - PROGRESS: at 87.98% examples, 212065 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:07,174 : INFO : EPOCH 6 - PROGRESS: at 88.71% examples, 211989 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:08,199 : INFO : EPOCH 6 - PROGRESS: at 89.45% examples, 211986 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:09,223 : INFO : EPOCH 6 - PROGRESS: at 90.22% examples, 211982 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:10,267 : INFO : EPOCH 6 - PROGRESS: at 90.95% examples, 211891 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:11,269 : INFO : EPOCH 6 - PROGRESS: at 91.68% examples, 211867 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:12,298 : INFO : EPOCH 6 - PROGRESS: at 92.44% examples, 211856 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:13,361 : INFO : EPOCH 6 - PROGRESS: at 93.08% examples, 211733 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:14,363 : INFO : EPOCH 6 - PROGRESS: at 93.72% examples, 211500 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:15,376 : INFO : EPOCH 6 - PROGRESS: at 94.40% examples, 211360 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:16,421 : INFO : EPOCH 6 - PROGRESS: at 95.12% examples, 211277 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:17,558 : INFO : EPOCH 6 - PROGRESS: at 95.86% examples, 211110 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:18,583 : INFO : EPOCH 6 - PROGRESS: at 96.47% examples, 210797 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:19,585 : INFO : EPOCH 6 - PROGRESS: at 97.09% examples, 210623 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:20,626 : INFO : EPOCH 6 - PROGRESS: at 97.75% examples, 210436 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:16:21,686 : INFO : EPOCH 6 - PROGRESS: at 98.43% examples, 210242 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:22,716 : INFO : EPOCH 6 - PROGRESS: at 99.17% examples, 210195 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:23,549 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:16:23,556 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:16:23,557 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:16:23,586 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:16:23,612 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:16:23,613 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:16:23,637 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:16:23,681 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:16:23,706 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:16:23,707 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:16:23,707 : INFO : EPOCH - 6 : training on 41519355 raw words (30347870 effective words) took 144.3s, 210373 effective words/s
2020-04-16 18:16:24,725 : INFO : EPOCH 7 - PROGRESS: at 0.51% examples, 164891 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:25,770 : INFO : EPOCH 7 - PROGRESS: at 1.21% examples, 190117 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:26,803 : INFO : EPOCH 7 - PROGRESS: at 1.93% examples, 196341 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:27,829 : INFO : EPOCH 7 - PROGRESS: at 2.61% examples, 199898 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:28,877 : INFO : EPOCH 7 - PROGRESS: at 3.34% examples, 201237 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:29,905 : INFO : EPOCH 7 - PROGRESS: at 4.09% examples, 203998 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:30,924 : INFO : EPOCH 7 - PROGRESS: at 4.83% examples, 206284 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:31,935 : INFO : EPOCH 7 - PROGRESS: at 5.52% examples, 207056 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:32,935 : INFO : EPOCH 7 - PROGRESS: at 6.21% examples, 208014 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:33,936 : INFO : EPOCH 7 - PROGRESS: at 6.94% examples, 208766 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:34,967 : INFO : EPOCH 7 - PROGRESS: at 7.61% examples, 209453 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:35,974 : INFO : EPOCH 7 - PROGRESS: at 8.33% examples, 210416 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:16:36,986 : INFO : EPOCH 7 - PROGRESS: at 9.01% examples, 211742 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:16:38,011 : INFO : EPOCH 7 - PROGRESS: at 9.63% examples, 211601 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:39,078 : INFO : EPOCH 7 - PROGRESS: at 10.15% examples, 210897 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:40,087 : INFO : EPOCH 7 - PROGRESS: at 10.76% examples, 211125 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:41,108 : INFO : EPOCH 7 - PROGRESS: at 11.36% examples, 211107 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:16:42,131 : INFO : EPOCH 7 - PROGRESS: at 11.90% examples, 211482 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:43,168 : INFO : EPOCH 7 - PROGRESS: at 12.48% examples, 212012 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:44,168 : INFO : EPOCH 7 - PROGRESS: at 13.19% examples, 212264 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:45,244 : INFO : EPOCH 7 - PROGRESS: at 13.81% examples, 211959 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:16:46,264 : INFO : EPOCH 7 - PROGRESS: at 14.46% examples, 211946 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:47,331 : INFO : EPOCH 7 - PROGRESS: at 15.12% examples, 212468 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:48,340 : INFO : EPOCH 7 - PROGRESS: at 15.80% examples, 212593 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:49,350 : INFO : EPOCH 7 - PROGRESS: at 16.39% examples, 212641 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:50,390 : INFO : EPOCH 7 - PROGRESS: at 17.01% examples, 212703 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:51,397 : INFO : EPOCH 7 - PROGRESS: at 17.65% examples, 213865 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:52,428 : INFO : EPOCH 7 - PROGRESS: at 18.28% examples, 214164 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:16:53,438 : INFO : EPOCH 7 - PROGRESS: at 18.91% examples, 214611 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:54,469 : INFO : EPOCH 7 - PROGRESS: at 19.46% examples, 214853 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:16:55,484 : INFO : EPOCH 7 - PROGRESS: at 20.08% examples, 215407 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:16:56,497 : INFO : EPOCH 7 - PROGRESS: at 20.64% examples, 215788 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:57,500 : INFO : EPOCH 7 - PROGRESS: at 21.56% examples, 216103 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:58,504 : INFO : EPOCH 7 - PROGRESS: at 22.12% examples, 216060 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:16:59,536 : INFO : EPOCH 7 - PROGRESS: at 22.72% examples, 216082 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:00,545 : INFO : EPOCH 7 - PROGRESS: at 23.25% examples, 216030 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:01,562 : INFO : EPOCH 7 - PROGRESS: at 23.85% examples, 216472 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:17:02,611 : INFO : EPOCH 7 - PROGRESS: at 24.45% examples, 216540 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:03,697 : INFO : EPOCH 7 - PROGRESS: at 25.24% examples, 216237 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:04,710 : INFO : EPOCH 7 - PROGRESS: at 26.00% examples, 216183 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:05,772 : INFO : EPOCH 7 - PROGRESS: at 26.81% examples, 215881 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:17:06,795 : INFO : EPOCH 7 - PROGRESS: at 27.69% examples, 215951 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:17:07,827 : INFO : EPOCH 7 - PROGRESS: at 28.46% examples, 215811 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:17:08,838 : INFO : EPOCH 7 - PROGRESS: at 29.28% examples, 216070 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:09,845 : INFO : EPOCH 7 - PROGRESS: at 29.99% examples, 215877 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:10,909 : INFO : EPOCH 7 - PROGRESS: at 30.82% examples, 215773 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:11,935 : INFO : EPOCH 7 - PROGRESS: at 31.68% examples, 215666 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:12,952 : INFO : EPOCH 7 - PROGRESS: at 32.43% examples, 215590 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:13,956 : INFO : EPOCH 7 - PROGRESS: at 33.17% examples, 215582 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:14,990 : INFO : EPOCH 7 - PROGRESS: at 33.84% examples, 215472 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:15,994 : INFO : EPOCH 7 - PROGRESS: at 34.63% examples, 215501 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:17,018 : INFO : EPOCH 7 - PROGRESS: at 35.33% examples, 215422 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:18,035 : INFO : EPOCH 7 - PROGRESS: at 36.14% examples, 215388 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:19,047 : INFO : EPOCH 7 - PROGRESS: at 36.89% examples, 215346 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:20,098 : INFO : EPOCH 7 - PROGRESS: at 37.52% examples, 214648 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:21,157 : INFO : EPOCH 7 - PROGRESS: at 38.24% examples, 214057 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:22,183 : INFO : EPOCH 7 - PROGRESS: at 39.06% examples, 214128 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:23,188 : INFO : EPOCH 7 - PROGRESS: at 39.77% examples, 214152 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:24,192 : INFO : EPOCH 7 - PROGRESS: at 40.58% examples, 214286 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:25,207 : INFO : EPOCH 7 - PROGRESS: at 41.50% examples, 214514 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:26,212 : INFO : EPOCH 7 - PROGRESS: at 42.28% examples, 214502 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:27,219 : INFO : EPOCH 7 - PROGRESS: at 42.97% examples, 214394 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:28,257 : INFO : EPOCH 7 - PROGRESS: at 43.76% examples, 214202 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:17:29,273 : INFO : EPOCH 7 - PROGRESS: at 44.59% examples, 214185 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:17:30,283 : INFO : EPOCH 7 - PROGRESS: at 45.46% examples, 214396 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:31,322 : INFO : EPOCH 7 - PROGRESS: at 46.16% examples, 214090 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:17:32,337 : INFO : EPOCH 7 - PROGRESS: at 46.87% examples, 214161 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:33,367 : INFO : EPOCH 7 - PROGRESS: at 47.63% examples, 214105 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:34,378 : INFO : EPOCH 7 - PROGRESS: at 48.43% examples, 214410 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:35,384 : INFO : EPOCH 7 - PROGRESS: at 49.27% examples, 214522 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:36,391 : INFO : EPOCH 7 - PROGRESS: at 49.97% examples, 214421 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:17:37,437 : INFO : EPOCH 7 - PROGRESS: at 50.71% examples, 214310 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:17:38,503 : INFO : EPOCH 7 - PROGRESS: at 51.34% examples, 213750 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:39,515 : INFO : EPOCH 7 - PROGRESS: at 52.00% examples, 213539 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:40,555 : INFO : EPOCH 7 - PROGRESS: at 52.67% examples, 213368 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:41,594 : INFO : EPOCH 7 - PROGRESS: at 53.21% examples, 212827 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:42,601 : INFO : EPOCH 7 - PROGRESS: at 53.87% examples, 212583 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:43,602 : INFO : EPOCH 7 - PROGRESS: at 54.55% examples, 212378 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:17:44,686 : INFO : EPOCH 7 - PROGRESS: at 55.26% examples, 211850 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:17:45,763 : INFO : EPOCH 7 - PROGRESS: at 56.04% examples, 211711 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:17:46,792 : INFO : EPOCH 7 - PROGRESS: at 56.74% examples, 211613 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:47,832 : INFO : EPOCH 7 - PROGRESS: at 57.44% examples, 211326 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:17:48,887 : INFO : EPOCH 7 - PROGRESS: at 58.12% examples, 211152 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:49,890 : INFO : EPOCH 7 - PROGRESS: at 58.81% examples, 210960 words/s, in_qsize 18, out_qsize 0
2020-04-16 18:17:50,920 : INFO : EPOCH 7 - PROGRESS: at 59.55% examples, 210873 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:51,927 : INFO : EPOCH 7 - PROGRESS: at 60.28% examples, 210940 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:52,978 : INFO : EPOCH 7 - PROGRESS: at 61.05% examples, 210895 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:54,000 : INFO : EPOCH 7 - PROGRESS: at 61.68% examples, 210672 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:17:55,028 : INFO : EPOCH 7 - PROGRESS: at 62.34% examples, 210362 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:56,059 : INFO : EPOCH 7 - PROGRESS: at 63.03% examples, 210125 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:57,172 : INFO : EPOCH 7 - PROGRESS: at 63.90% examples, 209935 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:17:58,195 : INFO : EPOCH 7 - PROGRESS: at 64.69% examples, 209799 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:17:59,228 : INFO : EPOCH 7 - PROGRESS: at 65.37% examples, 209786 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:18:00,249 : INFO : EPOCH 7 - PROGRESS: at 66.09% examples, 209947 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:01,324 : INFO : EPOCH 7 - PROGRESS: at 66.87% examples, 210039 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:02,325 : INFO : EPOCH 7 - PROGRESS: at 67.71% examples, 210319 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:03,342 : INFO : EPOCH 7 - PROGRESS: at 68.41% examples, 210274 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:18:04,355 : INFO : EPOCH 7 - PROGRESS: at 69.17% examples, 210442 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:05,363 : INFO : EPOCH 7 - PROGRESS: at 69.88% examples, 210549 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:06,391 : INFO : EPOCH 7 - PROGRESS: at 70.57% examples, 210615 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:07,428 : INFO : EPOCH 7 - PROGRESS: at 71.27% examples, 210606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:08,493 : INFO : EPOCH 7 - PROGRESS: at 72.01% examples, 210598 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:09,579 : INFO : EPOCH 7 - PROGRESS: at 72.87% examples, 210614 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:18:10,666 : INFO : EPOCH 7 - PROGRESS: at 73.67% examples, 210493 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:11,688 : INFO : EPOCH 7 - PROGRESS: at 74.38% examples, 210499 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:18:12,714 : INFO : EPOCH 7 - PROGRESS: at 75.13% examples, 210692 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:13,725 : INFO : EPOCH 7 - PROGRESS: at 75.82% examples, 210730 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:14,729 : INFO : EPOCH 7 - PROGRESS: at 76.50% examples, 210889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:15,762 : INFO : EPOCH 7 - PROGRESS: at 77.24% examples, 211003 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:16,795 : INFO : EPOCH 7 - PROGRESS: at 77.95% examples, 211107 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:17,797 : INFO : EPOCH 7 - PROGRESS: at 78.67% examples, 211147 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:18,868 : INFO : EPOCH 7 - PROGRESS: at 79.39% examples, 211122 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:19,917 : INFO : EPOCH 7 - PROGRESS: at 80.12% examples, 211140 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:18:21,058 : INFO : EPOCH 7 - PROGRESS: at 80.81% examples, 210922 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:18:22,096 : INFO : EPOCH 7 - PROGRESS: at 81.43% examples, 210711 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:23,110 : INFO : EPOCH 7 - PROGRESS: at 82.05% examples, 210369 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:24,147 : INFO : EPOCH 7 - PROGRESS: at 82.78% examples, 210356 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:18:25,155 : INFO : EPOCH 7 - PROGRESS: at 83.50% examples, 210390 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:26,169 : INFO : EPOCH 7 - PROGRESS: at 84.20% examples, 210471 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:27,211 : INFO : EPOCH 7 - PROGRESS: at 84.89% examples, 210550 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:28,248 : INFO : EPOCH 7 - PROGRESS: at 85.59% examples, 210529 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:29,268 : INFO : EPOCH 7 - PROGRESS: at 86.37% examples, 210536 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:30,300 : INFO : EPOCH 7 - PROGRESS: at 87.16% examples, 210532 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:31,306 : INFO : EPOCH 7 - PROGRESS: at 87.95% examples, 210570 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:32,341 : INFO : EPOCH 7 - PROGRESS: at 88.71% examples, 210503 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:33,355 : INFO : EPOCH 7 - PROGRESS: at 89.45% examples, 210532 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:34,396 : INFO : EPOCH 7 - PROGRESS: at 90.23% examples, 210514 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:35,434 : INFO : EPOCH 7 - PROGRESS: at 90.98% examples, 210500 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:36,480 : INFO : EPOCH 7 - PROGRESS: at 91.74% examples, 210473 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:37,500 : INFO : EPOCH 7 - PROGRESS: at 92.49% examples, 210487 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:38,513 : INFO : EPOCH 7 - PROGRESS: at 93.15% examples, 210503 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:39,514 : INFO : EPOCH 7 - PROGRESS: at 93.87% examples, 210437 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:40,554 : INFO : EPOCH 7 - PROGRESS: at 94.62% examples, 210430 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:41,558 : INFO : EPOCH 7 - PROGRESS: at 95.39% examples, 210470 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:42,565 : INFO : EPOCH 7 - PROGRESS: at 96.12% examples, 210554 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:43,569 : INFO : EPOCH 7 - PROGRESS: at 96.82% examples, 210483 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:44,593 : INFO : EPOCH 7 - PROGRESS: at 97.53% examples, 210377 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:45,619 : INFO : EPOCH 7 - PROGRESS: at 98.26% examples, 210382 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:46,647 : INFO : EPOCH 7 - PROGRESS: at 99.02% examples, 210388 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:47,679 : INFO : EPOCH 7 - PROGRESS: at 99.79% examples, 210380 words/s, in_qsize 9, out_qsize 1
2020-04-16 18:18:47,680 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:18:47,696 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:18:47,702 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:18:47,717 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:18:47,719 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:18:47,747 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:18:47,753 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:18:47,789 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:18:47,808 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:18:47,820 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:18:47,821 : INFO : EPOCH - 7 : training on 41519355 raw words (30348682 effective words) took 144.1s, 210600 effective words/s
2020-04-16 18:18:48,845 : INFO : EPOCH 8 - PROGRESS: at 0.51% examples, 163648 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:49,857 : INFO : EPOCH 8 - PROGRESS: at 1.19% examples, 189128 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:50,888 : INFO : EPOCH 8 - PROGRESS: at 1.89% examples, 193599 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:18:51,888 : INFO : EPOCH 8 - PROGRESS: at 2.59% examples, 200889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:52,910 : INFO : EPOCH 8 - PROGRESS: at 3.32% examples, 203104 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:53,944 : INFO : EPOCH 8 - PROGRESS: at 4.06% examples, 205428 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:54,960 : INFO : EPOCH 8 - PROGRESS: at 4.81% examples, 207571 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:55,963 : INFO : EPOCH 8 - PROGRESS: at 5.52% examples, 209298 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:18:56,978 : INFO : EPOCH 8 - PROGRESS: at 6.18% examples, 208866 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:57,995 : INFO : EPOCH 8 - PROGRESS: at 6.91% examples, 209157 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:18:59,006 : INFO : EPOCH 8 - PROGRESS: at 7.58% examples, 209560 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:00,038 : INFO : EPOCH 8 - PROGRESS: at 8.23% examples, 208900 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:01,078 : INFO : EPOCH 8 - PROGRESS: at 8.89% examples, 208775 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:02,089 : INFO : EPOCH 8 - PROGRESS: at 9.50% examples, 209112 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:19:03,107 : INFO : EPOCH 8 - PROGRESS: at 10.04% examples, 209252 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:04,121 : INFO : EPOCH 8 - PROGRESS: at 10.67% examples, 209574 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:05,132 : INFO : EPOCH 8 - PROGRESS: at 11.24% examples, 210121 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:06,166 : INFO : EPOCH 8 - PROGRESS: at 11.76% examples, 210050 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:07,181 : INFO : EPOCH 8 - PROGRESS: at 12.36% examples, 210485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:08,191 : INFO : EPOCH 8 - PROGRESS: at 13.01% examples, 210697 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:09,198 : INFO : EPOCH 8 - PROGRESS: at 13.69% examples, 210872 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:19:10,224 : INFO : EPOCH 8 - PROGRESS: at 14.30% examples, 211158 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:11,241 : INFO : EPOCH 8 - PROGRESS: at 14.94% examples, 211557 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:12,260 : INFO : EPOCH 8 - PROGRESS: at 15.73% examples, 212794 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:13,300 : INFO : EPOCH 8 - PROGRESS: at 16.31% examples, 212857 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:14,300 : INFO : EPOCH 8 - PROGRESS: at 16.92% examples, 212979 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:15,304 : INFO : EPOCH 8 - PROGRESS: at 17.47% examples, 213090 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:16,340 : INFO : EPOCH 8 - PROGRESS: at 18.09% examples, 213145 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:17,377 : INFO : EPOCH 8 - PROGRESS: at 18.70% examples, 213197 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:19:18,396 : INFO : EPOCH 8 - PROGRESS: at 19.24% examples, 213070 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:19,405 : INFO : EPOCH 8 - PROGRESS: at 19.79% examples, 213091 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:19:20,427 : INFO : EPOCH 8 - PROGRESS: at 20.36% examples, 213213 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:21,438 : INFO : EPOCH 8 - PROGRESS: at 20.87% examples, 213018 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:22,447 : INFO : EPOCH 8 - PROGRESS: at 21.80% examples, 213565 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:23,468 : INFO : EPOCH 8 - PROGRESS: at 22.29% examples, 212697 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:24,483 : INFO : EPOCH 8 - PROGRESS: at 22.86% examples, 212514 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:25,486 : INFO : EPOCH 8 - PROGRESS: at 23.35% examples, 212216 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:26,536 : INFO : EPOCH 8 - PROGRESS: at 23.93% examples, 212583 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:27,562 : INFO : EPOCH 8 - PROGRESS: at 24.53% examples, 212884 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:28,592 : INFO : EPOCH 8 - PROGRESS: at 25.39% examples, 213171 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:29,615 : INFO : EPOCH 8 - PROGRESS: at 26.16% examples, 212983 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:30,633 : INFO : EPOCH 8 - PROGRESS: at 26.95% examples, 212979 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:31,642 : INFO : EPOCH 8 - PROGRESS: at 27.82% examples, 213017 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:32,663 : INFO : EPOCH 8 - PROGRESS: at 28.54% examples, 212846 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:33,671 : INFO : EPOCH 8 - PROGRESS: at 29.30% examples, 212865 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:34,698 : INFO : EPOCH 8 - PROGRESS: at 30.04% examples, 212813 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:19:35,715 : INFO : EPOCH 8 - PROGRESS: at 30.79% examples, 212535 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:36,767 : INFO : EPOCH 8 - PROGRESS: at 31.65% examples, 212377 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:19:37,803 : INFO : EPOCH 8 - PROGRESS: at 32.40% examples, 212297 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:38,827 : INFO : EPOCH 8 - PROGRESS: at 33.17% examples, 212407 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:39,842 : INFO : EPOCH 8 - PROGRESS: at 33.84% examples, 212436 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:40,863 : INFO : EPOCH 8 - PROGRESS: at 34.63% examples, 212456 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:41,880 : INFO : EPOCH 8 - PROGRESS: at 35.31% examples, 212324 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:19:42,929 : INFO : EPOCH 8 - PROGRESS: at 36.12% examples, 212231 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:43,983 : INFO : EPOCH 8 - PROGRESS: at 36.86% examples, 212077 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:45,011 : INFO : EPOCH 8 - PROGRESS: at 37.60% examples, 212035 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:46,035 : INFO : EPOCH 8 - PROGRESS: at 38.44% examples, 212125 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:47,048 : INFO : EPOCH 8 - PROGRESS: at 39.16% examples, 211913 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:48,098 : INFO : EPOCH 8 - PROGRESS: at 39.89% examples, 211810 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:49,172 : INFO : EPOCH 8 - PROGRESS: at 40.65% examples, 211626 words/s, in_qsize 17, out_qsize 3
2020-04-16 18:19:50,183 : INFO : EPOCH 8 - PROGRESS: at 41.53% examples, 211672 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:51,216 : INFO : EPOCH 8 - PROGRESS: at 42.30% examples, 211614 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:52,264 : INFO : EPOCH 8 - PROGRESS: at 43.04% examples, 211532 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:19:53,306 : INFO : EPOCH 8 - PROGRESS: at 43.96% examples, 211929 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:54,307 : INFO : EPOCH 8 - PROGRESS: at 44.79% examples, 211981 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:19:55,328 : INFO : EPOCH 8 - PROGRESS: at 45.60% examples, 212086 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:19:56,350 : INFO : EPOCH 8 - PROGRESS: at 46.36% examples, 212184 words/s, in_qsize 18, out_qsize 2
2020-04-16 18:19:57,366 : INFO : EPOCH 8 - PROGRESS: at 47.10% examples, 212379 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:19:58,392 : INFO : EPOCH 8 - PROGRESS: at 47.84% examples, 212264 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:19:59,405 : INFO : EPOCH 8 - PROGRESS: at 48.56% examples, 212179 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:00,433 : INFO : EPOCH 8 - PROGRESS: at 49.34% examples, 212044 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:01,495 : INFO : EPOCH 8 - PROGRESS: at 50.08% examples, 211921 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:20:02,510 : INFO : EPOCH 8 - PROGRESS: at 50.83% examples, 211939 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:03,582 : INFO : EPOCH 8 - PROGRESS: at 51.56% examples, 211772 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:20:04,612 : INFO : EPOCH 8 - PROGRESS: at 52.25% examples, 211740 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:20:05,727 : INFO : EPOCH 8 - PROGRESS: at 52.90% examples, 211489 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:06,728 : INFO : EPOCH 8 - PROGRESS: at 53.59% examples, 211538 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:20:07,745 : INFO : EPOCH 8 - PROGRESS: at 54.40% examples, 211752 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:20:08,819 : INFO : EPOCH 8 - PROGRESS: at 55.26% examples, 211805 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:20:09,822 : INFO : EPOCH 8 - PROGRESS: at 56.04% examples, 211858 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:10,872 : INFO : EPOCH 8 - PROGRESS: at 56.79% examples, 211882 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:11,916 : INFO : EPOCH 8 - PROGRESS: at 57.56% examples, 211833 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:12,923 : INFO : EPOCH 8 - PROGRESS: at 58.25% examples, 211776 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:13,958 : INFO : EPOCH 8 - PROGRESS: at 58.91% examples, 211414 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:20:14,972 : INFO : EPOCH 8 - PROGRESS: at 59.70% examples, 211525 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:16,004 : INFO : EPOCH 8 - PROGRESS: at 60.40% examples, 211444 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:20:17,025 : INFO : EPOCH 8 - PROGRESS: at 61.17% examples, 211458 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:18,048 : INFO : EPOCH 8 - PROGRESS: at 61.89% examples, 211470 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:19,050 : INFO : EPOCH 8 - PROGRESS: at 62.62% examples, 211438 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:20:20,062 : INFO : EPOCH 8 - PROGRESS: at 63.41% examples, 211403 words/s, in_qsize 18, out_qsize 3
2020-04-16 18:20:21,096 : INFO : EPOCH 8 - PROGRESS: at 64.36% examples, 211608 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:22,240 : INFO : EPOCH 8 - PROGRESS: at 65.13% examples, 211400 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:23,243 : INFO : EPOCH 8 - PROGRESS: at 65.87% examples, 211742 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:24,286 : INFO : EPOCH 8 - PROGRESS: at 66.61% examples, 211746 words/s, in_qsize 17, out_qsize 4
2020-04-16 18:20:25,298 : INFO : EPOCH 8 - PROGRESS: at 67.25% examples, 211451 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:26,381 : INFO : EPOCH 8 - PROGRESS: at 67.98% examples, 211256 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:27,399 : INFO : EPOCH 8 - PROGRESS: at 68.69% examples, 211263 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:28,408 : INFO : EPOCH 8 - PROGRESS: at 69.38% examples, 211286 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:29,441 : INFO : EPOCH 8 - PROGRESS: at 70.04% examples, 211269 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:30,486 : INFO : EPOCH 8 - PROGRESS: at 70.76% examples, 211230 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:31,519 : INFO : EPOCH 8 - PROGRESS: at 71.50% examples, 211215 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:32,531 : INFO : EPOCH 8 - PROGRESS: at 72.23% examples, 211313 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:33,559 : INFO : EPOCH 8 - PROGRESS: at 73.02% examples, 211295 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:34,561 : INFO : EPOCH 8 - PROGRESS: at 73.81% examples, 211337 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:35,570 : INFO : EPOCH 8 - PROGRESS: at 74.51% examples, 211363 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:36,630 : INFO : EPOCH 8 - PROGRESS: at 75.26% examples, 211423 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:37,722 : INFO : EPOCH 8 - PROGRESS: at 75.95% examples, 211359 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:20:38,750 : INFO : EPOCH 8 - PROGRESS: at 76.63% examples, 211403 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:20:39,765 : INFO : EPOCH 8 - PROGRESS: at 77.31% examples, 211416 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:40,777 : INFO : EPOCH 8 - PROGRESS: at 77.97% examples, 211428 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:20:41,784 : INFO : EPOCH 8 - PROGRESS: at 78.69% examples, 211455 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:20:42,794 : INFO : EPOCH 8 - PROGRESS: at 79.43% examples, 211546 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:43,818 : INFO : EPOCH 8 - PROGRESS: at 80.14% examples, 211605 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:44,824 : INFO : EPOCH 8 - PROGRESS: at 80.83% examples, 211628 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:45,896 : INFO : EPOCH 8 - PROGRESS: at 81.56% examples, 211597 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:47,014 : INFO : EPOCH 8 - PROGRESS: at 82.34% examples, 211481 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:48,031 : INFO : EPOCH 8 - PROGRESS: at 83.09% examples, 211556 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:49,043 : INFO : EPOCH 8 - PROGRESS: at 83.78% examples, 211571 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:50,070 : INFO : EPOCH 8 - PROGRESS: at 84.45% examples, 211551 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:51,071 : INFO : EPOCH 8 - PROGRESS: at 85.17% examples, 211698 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:52,081 : INFO : EPOCH 8 - PROGRESS: at 85.94% examples, 211770 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:53,103 : INFO : EPOCH 8 - PROGRESS: at 86.78% examples, 211943 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:54,103 : INFO : EPOCH 8 - PROGRESS: at 87.64% examples, 212101 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:55,162 : INFO : EPOCH 8 - PROGRESS: at 88.43% examples, 212089 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:56,188 : INFO : EPOCH 8 - PROGRESS: at 89.21% examples, 212089 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:57,249 : INFO : EPOCH 8 - PROGRESS: at 90.01% examples, 212135 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:20:58,264 : INFO : EPOCH 8 - PROGRESS: at 90.81% examples, 212204 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:20:59,302 : INFO : EPOCH 8 - PROGRESS: at 91.53% examples, 212119 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:00,307 : INFO : EPOCH 8 - PROGRESS: at 92.23% examples, 211981 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:01,343 : INFO : EPOCH 8 - PROGRESS: at 92.84% examples, 211788 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:21:02,378 : INFO : EPOCH 8 - PROGRESS: at 93.57% examples, 211765 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:21:03,382 : INFO : EPOCH 8 - PROGRESS: at 94.28% examples, 211691 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:04,421 : INFO : EPOCH 8 - PROGRESS: at 95.01% examples, 211666 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:05,431 : INFO : EPOCH 8 - PROGRESS: at 95.80% examples, 211745 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:21:06,456 : INFO : EPOCH 8 - PROGRESS: at 96.63% examples, 211999 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:07,521 : INFO : EPOCH 8 - PROGRESS: at 97.50% examples, 212128 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:08,523 : INFO : EPOCH 8 - PROGRESS: at 98.28% examples, 212256 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:09,538 : INFO : EPOCH 8 - PROGRESS: at 99.16% examples, 212475 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:10,362 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:21:10,370 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:21:10,375 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:21:10,407 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:21:10,409 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:21:10,419 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:21:10,426 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:21:10,463 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:21:10,464 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:21:10,488 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:21:10,489 : INFO : EPOCH - 8 : training on 41519355 raw words (30351303 effective words) took 142.7s, 212751 effective words/s
2020-04-16 18:21:11,505 : INFO : EPOCH 9 - PROGRESS: at 0.66% examples, 207852 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:12,590 : INFO : EPOCH 9 - PROGRESS: at 1.38% examples, 210714 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:13,673 : INFO : EPOCH 9 - PROGRESS: at 2.11% examples, 208955 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:14,679 : INFO : EPOCH 9 - PROGRESS: at 2.98% examples, 220668 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:15,710 : INFO : EPOCH 9 - PROGRESS: at 3.75% examples, 222747 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:16,787 : INFO : EPOCH 9 - PROGRESS: at 4.54% examples, 223692 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:17,794 : INFO : EPOCH 9 - PROGRESS: at 5.38% examples, 227298 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:18,830 : INFO : EPOCH 9 - PROGRESS: at 6.12% examples, 226625 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:21:19,838 : INFO : EPOCH 9 - PROGRESS: at 6.94% examples, 228374 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:20,852 : INFO : EPOCH 9 - PROGRESS: at 7.68% examples, 229590 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:21,890 : INFO : EPOCH 9 - PROGRESS: at 8.46% examples, 229493 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:22,927 : INFO : EPOCH 9 - PROGRESS: at 9.17% examples, 230009 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:21:23,932 : INFO : EPOCH 9 - PROGRESS: at 9.79% examples, 230387 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:24,972 : INFO : EPOCH 9 - PROGRESS: at 10.35% examples, 228803 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:25,983 : INFO : EPOCH 9 - PROGRESS: at 10.97% examples, 228264 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:26,991 : INFO : EPOCH 9 - PROGRESS: at 11.44% examples, 224763 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:28,096 : INFO : EPOCH 9 - PROGRESS: at 11.96% examples, 222488 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:29,110 : INFO : EPOCH 9 - PROGRESS: at 12.56% examples, 223109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:30,188 : INFO : EPOCH 9 - PROGRESS: at 13.34% examples, 222972 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:31,253 : INFO : EPOCH 9 - PROGRESS: at 14.03% examples, 223317 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:21:32,290 : INFO : EPOCH 9 - PROGRESS: at 14.80% examples, 224914 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:33,303 : INFO : EPOCH 9 - PROGRESS: at 15.49% examples, 224756 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:34,338 : INFO : EPOCH 9 - PROGRESS: at 16.08% examples, 223816 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:35,366 : INFO : EPOCH 9 - PROGRESS: at 16.72% examples, 224086 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:36,393 : INFO : EPOCH 9 - PROGRESS: at 17.40% examples, 224970 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:21:37,394 : INFO : EPOCH 9 - PROGRESS: at 18.05% examples, 225410 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:38,516 : INFO : EPOCH 9 - PROGRESS: at 18.73% examples, 225080 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:39,548 : INFO : EPOCH 9 - PROGRESS: at 19.26% examples, 224444 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:40,573 : INFO : EPOCH 9 - PROGRESS: at 19.81% examples, 223972 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:41,617 : INFO : EPOCH 9 - PROGRESS: at 20.36% examples, 223347 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:42,660 : INFO : EPOCH 9 - PROGRESS: at 20.96% examples, 223732 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:21:43,712 : INFO : EPOCH 9 - PROGRESS: at 21.85% examples, 223246 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:44,728 : INFO : EPOCH 9 - PROGRESS: at 22.46% examples, 223157 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:45,794 : INFO : EPOCH 9 - PROGRESS: at 23.07% examples, 223347 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:46,861 : INFO : EPOCH 9 - PROGRESS: at 23.73% examples, 223927 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:47,865 : INFO : EPOCH 9 - PROGRESS: at 24.29% examples, 223677 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:48,932 : INFO : EPOCH 9 - PROGRESS: at 25.05% examples, 223650 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:21:49,986 : INFO : EPOCH 9 - PROGRESS: at 25.91% examples, 223711 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:21:51,007 : INFO : EPOCH 9 - PROGRESS: at 26.77% examples, 223793 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:52,072 : INFO : EPOCH 9 - PROGRESS: at 27.75% examples, 224136 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:21:53,139 : INFO : EPOCH 9 - PROGRESS: at 28.58% examples, 224115 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:54,187 : INFO : EPOCH 9 - PROGRESS: at 29.50% examples, 224651 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:55,194 : INFO : EPOCH 9 - PROGRESS: at 30.31% examples, 224916 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:56,248 : INFO : EPOCH 9 - PROGRESS: at 31.26% examples, 224964 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:57,259 : INFO : EPOCH 9 - PROGRESS: at 32.05% examples, 224857 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:58,264 : INFO : EPOCH 9 - PROGRESS: at 32.76% examples, 224206 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:21:59,270 : INFO : EPOCH 9 - PROGRESS: at 33.46% examples, 223868 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:00,317 : INFO : EPOCH 9 - PROGRESS: at 34.09% examples, 223236 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:01,328 : INFO : EPOCH 9 - PROGRESS: at 34.81% examples, 222931 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:02,392 : INFO : EPOCH 9 - PROGRESS: at 35.59% examples, 222538 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:03,414 : INFO : EPOCH 9 - PROGRESS: at 36.38% examples, 222321 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:04,439 : INFO : EPOCH 9 - PROGRESS: at 37.10% examples, 222123 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:05,481 : INFO : EPOCH 9 - PROGRESS: at 37.88% examples, 221833 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:06,496 : INFO : EPOCH 9 - PROGRESS: at 38.67% examples, 221667 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:07,580 : INFO : EPOCH 9 - PROGRESS: at 39.44% examples, 221260 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:22:08,633 : INFO : EPOCH 9 - PROGRESS: at 40.21% examples, 220968 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:22:09,635 : INFO : EPOCH 9 - PROGRESS: at 40.96% examples, 220889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:10,640 : INFO : EPOCH 9 - PROGRESS: at 41.98% examples, 221397 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:11,675 : INFO : EPOCH 9 - PROGRESS: at 42.76% examples, 221635 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:12,715 : INFO : EPOCH 9 - PROGRESS: at 43.59% examples, 221532 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:13,718 : INFO : EPOCH 9 - PROGRESS: at 44.49% examples, 221672 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:14,724 : INFO : EPOCH 9 - PROGRESS: at 45.25% examples, 221453 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:15,745 : INFO : EPOCH 9 - PROGRESS: at 46.09% examples, 221526 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:16,755 : INFO : EPOCH 9 - PROGRESS: at 46.81% examples, 221498 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:22:17,781 : INFO : EPOCH 9 - PROGRESS: at 47.63% examples, 221766 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:18,802 : INFO : EPOCH 9 - PROGRESS: at 48.41% examples, 221718 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:19,834 : INFO : EPOCH 9 - PROGRESS: at 49.31% examples, 221949 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:20,842 : INFO : EPOCH 9 - PROGRESS: at 50.11% examples, 222042 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:21,901 : INFO : EPOCH 9 - PROGRESS: at 50.95% examples, 222190 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:22,908 : INFO : EPOCH 9 - PROGRESS: at 51.77% examples, 222457 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:23,967 : INFO : EPOCH 9 - PROGRESS: at 52.54% examples, 222478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:24,996 : INFO : EPOCH 9 - PROGRESS: at 53.31% examples, 222882 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:26,062 : INFO : EPOCH 9 - PROGRESS: at 54.15% examples, 222988 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:22:27,070 : INFO : EPOCH 9 - PROGRESS: at 55.04% examples, 223367 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:28,138 : INFO : EPOCH 9 - PROGRESS: at 55.93% examples, 223265 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:29,208 : INFO : EPOCH 9 - PROGRESS: at 56.65% examples, 222989 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:30,247 : INFO : EPOCH 9 - PROGRESS: at 57.41% examples, 222812 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:31,261 : INFO : EPOCH 9 - PROGRESS: at 58.15% examples, 222770 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:32,290 : INFO : EPOCH 9 - PROGRESS: at 59.01% examples, 222973 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:33,303 : INFO : EPOCH 9 - PROGRESS: at 59.85% examples, 223221 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:34,309 : INFO : EPOCH 9 - PROGRESS: at 60.68% examples, 223402 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:35,323 : INFO : EPOCH 9 - PROGRESS: at 61.49% examples, 223547 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:36,326 : INFO : EPOCH 9 - PROGRESS: at 62.25% examples, 223547 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:37,364 : INFO : EPOCH 9 - PROGRESS: at 63.11% examples, 223617 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:38,399 : INFO : EPOCH 9 - PROGRESS: at 64.11% examples, 223769 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:39,420 : INFO : EPOCH 9 - PROGRESS: at 64.94% examples, 223701 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:40,422 : INFO : EPOCH 9 - PROGRESS: at 65.65% examples, 223855 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:41,440 : INFO : EPOCH 9 - PROGRESS: at 66.41% examples, 223865 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:22:42,465 : INFO : EPOCH 9 - PROGRESS: at 67.28% examples, 224179 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:43,528 : INFO : EPOCH 9 - PROGRESS: at 68.13% examples, 224245 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:44,557 : INFO : EPOCH 9 - PROGRESS: at 69.02% examples, 224625 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:45,569 : INFO : EPOCH 9 - PROGRESS: at 69.79% examples, 224802 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:46,592 : INFO : EPOCH 9 - PROGRESS: at 70.53% examples, 224881 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:22:47,664 : INFO : EPOCH 9 - PROGRESS: at 71.36% examples, 225013 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:22:48,670 : INFO : EPOCH 9 - PROGRESS: at 72.23% examples, 225356 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:49,738 : INFO : EPOCH 9 - PROGRESS: at 73.11% examples, 225390 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:22:50,744 : INFO : EPOCH 9 - PROGRESS: at 74.07% examples, 225714 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:51,818 : INFO : EPOCH 9 - PROGRESS: at 74.86% examples, 225735 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:52,844 : INFO : EPOCH 9 - PROGRESS: at 75.64% examples, 225946 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:22:53,895 : INFO : EPOCH 9 - PROGRESS: at 76.40% examples, 226145 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:54,903 : INFO : EPOCH 9 - PROGRESS: at 77.19% examples, 226309 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:55,923 : INFO : EPOCH 9 - PROGRESS: at 77.98% examples, 226570 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:22:56,932 : INFO : EPOCH 9 - PROGRESS: at 78.75% examples, 226584 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:57,943 : INFO : EPOCH 9 - PROGRESS: at 79.59% examples, 226799 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:58,983 : INFO : EPOCH 9 - PROGRESS: at 80.41% examples, 226955 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:22:59,991 : INFO : EPOCH 9 - PROGRESS: at 81.18% examples, 227099 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:00,994 : INFO : EPOCH 9 - PROGRESS: at 82.05% examples, 227323 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:01,995 : INFO : EPOCH 9 - PROGRESS: at 82.82% examples, 227350 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:03,071 : INFO : EPOCH 9 - PROGRESS: at 83.59% examples, 227290 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:04,081 : INFO : EPOCH 9 - PROGRESS: at 84.43% examples, 227609 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:05,153 : INFO : EPOCH 9 - PROGRESS: at 85.17% examples, 227545 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:06,205 : INFO : EPOCH 9 - PROGRESS: at 86.09% examples, 227838 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:07,229 : INFO : EPOCH 9 - PROGRESS: at 87.03% examples, 228004 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:08,262 : INFO : EPOCH 9 - PROGRESS: at 87.95% examples, 228151 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:09,285 : INFO : EPOCH 9 - PROGRESS: at 88.84% examples, 228256 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:10,310 : INFO : EPOCH 9 - PROGRESS: at 89.68% examples, 228353 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:11,332 : INFO : EPOCH 9 - PROGRESS: at 90.54% examples, 228460 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:12,360 : INFO : EPOCH 9 - PROGRESS: at 91.41% examples, 228543 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:13,365 : INFO : EPOCH 9 - PROGRESS: at 92.29% examples, 228674 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:14,381 : INFO : EPOCH 9 - PROGRESS: at 93.06% examples, 228834 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:15,429 : INFO : EPOCH 9 - PROGRESS: at 93.85% examples, 228702 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:16,429 : INFO : EPOCH 9 - PROGRESS: at 94.74% examples, 228959 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:17,515 : INFO : EPOCH 9 - PROGRESS: at 95.62% examples, 228939 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:18,561 : INFO : EPOCH 9 - PROGRESS: at 96.46% examples, 229041 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:23:19,573 : INFO : EPOCH 9 - PROGRESS: at 97.35% examples, 229187 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:20,604 : INFO : EPOCH 9 - PROGRESS: at 98.13% examples, 229193 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:21,609 : INFO : EPOCH 9 - PROGRESS: at 99.00% examples, 229313 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:23:22,537 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:23:22,544 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:23:22,554 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:23:22,650 : INFO : EPOCH 9 - PROGRESS: at 99.86% examples, 229334 words/s, in_qsize 6, out_qsize 1
2020-04-16 18:23:22,651 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:23:22,659 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:23:22,663 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:23:22,672 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:23:22,704 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:23:22,712 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:23:22,719 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:23:22,720 : INFO : EPOCH - 9 : training on 41519355 raw words (30351077 effective words) took 132.2s, 229540 effective words/s
2020-04-16 18:23:23,844 : INFO : EPOCH 10 - PROGRESS: at 0.69% examples, 201113 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:24,848 : INFO : EPOCH 10 - PROGRESS: at 1.52% examples, 228460 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:25,865 : INFO : EPOCH 10 - PROGRESS: at 2.32% examples, 234565 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:26,873 : INFO : EPOCH 10 - PROGRESS: at 3.13% examples, 233311 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:23:27,901 : INFO : EPOCH 10 - PROGRESS: at 3.99% examples, 238605 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:28,953 : INFO : EPOCH 10 - PROGRESS: at 4.78% examples, 236632 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:29,966 : INFO : EPOCH 10 - PROGRESS: at 5.52% examples, 235241 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:30,988 : INFO : EPOCH 10 - PROGRESS: at 6.18% examples, 231358 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:31,991 : INFO : EPOCH 10 - PROGRESS: at 6.89% examples, 228808 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:33,043 : INFO : EPOCH 10 - PROGRESS: at 7.66% examples, 229865 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:34,141 : INFO : EPOCH 10 - PROGRESS: at 8.48% examples, 229812 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:23:35,194 : INFO : EPOCH 10 - PROGRESS: at 9.24% examples, 231156 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:23:36,195 : INFO : EPOCH 10 - PROGRESS: at 9.85% examples, 232107 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:37,227 : INFO : EPOCH 10 - PROGRESS: at 10.59% examples, 233552 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:38,227 : INFO : EPOCH 10 - PROGRESS: at 11.24% examples, 234614 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:39,270 : INFO : EPOCH 10 - PROGRESS: at 11.88% examples, 235063 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:40,304 : INFO : EPOCH 10 - PROGRESS: at 12.50% examples, 235101 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:23:41,333 : INFO : EPOCH 10 - PROGRESS: at 13.34% examples, 236075 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:42,386 : INFO : EPOCH 10 - PROGRESS: at 14.03% examples, 235852 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:23:43,403 : INFO : EPOCH 10 - PROGRESS: at 14.78% examples, 236781 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:44,426 : INFO : EPOCH 10 - PROGRESS: at 15.52% examples, 236955 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:45,452 : INFO : EPOCH 10 - PROGRESS: at 16.26% examples, 237680 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:23:46,464 : INFO : EPOCH 10 - PROGRESS: at 16.96% examples, 238160 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:47,481 : INFO : EPOCH 10 - PROGRESS: at 17.63% examples, 238902 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:48,514 : INFO : EPOCH 10 - PROGRESS: at 18.31% examples, 239046 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:49,538 : INFO : EPOCH 10 - PROGRESS: at 19.02% examples, 239796 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:50,581 : INFO : EPOCH 10 - PROGRESS: at 19.66% examples, 239811 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:51,620 : INFO : EPOCH 10 - PROGRESS: at 20.36% examples, 240589 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:52,651 : INFO : EPOCH 10 - PROGRESS: at 21.03% examples, 241448 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:23:53,696 : INFO : EPOCH 10 - PROGRESS: at 22.05% examples, 241793 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:54,702 : INFO : EPOCH 10 - PROGRESS: at 22.75% examples, 242298 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:55,704 : INFO : EPOCH 10 - PROGRESS: at 23.35% examples, 242365 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:23:56,746 : INFO : EPOCH 10 - PROGRESS: at 23.95% examples, 242125 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:23:57,770 : INFO : EPOCH 10 - PROGRESS: at 24.67% examples, 242639 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:58,797 : INFO : EPOCH 10 - PROGRESS: at 25.58% examples, 242312 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:23:59,799 : INFO : EPOCH 10 - PROGRESS: at 26.53% examples, 242592 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:24:00,833 : INFO : EPOCH 10 - PROGRESS: at 27.37% examples, 242078 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:24:01,837 : INFO : EPOCH 10 - PROGRESS: at 28.31% examples, 242330 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:02,917 : INFO : EPOCH 10 - PROGRESS: at 29.21% examples, 242089 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:24:03,927 : INFO : EPOCH 10 - PROGRESS: at 30.02% examples, 241918 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:04,987 : INFO : EPOCH 10 - PROGRESS: at 31.01% examples, 242206 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:06,046 : INFO : EPOCH 10 - PROGRESS: at 31.98% examples, 242097 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:24:07,048 : INFO : EPOCH 10 - PROGRESS: at 32.93% examples, 242635 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:08,059 : INFO : EPOCH 10 - PROGRESS: at 33.64% examples, 242166 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:09,082 : INFO : EPOCH 10 - PROGRESS: at 34.47% examples, 241981 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:10,084 : INFO : EPOCH 10 - PROGRESS: at 35.29% examples, 242200 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:11,104 : INFO : EPOCH 10 - PROGRESS: at 36.14% examples, 241870 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:24:12,114 : INFO : EPOCH 10 - PROGRESS: at 36.97% examples, 241735 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:13,121 : INFO : EPOCH 10 - PROGRESS: at 37.88% examples, 242039 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:14,160 : INFO : EPOCH 10 - PROGRESS: at 38.75% examples, 241769 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:15,179 : INFO : EPOCH 10 - PROGRESS: at 39.53% examples, 241483 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:16,210 : INFO : EPOCH 10 - PROGRESS: at 40.47% examples, 241801 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:17,224 : INFO : EPOCH 10 - PROGRESS: at 41.38% examples, 241558 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:18,244 : INFO : EPOCH 10 - PROGRESS: at 42.30% examples, 241640 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:24:19,253 : INFO : EPOCH 10 - PROGRESS: at 43.22% examples, 241917 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:20,269 : INFO : EPOCH 10 - PROGRESS: at 44.12% examples, 241920 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:21,287 : INFO : EPOCH 10 - PROGRESS: at 45.06% examples, 242017 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:22,335 : INFO : EPOCH 10 - PROGRESS: at 45.93% examples, 241761 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:23,349 : INFO : EPOCH 10 - PROGRESS: at 46.73% examples, 241742 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:24,376 : INFO : EPOCH 10 - PROGRESS: at 47.56% examples, 241685 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:25,410 : INFO : EPOCH 10 - PROGRESS: at 48.41% examples, 241608 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:26,439 : INFO : EPOCH 10 - PROGRESS: at 49.31% examples, 241546 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:27,475 : INFO : EPOCH 10 - PROGRESS: at 50.11% examples, 241242 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:28,489 : INFO : EPOCH 10 - PROGRESS: at 50.97% examples, 241362 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:29,490 : INFO : EPOCH 10 - PROGRESS: at 51.77% examples, 241281 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:30,537 : INFO : EPOCH 10 - PROGRESS: at 52.55% examples, 241059 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:31,556 : INFO : EPOCH 10 - PROGRESS: at 53.31% examples, 241248 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:32,581 : INFO : EPOCH 10 - PROGRESS: at 54.03% examples, 240708 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:33,597 : INFO : EPOCH 10 - PROGRESS: at 54.77% examples, 240437 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:34,696 : INFO : EPOCH 10 - PROGRESS: at 55.75% examples, 240265 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:35,705 : INFO : EPOCH 10 - PROGRESS: at 56.55% examples, 240217 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:24:36,708 : INFO : EPOCH 10 - PROGRESS: at 57.46% examples, 240388 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:24:37,750 : INFO : EPOCH 10 - PROGRESS: at 58.23% examples, 240122 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:38,770 : INFO : EPOCH 10 - PROGRESS: at 59.07% examples, 240041 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:39,776 : INFO : EPOCH 10 - PROGRESS: at 59.90% examples, 240114 words/s, in_qsize 16, out_qsize 1
2020-04-16 18:24:40,776 : INFO : EPOCH 10 - PROGRESS: at 60.71% examples, 240014 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:41,818 : INFO : EPOCH 10 - PROGRESS: at 61.49% examples, 239775 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:24:42,936 : INFO : EPOCH 10 - PROGRESS: at 62.31% examples, 239412 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:24:43,946 : INFO : EPOCH 10 - PROGRESS: at 63.36% examples, 239911 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:45,016 : INFO : EPOCH 10 - PROGRESS: at 64.26% examples, 239504 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:46,030 : INFO : EPOCH 10 - PROGRESS: at 65.19% examples, 239867 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:47,057 : INFO : EPOCH 10 - PROGRESS: at 65.91% examples, 239757 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:48,061 : INFO : EPOCH 10 - PROGRESS: at 66.80% examples, 240108 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:49,097 : INFO : EPOCH 10 - PROGRESS: at 67.63% examples, 239898 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:50,126 : INFO : EPOCH 10 - PROGRESS: at 68.53% examples, 240209 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:24:51,145 : INFO : EPOCH 10 - PROGRESS: at 69.30% examples, 240041 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:52,186 : INFO : EPOCH 10 - PROGRESS: at 70.12% examples, 240301 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:53,196 : INFO : EPOCH 10 - PROGRESS: at 70.89% examples, 240179 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:54,219 : INFO : EPOCH 10 - PROGRESS: at 71.77% examples, 240415 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:55,262 : INFO : EPOCH 10 - PROGRESS: at 72.63% examples, 240286 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:24:56,273 : INFO : EPOCH 10 - PROGRESS: at 73.60% examples, 240526 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:57,369 : INFO : EPOCH 10 - PROGRESS: at 74.40% examples, 240249 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:58,388 : INFO : EPOCH 10 - PROGRESS: at 75.28% examples, 240550 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:24:59,402 : INFO : EPOCH 10 - PROGRESS: at 75.99% examples, 240420 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:25:00,517 : INFO : EPOCH 10 - PROGRESS: at 76.90% examples, 240626 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:01,649 : INFO : EPOCH 10 - PROGRESS: at 77.78% examples, 240774 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:02,661 : INFO : EPOCH 10 - PROGRESS: at 78.58% examples, 240856 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:03,711 : INFO : EPOCH 10 - PROGRESS: at 79.43% examples, 240853 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:04,726 : INFO : EPOCH 10 - PROGRESS: at 80.16% examples, 240718 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:05,727 : INFO : EPOCH 10 - PROGRESS: at 80.92% examples, 240676 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:25:06,789 : INFO : EPOCH 10 - PROGRESS: at 81.82% examples, 240784 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:07,847 : INFO : EPOCH 10 - PROGRESS: at 82.63% examples, 240623 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:08,872 : INFO : EPOCH 10 - PROGRESS: at 83.54% examples, 240872 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:09,878 : INFO : EPOCH 10 - PROGRESS: at 84.27% examples, 240763 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:10,896 : INFO : EPOCH 10 - PROGRESS: at 85.06% examples, 240946 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:25:11,901 : INFO : EPOCH 10 - PROGRESS: at 85.98% examples, 241167 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:12,918 : INFO : EPOCH 10 - PROGRESS: at 86.84% examples, 241103 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:13,933 : INFO : EPOCH 10 - PROGRESS: at 87.71% examples, 241049 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:25:15,011 : INFO : EPOCH 10 - PROGRESS: at 88.69% examples, 241106 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:16,030 : INFO : EPOCH 10 - PROGRESS: at 89.55% examples, 241171 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:17,069 : INFO : EPOCH 10 - PROGRESS: at 90.44% examples, 241195 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:18,104 : INFO : EPOCH 10 - PROGRESS: at 91.31% examples, 241159 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:25:19,135 : INFO : EPOCH 10 - PROGRESS: at 92.19% examples, 241132 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:20,138 : INFO : EPOCH 10 - PROGRESS: at 92.97% examples, 241218 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:21,145 : INFO : EPOCH 10 - PROGRESS: at 93.85% examples, 241295 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:22,145 : INFO : EPOCH 10 - PROGRESS: at 94.68% examples, 241336 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:23,162 : INFO : EPOCH 10 - PROGRESS: at 95.56% examples, 241340 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:25:24,185 : INFO : EPOCH 10 - PROGRESS: at 96.44% examples, 241447 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:25,211 : INFO : EPOCH 10 - PROGRESS: at 97.26% examples, 241355 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:25:26,231 : INFO : EPOCH 10 - PROGRESS: at 98.13% examples, 241458 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:27,264 : INFO : EPOCH 10 - PROGRESS: at 98.95% examples, 241318 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:25:28,260 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:25:28,273 : INFO : EPOCH 10 - PROGRESS: at 99.82% examples, 241327 words/s, in_qsize 8, out_qsize 1
2020-04-16 18:25:28,274 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:25:28,277 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:25:28,286 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:25:28,314 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:25:28,323 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:25:28,331 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:25:28,366 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:25:28,385 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:25:28,399 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:25:28,400 : INFO : EPOCH - 10 : training on 41519355 raw words (30352549 effective words) took 125.7s, 241517 effective words/s
2020-04-16 18:25:28,401 : INFO : training on a 415193550 raw words (303497405 effective words) took 1360.1s, 223136 effective words/s

CPU times: user 2h 42min 32s, sys: 30.8 s, total: 2h 43min 2s
Wall time: 24min 19s

Train a SkipGram model

model_skipgram = gensim.models.Word2Vec (documents, size=150, window=10, min_count=2, workers=10, sg=1)
%time model_skipgram.train(documents,total_examples=len(documents),epochs=10)

2020-04-16 18:26:19,740 : WARNING : consider setting layer size to a multiple of 4 for greater performance
2020-04-16 18:26:19,742 : INFO : collecting all words and their counts
2020-04-16 18:26:19,743 : INFO : PROGRESS: at sentence #0, processed 0 words, keeping 0 word types
2020-04-16 18:26:19,950 : INFO : PROGRESS: at sentence #10000, processed 1655714 words, keeping 25777 word types
2020-04-16 18:26:20,165 : INFO : PROGRESS: at sentence #20000, processed 3317863 words, keeping 35016 word types
2020-04-16 18:26:20,417 : INFO : PROGRESS: at sentence #30000, processed 5264072 words, keeping 47518 word types
2020-04-16 18:26:20,639 : INFO : PROGRESS: at sentence #40000, processed 7081746 words, keeping 56675 word types
2020-04-16 18:26:20,892 : INFO : PROGRESS: at sentence #50000, processed 9089491 words, keeping 63744 word types
2020-04-16 18:26:21,145 : INFO : PROGRESS: at sentence #60000, processed 11013723 words, keeping 76781 word types
2020-04-16 18:26:21,377 : INFO : PROGRESS: at sentence #70000, processed 12637525 words, keeping 83194 word types
2020-04-16 18:26:21,591 : INFO : PROGRESS: at sentence #80000, processed 14099751 words, keeping 88454 word types
2020-04-16 18:26:21,807 : INFO : PROGRESS: at sentence #90000, processed 15662149 words, keeping 93352 word types
2020-04-16 18:26:22,018 : INFO : PROGRESS: at sentence #100000, processed 17164487 words, keeping 97881 word types
2020-04-16 18:26:22,210 : INFO : PROGRESS: at sentence #110000, processed 18652292 words, keeping 102127 word types
2020-04-16 18:26:22,398 : INFO : PROGRESS: at sentence #120000, processed 20152529 words, keeping 105918 word types
2020-04-16 18:26:22,583 : INFO : PROGRESS: at sentence #130000, processed 21684330 words, keeping 110099 word types
2020-04-16 18:26:22,792 : INFO : PROGRESS: at sentence #140000, processed 23330206 words, keeping 114103 word types
2020-04-16 18:26:22,983 : INFO : PROGRESS: at sentence #150000, processed 24838754 words, keeping 118169 word types
2020-04-16 18:26:23,174 : INFO : PROGRESS: at sentence #160000, processed 26390910 words, keeping 118665 word types
2020-04-16 18:26:23,362 : INFO : PROGRESS: at sentence #170000, processed 27913916 words, keeping 123350 word types
2020-04-16 18:26:23,566 : INFO : PROGRESS: at sentence #180000, processed 29535612 words, keeping 126742 word types
2020-04-16 18:26:23,758 : INFO : PROGRESS: at sentence #190000, processed 31096459 words, keeping 129841 word types
2020-04-16 18:26:23,971 : INFO : PROGRESS: at sentence #200000, processed 32805271 words, keeping 133249 word types
2020-04-16 18:26:24,179 : INFO : PROGRESS: at sentence #210000, processed 34434198 words, keeping 136358 word types
2020-04-16 18:26:24,383 : INFO : PROGRESS: at sentence #220000, processed 36083482 words, keeping 139412 word types
2020-04-16 18:26:24,567 : INFO : PROGRESS: at sentence #230000, processed 37571762 words, keeping 142393 word types
2020-04-16 18:26:24,759 : INFO : PROGRESS: at sentence #240000, processed 39138190 words, keeping 145226 word types
2020-04-16 18:26:24,950 : INFO : PROGRESS: at sentence #250000, processed 40695049 words, keeping 147960 word types
2020-04-16 18:26:25,058 : INFO : collected 150053 word types from a corpus of 41519355 raw words and 255404 sentences
2020-04-16 18:26:25,059 : INFO : Loading a fresh vocabulary
2020-04-16 18:26:26,110 : INFO : effective_min_count=2 retains 70538 unique words (47% of original 150053, drops 79515)
2020-04-16 18:26:26,110 : INFO : effective_min_count=2 leaves 41439840 word corpus (99% of original 41519355, drops 79515)
2020-04-16 18:26:26,286 : INFO : deleting the raw counts dictionary of 150053 items
2020-04-16 18:26:26,289 : INFO : sample=0.001 downsamples 55 most-common words
2020-04-16 18:26:26,290 : INFO : downsampling leaves estimated 30349255 word corpus (73.2% of prior 41439840)
2020-04-16 18:26:26,491 : INFO : estimated required memory for 70538 words and 150 dimensions: 119914600 bytes
2020-04-16 18:26:26,492 : INFO : resetting layer weights
2020-04-16 18:26:38,749 : INFO : training model with 10 workers on 70538 vocabulary and 150 features, using sg=1 hs=0 sample=0.001 negative=5 window=10
2020-04-16 18:26:39,756 : INFO : EPOCH 1 - PROGRESS: at 1.04% examples, 339227 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:40,796 : INFO : EPOCH 1 - PROGRESS: at 2.28% examples, 353507 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:41,798 : INFO : EPOCH 1 - PROGRESS: at 3.51% examples, 357887 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:26:42,829 : INFO : EPOCH 1 - PROGRESS: at 4.73% examples, 357872 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:43,837 : INFO : EPOCH 1 - PROGRESS: at 5.92% examples, 360301 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:44,844 : INFO : EPOCH 1 - PROGRESS: at 7.18% examples, 363421 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:45,851 : INFO : EPOCH 1 - PROGRESS: at 8.38% examples, 365443 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:46,922 : INFO : EPOCH 1 - PROGRESS: at 9.47% examples, 363382 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:47,923 : INFO : EPOCH 1 - PROGRESS: at 10.47% examples, 365277 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:48,936 : INFO : EPOCH 1 - PROGRESS: at 11.51% examples, 367022 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:49,945 : INFO : EPOCH 1 - PROGRESS: at 12.44% examples, 366606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:50,958 : INFO : EPOCH 1 - PROGRESS: at 13.56% examples, 365737 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:52,000 : INFO : EPOCH 1 - PROGRESS: at 14.58% examples, 364077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:53,008 : INFO : EPOCH 1 - PROGRESS: at 15.63% examples, 362703 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:54,032 : INFO : EPOCH 1 - PROGRESS: at 16.51% examples, 359627 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:55,058 : INFO : EPOCH 1 - PROGRESS: at 17.44% examples, 358283 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:56,113 : INFO : EPOCH 1 - PROGRESS: at 18.44% examples, 357236 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:57,155 : INFO : EPOCH 1 - PROGRESS: at 19.34% examples, 356380 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:58,162 : INFO : EPOCH 1 - PROGRESS: at 20.26% examples, 356346 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:26:59,195 : INFO : EPOCH 1 - PROGRESS: at 21.48% examples, 355812 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:00,238 : INFO : EPOCH 1 - PROGRESS: at 22.43% examples, 355299 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:01,289 : INFO : EPOCH 1 - PROGRESS: at 23.35% examples, 354697 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:02,301 : INFO : EPOCH 1 - PROGRESS: at 24.24% examples, 354395 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:03,329 : INFO : EPOCH 1 - PROGRESS: at 25.34% examples, 353062 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:04,363 : INFO : EPOCH 1 - PROGRESS: at 26.63% examples, 352349 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:27:05,385 : INFO : EPOCH 1 - PROGRESS: at 27.94% examples, 351848 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:06,387 : INFO : EPOCH 1 - PROGRESS: at 29.19% examples, 351888 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:07,390 : INFO : EPOCH 1 - PROGRESS: at 30.34% examples, 351362 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:08,412 : INFO : EPOCH 1 - PROGRESS: at 31.68% examples, 350713 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:09,417 : INFO : EPOCH 1 - PROGRESS: at 32.93% examples, 350722 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:10,452 : INFO : EPOCH 1 - PROGRESS: at 34.02% examples, 350198 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:11,499 : INFO : EPOCH 1 - PROGRESS: at 35.27% examples, 350052 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:12,509 : INFO : EPOCH 1 - PROGRESS: at 36.56% examples, 350054 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:13,540 : INFO : EPOCH 1 - PROGRESS: at 37.68% examples, 349207 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:14,554 : INFO : EPOCH 1 - PROGRESS: at 38.97% examples, 349169 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:15,557 : INFO : EPOCH 1 - PROGRESS: at 40.19% examples, 348866 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:16,620 : INFO : EPOCH 1 - PROGRESS: at 41.52% examples, 348599 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:17,706 : INFO : EPOCH 1 - PROGRESS: at 42.76% examples, 348103 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:27:18,709 : INFO : EPOCH 1 - PROGRESS: at 44.09% examples, 348232 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:19,728 : INFO : EPOCH 1 - PROGRESS: at 45.31% examples, 347481 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:20,735 : INFO : EPOCH 1 - PROGRESS: at 46.44% examples, 347045 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:21,798 : INFO : EPOCH 1 - PROGRESS: at 47.65% examples, 346836 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:22,821 : INFO : EPOCH 1 - PROGRESS: at 48.92% examples, 346806 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:23,825 : INFO : EPOCH 1 - PROGRESS: at 50.09% examples, 346415 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:24,855 : INFO : EPOCH 1 - PROGRESS: at 51.29% examples, 346479 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:25,856 : INFO : EPOCH 1 - PROGRESS: at 52.39% examples, 346117 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:27:26,857 : INFO : EPOCH 1 - PROGRESS: at 53.41% examples, 345792 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:27,872 : INFO : EPOCH 1 - PROGRESS: at 54.57% examples, 345580 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:28,897 : INFO : EPOCH 1 - PROGRESS: at 55.78% examples, 344988 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:29,941 : INFO : EPOCH 1 - PROGRESS: at 56.95% examples, 344600 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:27:30,946 : INFO : EPOCH 1 - PROGRESS: at 58.15% examples, 344726 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:27:31,955 : INFO : EPOCH 1 - PROGRESS: at 59.25% examples, 344169 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:32,973 : INFO : EPOCH 1 - PROGRESS: at 60.39% examples, 343874 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:33,976 : INFO : EPOCH 1 - PROGRESS: at 61.57% examples, 343792 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:34,980 : INFO : EPOCH 1 - PROGRESS: at 62.66% examples, 343180 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:36,029 : INFO : EPOCH 1 - PROGRESS: at 63.73% examples, 341817 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:37,038 : INFO : EPOCH 1 - PROGRESS: at 64.89% examples, 341069 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:38,045 : INFO : EPOCH 1 - PROGRESS: at 65.89% examples, 340876 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:39,051 : INFO : EPOCH 1 - PROGRESS: at 66.94% examples, 340391 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:27:40,116 : INFO : EPOCH 1 - PROGRESS: at 68.15% examples, 340118 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:41,117 : INFO : EPOCH 1 - PROGRESS: at 69.26% examples, 340079 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:42,120 : INFO : EPOCH 1 - PROGRESS: at 70.27% examples, 339915 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:43,121 : INFO : EPOCH 1 - PROGRESS: at 71.38% examples, 339806 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:44,139 : INFO : EPOCH 1 - PROGRESS: at 72.49% examples, 339479 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:45,159 : INFO : EPOCH 1 - PROGRESS: at 73.72% examples, 339246 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:46,212 : INFO : EPOCH 1 - PROGRESS: at 74.82% examples, 338845 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:27:47,240 : INFO : EPOCH 1 - PROGRESS: at 75.89% examples, 338826 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:48,257 : INFO : EPOCH 1 - PROGRESS: at 76.85% examples, 338323 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:49,266 : INFO : EPOCH 1 - PROGRESS: at 77.86% examples, 338071 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:27:50,287 : INFO : EPOCH 1 - PROGRESS: at 78.90% examples, 337857 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:51,305 : INFO : EPOCH 1 - PROGRESS: at 79.95% examples, 337496 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:52,308 : INFO : EPOCH 1 - PROGRESS: at 80.98% examples, 337293 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:53,310 : INFO : EPOCH 1 - PROGRESS: at 82.10% examples, 337107 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:54,330 : INFO : EPOCH 1 - PROGRESS: at 83.24% examples, 337046 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:55,337 : INFO : EPOCH 1 - PROGRESS: at 84.27% examples, 336839 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:56,337 : INFO : EPOCH 1 - PROGRESS: at 85.31% examples, 336834 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:57,353 : INFO : EPOCH 1 - PROGRESS: at 86.44% examples, 336605 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:58,354 : INFO : EPOCH 1 - PROGRESS: at 87.61% examples, 336367 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:27:59,359 : INFO : EPOCH 1 - PROGRESS: at 88.77% examples, 336109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:00,379 : INFO : EPOCH 1 - PROGRESS: at 89.89% examples, 335890 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:28:01,388 : INFO : EPOCH 1 - PROGRESS: at 91.03% examples, 335723 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:02,419 : INFO : EPOCH 1 - PROGRESS: at 92.19% examples, 335470 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:03,420 : INFO : EPOCH 1 - PROGRESS: at 93.22% examples, 335412 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:04,429 : INFO : EPOCH 1 - PROGRESS: at 94.30% examples, 335007 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:05,470 : INFO : EPOCH 1 - PROGRESS: at 95.44% examples, 334735 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:06,473 : INFO : EPOCH 1 - PROGRESS: at 96.55% examples, 334695 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:07,492 : INFO : EPOCH 1 - PROGRESS: at 97.61% examples, 334320 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:08,501 : INFO : EPOCH 1 - PROGRESS: at 98.75% examples, 334185 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:09,417 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:28:09,426 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:28:09,459 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:28:09,474 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:28:09,491 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:28:09,491 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:28:09,521 : INFO : EPOCH 1 - PROGRESS: at 99.93% examples, 334116 words/s, in_qsize 3, out_qsize 1
2020-04-16 18:28:09,522 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:28:09,543 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:28:09,544 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:28:09,547 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:28:09,548 : INFO : EPOCH - 1 : training on 41519355 raw words (30348889 effective words) took 90.8s, 334261 effective words/s
2020-04-16 18:28:10,561 : INFO : EPOCH 2 - PROGRESS: at 0.74% examples, 243992 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:28:11,629 : INFO : EPOCH 2 - PROGRESS: at 1.86% examples, 282162 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:12,645 : INFO : EPOCH 2 - PROGRESS: at 2.93% examples, 294132 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:13,726 : INFO : EPOCH 2 - PROGRESS: at 3.99% examples, 295876 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:14,737 : INFO : EPOCH 2 - PROGRESS: at 5.00% examples, 296787 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:15,737 : INFO : EPOCH 2 - PROGRESS: at 6.06% examples, 302093 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:16,749 : INFO : EPOCH 2 - PROGRESS: at 7.07% examples, 302685 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:17,753 : INFO : EPOCH 2 - PROGRESS: at 8.04% examples, 304197 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:18,801 : INFO : EPOCH 2 - PROGRESS: at 9.05% examples, 305519 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:19,856 : INFO : EPOCH 2 - PROGRESS: at 9.93% examples, 307605 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:20,868 : INFO : EPOCH 2 - PROGRESS: at 10.83% examples, 307487 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:21,900 : INFO : EPOCH 2 - PROGRESS: at 11.67% examples, 309217 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:22,936 : INFO : EPOCH 2 - PROGRESS: at 12.48% examples, 308272 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:28:23,951 : INFO : EPOCH 2 - PROGRESS: at 13.56% examples, 310110 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:24,954 : INFO : EPOCH 2 - PROGRESS: at 14.41% examples, 309493 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:25,981 : INFO : EPOCH 2 - PROGRESS: at 15.30% examples, 308615 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:28:27,023 : INFO : EPOCH 2 - PROGRESS: at 16.24% examples, 308807 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:28,033 : INFO : EPOCH 2 - PROGRESS: at 17.10% examples, 309063 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:29,039 : INFO : EPOCH 2 - PROGRESS: at 17.92% examples, 309027 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:30,065 : INFO : EPOCH 2 - PROGRESS: at 18.83% examples, 309280 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:31,083 : INFO : EPOCH 2 - PROGRESS: at 19.63% examples, 309631 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:32,095 : INFO : EPOCH 2 - PROGRESS: at 20.48% examples, 310322 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:33,134 : INFO : EPOCH 2 - PROGRESS: at 21.57% examples, 309978 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:28:34,153 : INFO : EPOCH 2 - PROGRESS: at 22.43% examples, 310310 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:35,163 : INFO : EPOCH 2 - PROGRESS: at 23.22% examples, 310181 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:36,179 : INFO : EPOCH 2 - PROGRESS: at 23.96% examples, 309670 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:37,185 : INFO : EPOCH 2 - PROGRESS: at 24.69% examples, 308036 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:38,230 : INFO : EPOCH 2 - PROGRESS: at 25.72% examples, 306352 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:39,239 : INFO : EPOCH 2 - PROGRESS: at 26.79% examples, 305705 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:40,267 : INFO : EPOCH 2 - PROGRESS: at 28.11% examples, 306514 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:41,289 : INFO : EPOCH 2 - PROGRESS: at 29.19% examples, 306426 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:42,296 : INFO : EPOCH 2 - PROGRESS: at 30.31% examples, 307123 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:43,307 : INFO : EPOCH 2 - PROGRESS: at 31.57% examples, 307338 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:44,323 : INFO : EPOCH 2 - PROGRESS: at 32.64% examples, 307247 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:28:45,335 : INFO : EPOCH 2 - PROGRESS: at 33.70% examples, 307439 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:46,382 : INFO : EPOCH 2 - PROGRESS: at 34.77% examples, 307364 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:47,410 : INFO : EPOCH 2 - PROGRESS: at 35.88% examples, 307408 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:48,436 : INFO : EPOCH 2 - PROGRESS: at 37.03% examples, 307629 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:49,437 : INFO : EPOCH 2 - PROGRESS: at 38.06% examples, 307304 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:50,442 : INFO : EPOCH 2 - PROGRESS: at 39.21% examples, 307322 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:51,445 : INFO : EPOCH 2 - PROGRESS: at 40.27% examples, 307188 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:28:52,448 : INFO : EPOCH 2 - PROGRESS: at 41.53% examples, 307753 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:53,459 : INFO : EPOCH 2 - PROGRESS: at 42.61% examples, 307696 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:54,461 : INFO : EPOCH 2 - PROGRESS: at 43.78% examples, 308076 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:55,495 : INFO : EPOCH 2 - PROGRESS: at 45.03% examples, 308356 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:56,498 : INFO : EPOCH 2 - PROGRESS: at 46.16% examples, 308378 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:57,524 : INFO : EPOCH 2 - PROGRESS: at 47.18% examples, 308381 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:28:58,563 : INFO : EPOCH 2 - PROGRESS: at 48.28% examples, 308310 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:28:59,575 : INFO : EPOCH 2 - PROGRESS: at 49.38% examples, 308120 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:00,576 : INFO : EPOCH 2 - PROGRESS: at 50.49% examples, 308424 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:01,628 : INFO : EPOCH 2 - PROGRESS: at 51.56% examples, 308114 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:02,630 : INFO : EPOCH 2 - PROGRESS: at 52.54% examples, 307981 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:29:03,645 : INFO : EPOCH 2 - PROGRESS: at 53.55% examples, 308320 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:29:04,694 : INFO : EPOCH 2 - PROGRESS: at 54.59% examples, 307981 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:05,717 : INFO : EPOCH 2 - PROGRESS: at 55.87% examples, 308417 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:06,734 : INFO : EPOCH 2 - PROGRESS: at 56.93% examples, 308374 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:07,750 : INFO : EPOCH 2 - PROGRESS: at 57.99% examples, 308439 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:08,819 : INFO : EPOCH 2 - PROGRESS: at 59.16% examples, 308491 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:09,820 : INFO : EPOCH 2 - PROGRESS: at 60.20% examples, 308411 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:10,821 : INFO : EPOCH 2 - PROGRESS: at 61.31% examples, 308579 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:11,842 : INFO : EPOCH 2 - PROGRESS: at 62.37% examples, 308517 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:12,861 : INFO : EPOCH 2 - PROGRESS: at 63.50% examples, 308351 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:29:13,862 : INFO : EPOCH 2 - PROGRESS: at 64.71% examples, 308369 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:14,871 : INFO : EPOCH 2 - PROGRESS: at 65.68% examples, 308437 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:15,902 : INFO : EPOCH 2 - PROGRESS: at 66.74% examples, 308492 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:16,924 : INFO : EPOCH 2 - PROGRESS: at 67.88% examples, 308621 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:17,939 : INFO : EPOCH 2 - PROGRESS: at 69.00% examples, 308889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:18,963 : INFO : EPOCH 2 - PROGRESS: at 69.95% examples, 308784 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:19,980 : INFO : EPOCH 2 - PROGRESS: at 71.00% examples, 309135 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:20,998 : INFO : EPOCH 2 - PROGRESS: at 72.04% examples, 308972 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:22,022 : INFO : EPOCH 2 - PROGRESS: at 73.17% examples, 308879 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:29:23,027 : INFO : EPOCH 2 - PROGRESS: at 74.28% examples, 308963 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:24,059 : INFO : EPOCH 2 - PROGRESS: at 75.26% examples, 308741 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:25,080 : INFO : EPOCH 2 - PROGRESS: at 76.18% examples, 308579 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:26,081 : INFO : EPOCH 2 - PROGRESS: at 77.19% examples, 308768 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:27,106 : INFO : EPOCH 2 - PROGRESS: at 78.19% examples, 308770 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:28,115 : INFO : EPOCH 2 - PROGRESS: at 79.33% examples, 309112 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:29,120 : INFO : EPOCH 2 - PROGRESS: at 80.28% examples, 309016 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:30,131 : INFO : EPOCH 2 - PROGRESS: at 81.32% examples, 309151 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:31,132 : INFO : EPOCH 2 - PROGRESS: at 82.40% examples, 309238 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:32,142 : INFO : EPOCH 2 - PROGRESS: at 83.41% examples, 309037 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:29:33,143 : INFO : EPOCH 2 - PROGRESS: at 84.43% examples, 309292 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:34,148 : INFO : EPOCH 2 - PROGRESS: at 85.37% examples, 309177 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:29:35,163 : INFO : EPOCH 2 - PROGRESS: at 86.41% examples, 308963 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:36,182 : INFO : EPOCH 2 - PROGRESS: at 87.59% examples, 309004 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:37,208 : INFO : EPOCH 2 - PROGRESS: at 88.73% examples, 309007 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:38,251 : INFO : EPOCH 2 - PROGRESS: at 89.76% examples, 308797 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:39,272 : INFO : EPOCH 2 - PROGRESS: at 90.78% examples, 308433 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:40,280 : INFO : EPOCH 2 - PROGRESS: at 91.74% examples, 308030 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:41,289 : INFO : EPOCH 2 - PROGRESS: at 92.80% examples, 308096 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:42,294 : INFO : EPOCH 2 - PROGRESS: at 93.87% examples, 308176 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:43,330 : INFO : EPOCH 2 - PROGRESS: at 94.99% examples, 308249 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:44,347 : INFO : EPOCH 2 - PROGRESS: at 96.03% examples, 308151 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:45,360 : INFO : EPOCH 2 - PROGRESS: at 97.15% examples, 308266 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:46,363 : INFO : EPOCH 2 - PROGRESS: at 98.22% examples, 308338 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:47,372 : INFO : EPOCH 2 - PROGRESS: at 99.28% examples, 308195 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:47,840 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:29:47,844 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:29:47,852 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:29:47,870 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:29:47,875 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:29:47,888 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:29:47,898 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:29:47,925 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:29:47,926 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:29:47,927 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:29:47,928 : INFO : EPOCH - 2 : training on 41519355 raw words (30351885 effective words) took 98.4s, 308534 effective words/s
2020-04-16 18:29:49,098 : INFO : EPOCH 3 - PROGRESS: at 0.89% examples, 254532 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:50,224 : INFO : EPOCH 3 - PROGRESS: at 2.08% examples, 286997 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:51,237 : INFO : EPOCH 3 - PROGRESS: at 3.26% examples, 305975 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:52,256 : INFO : EPOCH 3 - PROGRESS: at 4.25% examples, 302300 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:29:53,272 : INFO : EPOCH 3 - PROGRESS: at 5.38% examples, 310926 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:54,273 : INFO : EPOCH 3 - PROGRESS: at 6.33% examples, 308340 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:55,290 : INFO : EPOCH 3 - PROGRESS: at 7.41% examples, 310695 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:56,342 : INFO : EPOCH 3 - PROGRESS: at 8.41% examples, 309389 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:57,345 : INFO : EPOCH 3 - PROGRESS: at 9.28% examples, 307790 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:58,359 : INFO : EPOCH 3 - PROGRESS: at 10.14% examples, 310247 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:29:59,395 : INFO : EPOCH 3 - PROGRESS: at 10.97% examples, 308541 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:00,395 : INFO : EPOCH 3 - PROGRESS: at 11.70% examples, 307484 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:01,513 : INFO : EPOCH 3 - PROGRESS: at 12.66% examples, 308043 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:30:02,516 : INFO : EPOCH 3 - PROGRESS: at 13.75% examples, 310537 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:03,552 : INFO : EPOCH 3 - PROGRESS: at 14.60% examples, 309253 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:04,554 : INFO : EPOCH 3 - PROGRESS: at 15.56% examples, 309790 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:30:05,636 : INFO : EPOCH 3 - PROGRESS: at 16.48% examples, 309573 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:30:06,648 : INFO : EPOCH 3 - PROGRESS: at 17.30% examples, 309459 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:07,657 : INFO : EPOCH 3 - PROGRESS: at 18.21% examples, 310372 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:08,675 : INFO : EPOCH 3 - PROGRESS: at 18.98% examples, 309299 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:09,693 : INFO : EPOCH 3 - PROGRESS: at 19.75% examples, 308650 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:30:10,717 : INFO : EPOCH 3 - PROGRESS: at 20.55% examples, 308618 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:11,735 : INFO : EPOCH 3 - PROGRESS: at 21.67% examples, 308606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:12,736 : INFO : EPOCH 3 - PROGRESS: at 22.48% examples, 308349 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:13,786 : INFO : EPOCH 3 - PROGRESS: at 23.35% examples, 309187 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:14,790 : INFO : EPOCH 3 - PROGRESS: at 24.13% examples, 309111 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:15,814 : INFO : EPOCH 3 - PROGRESS: at 25.22% examples, 309903 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:16,833 : INFO : EPOCH 3 - PROGRESS: at 26.34% examples, 309488 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:17,844 : INFO : EPOCH 3 - PROGRESS: at 27.60% examples, 310362 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:18,929 : INFO : EPOCH 3 - PROGRESS: at 28.72% examples, 309513 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:19,931 : INFO : EPOCH 3 - PROGRESS: at 29.87% examples, 309928 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:21,048 : INFO : EPOCH 3 - PROGRESS: at 31.06% examples, 309327 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:22,093 : INFO : EPOCH 3 - PROGRESS: at 32.35% examples, 310169 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:23,121 : INFO : EPOCH 3 - PROGRESS: at 33.38% examples, 309492 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:24,135 : INFO : EPOCH 3 - PROGRESS: at 34.55% examples, 310631 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:25,152 : INFO : EPOCH 3 - PROGRESS: at 35.56% examples, 310108 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:26,165 : INFO : EPOCH 3 - PROGRESS: at 36.82% examples, 311128 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:27,177 : INFO : EPOCH 3 - PROGRESS: at 37.85% examples, 310628 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:28,187 : INFO : EPOCH 3 - PROGRESS: at 39.00% examples, 310701 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:29,223 : INFO : EPOCH 3 - PROGRESS: at 40.21% examples, 311115 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:30,227 : INFO : EPOCH 3 - PROGRESS: at 41.40% examples, 311413 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:31,230 : INFO : EPOCH 3 - PROGRESS: at 42.50% examples, 311335 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:32,248 : INFO : EPOCH 3 - PROGRESS: at 43.59% examples, 311027 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:33,260 : INFO : EPOCH 3 - PROGRESS: at 44.79% examples, 310914 words/s, in_qsize 20, out_qsize 2
2020-04-16 18:30:34,261 : INFO : EPOCH 3 - PROGRESS: at 45.93% examples, 311046 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:35,261 : INFO : EPOCH 3 - PROGRESS: at 46.93% examples, 310997 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:36,283 : INFO : EPOCH 3 - PROGRESS: at 48.03% examples, 310990 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:37,288 : INFO : EPOCH 3 - PROGRESS: at 49.22% examples, 311237 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:38,344 : INFO : EPOCH 3 - PROGRESS: at 50.31% examples, 311131 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:30:39,355 : INFO : EPOCH 3 - PROGRESS: at 51.44% examples, 311437 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:40,357 : INFO : EPOCH 3 - PROGRESS: at 52.29% examples, 310410 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:41,390 : INFO : EPOCH 3 - PROGRESS: at 53.15% examples, 309661 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:42,400 : INFO : EPOCH 3 - PROGRESS: at 54.22% examples, 309756 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:43,476 : INFO : EPOCH 3 - PROGRESS: at 55.43% examples, 309618 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:44,484 : INFO : EPOCH 3 - PROGRESS: at 56.54% examples, 309852 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:45,542 : INFO : EPOCH 3 - PROGRESS: at 57.67% examples, 309817 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:46,557 : INFO : EPOCH 3 - PROGRESS: at 58.84% examples, 310228 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:47,636 : INFO : EPOCH 3 - PROGRESS: at 59.90% examples, 309845 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:48,641 : INFO : EPOCH 3 - PROGRESS: at 61.02% examples, 309978 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:49,645 : INFO : EPOCH 3 - PROGRESS: at 62.05% examples, 309982 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:50,680 : INFO : EPOCH 3 - PROGRESS: at 63.18% examples, 309816 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:51,687 : INFO : EPOCH 3 - PROGRESS: at 64.53% examples, 310240 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:52,701 : INFO : EPOCH 3 - PROGRESS: at 65.55% examples, 310264 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:53,738 : INFO : EPOCH 3 - PROGRESS: at 66.63% examples, 310491 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:54,757 : INFO : EPOCH 3 - PROGRESS: at 67.73% examples, 310477 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:30:55,797 : INFO : EPOCH 3 - PROGRESS: at 68.85% examples, 310613 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:56,850 : INFO : EPOCH 3 - PROGRESS: at 69.90% examples, 310656 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:57,889 : INFO : EPOCH 3 - PROGRESS: at 70.91% examples, 310687 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:58,891 : INFO : EPOCH 3 - PROGRESS: at 72.01% examples, 310981 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:30:59,907 : INFO : EPOCH 3 - PROGRESS: at 73.17% examples, 310989 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:00,908 : INFO : EPOCH 3 - PROGRESS: at 74.32% examples, 311165 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:01,952 : INFO : EPOCH 3 - PROGRESS: at 75.33% examples, 311061 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:02,966 : INFO : EPOCH 3 - PROGRESS: at 76.30% examples, 311174 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:03,970 : INFO : EPOCH 3 - PROGRESS: at 77.24% examples, 310940 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:04,976 : INFO : EPOCH 3 - PROGRESS: at 78.19% examples, 310801 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:05,979 : INFO : EPOCH 3 - PROGRESS: at 79.23% examples, 310858 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:06,987 : INFO : EPOCH 3 - PROGRESS: at 80.29% examples, 311006 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:08,019 : INFO : EPOCH 3 - PROGRESS: at 81.32% examples, 311028 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:09,031 : INFO : EPOCH 3 - PROGRESS: at 82.40% examples, 311054 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:10,035 : INFO : EPOCH 3 - PROGRESS: at 83.50% examples, 311205 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:11,047 : INFO : EPOCH 3 - PROGRESS: at 84.49% examples, 311296 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:12,047 : INFO : EPOCH 3 - PROGRESS: at 85.48% examples, 311348 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:13,054 : INFO : EPOCH 3 - PROGRESS: at 86.53% examples, 311055 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:14,074 : INFO : EPOCH 3 - PROGRESS: at 87.59% examples, 310730 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:15,081 : INFO : EPOCH 3 - PROGRESS: at 88.72% examples, 310693 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:16,101 : INFO : EPOCH 3 - PROGRESS: at 89.82% examples, 310787 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:17,124 : INFO : EPOCH 3 - PROGRESS: at 90.91% examples, 310626 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:18,203 : INFO : EPOCH 3 - PROGRESS: at 91.99% examples, 310356 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:31:19,212 : INFO : EPOCH 3 - PROGRESS: at 93.06% examples, 310549 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:20,282 : INFO : EPOCH 3 - PROGRESS: at 94.18% examples, 310400 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:21,315 : INFO : EPOCH 3 - PROGRESS: at 95.34% examples, 310597 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:22,339 : INFO : EPOCH 3 - PROGRESS: at 96.42% examples, 310527 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:23,361 : INFO : EPOCH 3 - PROGRESS: at 97.57% examples, 310728 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:24,376 : INFO : EPOCH 3 - PROGRESS: at 98.64% examples, 310673 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:25,357 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:31:25,370 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:31:25,401 : INFO : EPOCH 3 - PROGRESS: at 99.84% examples, 310883 words/s, in_qsize 7, out_qsize 1
2020-04-16 18:31:25,402 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:31:25,412 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:31:25,425 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:31:25,449 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:31:25,461 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:31:25,481 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:31:25,483 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:31:25,496 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:31:25,497 : INFO : EPOCH - 3 : training on 41519355 raw words (30348217 effective words) took 97.6s, 311065 effective words/s
2020-04-16 18:31:26,602 : INFO : EPOCH 4 - PROGRESS: at 0.89% examples, 269534 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:27,605 : INFO : EPOCH 4 - PROGRESS: at 2.04% examples, 305470 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:31:28,656 : INFO : EPOCH 4 - PROGRESS: at 3.05% examples, 299802 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:31:29,661 : INFO : EPOCH 4 - PROGRESS: at 4.07% examples, 301970 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:30,683 : INFO : EPOCH 4 - PROGRESS: at 5.13% examples, 305121 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:31,771 : INFO : EPOCH 4 - PROGRESS: at 6.10% examples, 300301 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:32,815 : INFO : EPOCH 4 - PROGRESS: at 7.05% examples, 296901 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:33,874 : INFO : EPOCH 4 - PROGRESS: at 7.95% examples, 294529 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:34,876 : INFO : EPOCH 4 - PROGRESS: at 8.97% examples, 298296 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:31:35,973 : INFO : EPOCH 4 - PROGRESS: at 9.80% examples, 296484 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:36,977 : INFO : EPOCH 4 - PROGRESS: at 10.67% examples, 297607 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:38,072 : INFO : EPOCH 4 - PROGRESS: at 11.54% examples, 298485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:39,083 : INFO : EPOCH 4 - PROGRESS: at 12.34% examples, 299463 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:40,120 : INFO : EPOCH 4 - PROGRESS: at 13.38% examples, 300941 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:31:41,125 : INFO : EPOCH 4 - PROGRESS: at 14.26% examples, 301857 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:42,143 : INFO : EPOCH 4 - PROGRESS: at 15.03% examples, 299429 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:43,177 : INFO : EPOCH 4 - PROGRESS: at 15.87% examples, 297890 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:44,211 : INFO : EPOCH 4 - PROGRESS: at 16.72% examples, 297954 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:45,220 : INFO : EPOCH 4 - PROGRESS: at 17.62% examples, 299561 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:46,226 : INFO : EPOCH 4 - PROGRESS: at 18.45% examples, 299568 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:47,240 : INFO : EPOCH 4 - PROGRESS: at 19.21% examples, 299038 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:48,243 : INFO : EPOCH 4 - PROGRESS: at 19.81% examples, 296298 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:49,257 : INFO : EPOCH 4 - PROGRESS: at 20.57% examples, 296613 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:31:50,327 : INFO : EPOCH 4 - PROGRESS: at 21.72% examples, 296459 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:51,338 : INFO : EPOCH 4 - PROGRESS: at 22.53% examples, 297124 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:52,346 : INFO : EPOCH 4 - PROGRESS: at 23.35% examples, 297779 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:31:53,355 : INFO : EPOCH 4 - PROGRESS: at 24.13% examples, 298068 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:54,385 : INFO : EPOCH 4 - PROGRESS: at 25.24% examples, 299400 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:55,402 : INFO : EPOCH 4 - PROGRESS: at 26.36% examples, 299378 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:56,414 : INFO : EPOCH 4 - PROGRESS: at 27.66% examples, 300788 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:57,448 : INFO : EPOCH 4 - PROGRESS: at 28.74% examples, 300550 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:58,474 : INFO : EPOCH 4 - PROGRESS: at 29.96% examples, 301654 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:31:59,477 : INFO : EPOCH 4 - PROGRESS: at 31.06% examples, 301730 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:00,509 : INFO : EPOCH 4 - PROGRESS: at 32.35% examples, 302693 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:01,535 : INFO : EPOCH 4 - PROGRESS: at 33.42% examples, 302679 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:02,627 : INFO : EPOCH 4 - PROGRESS: at 34.58% examples, 303154 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:03,634 : INFO : EPOCH 4 - PROGRESS: at 35.65% examples, 303292 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:04,655 : INFO : EPOCH 4 - PROGRESS: at 36.72% examples, 303115 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:05,741 : INFO : EPOCH 4 - PROGRESS: at 37.85% examples, 302984 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:06,741 : INFO : EPOCH 4 - PROGRESS: at 39.03% examples, 303484 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:07,792 : INFO : EPOCH 4 - PROGRESS: at 40.19% examples, 303621 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:08,797 : INFO : EPOCH 4 - PROGRESS: at 41.38% examples, 304079 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:09,861 : INFO : EPOCH 4 - PROGRESS: at 42.53% examples, 304074 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:10,887 : INFO : EPOCH 4 - PROGRESS: at 43.76% examples, 304670 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:11,905 : INFO : EPOCH 4 - PROGRESS: at 45.01% examples, 305123 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:12,939 : INFO : EPOCH 4 - PROGRESS: at 46.16% examples, 305171 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:13,945 : INFO : EPOCH 4 - PROGRESS: at 47.19% examples, 305353 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:14,955 : INFO : EPOCH 4 - PROGRESS: at 48.31% examples, 305682 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:15,973 : INFO : EPOCH 4 - PROGRESS: at 49.51% examples, 306077 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:32:17,002 : INFO : EPOCH 4 - PROGRESS: at 50.61% examples, 306109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:18,003 : INFO : EPOCH 4 - PROGRESS: at 51.72% examples, 306561 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:19,018 : INFO : EPOCH 4 - PROGRESS: at 52.67% examples, 306390 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:20,028 : INFO : EPOCH 4 - PROGRESS: at 53.62% examples, 306257 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:21,038 : INFO : EPOCH 4 - PROGRESS: at 54.68% examples, 306307 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:22,066 : INFO : EPOCH 4 - PROGRESS: at 55.94% examples, 306612 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:23,071 : INFO : EPOCH 4 - PROGRESS: at 57.00% examples, 306663 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:24,108 : INFO : EPOCH 4 - PROGRESS: at 58.15% examples, 307013 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:25,136 : INFO : EPOCH 4 - PROGRESS: at 59.25% examples, 307052 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:26,171 : INFO : EPOCH 4 - PROGRESS: at 60.39% examples, 307322 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:27,180 : INFO : EPOCH 4 - PROGRESS: at 61.49% examples, 307467 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:28,218 : INFO : EPOCH 4 - PROGRESS: at 62.66% examples, 307671 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:32:29,224 : INFO : EPOCH 4 - PROGRESS: at 63.90% examples, 307916 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:30,230 : INFO : EPOCH 4 - PROGRESS: at 65.09% examples, 308129 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:31,240 : INFO : EPOCH 4 - PROGRESS: at 66.02% examples, 307993 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:32,253 : INFO : EPOCH 4 - PROGRESS: at 67.21% examples, 308557 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:33,259 : INFO : EPOCH 4 - PROGRESS: at 68.15% examples, 308016 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:34,259 : INFO : EPOCH 4 - PROGRESS: at 69.02% examples, 307302 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:35,287 : INFO : EPOCH 4 - PROGRESS: at 69.92% examples, 306886 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:36,323 : INFO : EPOCH 4 - PROGRESS: at 70.97% examples, 307185 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:37,335 : INFO : EPOCH 4 - PROGRESS: at 72.04% examples, 307285 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:38,389 : INFO : EPOCH 4 - PROGRESS: at 73.24% examples, 307387 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:39,415 : INFO : EPOCH 4 - PROGRESS: at 74.36% examples, 307403 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:40,434 : INFO : EPOCH 4 - PROGRESS: at 75.43% examples, 307656 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:41,478 : INFO : EPOCH 4 - PROGRESS: at 76.36% examples, 307584 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:42,505 : INFO : EPOCH 4 - PROGRESS: at 77.41% examples, 307777 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:43,535 : INFO : EPOCH 4 - PROGRESS: at 78.27% examples, 307223 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:44,542 : INFO : EPOCH 4 - PROGRESS: at 79.17% examples, 306671 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:45,544 : INFO : EPOCH 4 - PROGRESS: at 80.18% examples, 306805 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:46,572 : INFO : EPOCH 4 - PROGRESS: at 81.19% examples, 306816 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:47,585 : INFO : EPOCH 4 - PROGRESS: at 82.26% examples, 306794 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:48,604 : INFO : EPOCH 4 - PROGRESS: at 83.33% examples, 306849 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:49,656 : INFO : EPOCH 4 - PROGRESS: at 84.31% examples, 306695 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:50,688 : INFO : EPOCH 4 - PROGRESS: at 85.29% examples, 306683 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:51,705 : INFO : EPOCH 4 - PROGRESS: at 86.44% examples, 306907 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:52,716 : INFO : EPOCH 4 - PROGRESS: at 87.59% examples, 306914 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:53,734 : INFO : EPOCH 4 - PROGRESS: at 88.71% examples, 306889 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:32:54,768 : INFO : EPOCH 4 - PROGRESS: at 89.82% examples, 306973 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:32:55,772 : INFO : EPOCH 4 - PROGRESS: at 90.98% examples, 307168 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:56,790 : INFO : EPOCH 4 - PROGRESS: at 92.13% examples, 307301 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:57,792 : INFO : EPOCH 4 - PROGRESS: at 93.11% examples, 307318 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:58,863 : INFO : EPOCH 4 - PROGRESS: at 94.30% examples, 307434 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:32:59,886 : INFO : EPOCH 4 - PROGRESS: at 95.41% examples, 307467 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:00,901 : INFO : EPOCH 4 - PROGRESS: at 96.51% examples, 307606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:01,914 : INFO : EPOCH 4 - PROGRESS: at 97.55% examples, 307495 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:33:02,956 : INFO : EPOCH 4 - PROGRESS: at 98.64% examples, 307461 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:03,937 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:33:03,947 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:33:03,955 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:33:03,986 : INFO : EPOCH 4 - PROGRESS: at 99.86% examples, 307758 words/s, in_qsize 6, out_qsize 1
2020-04-16 18:33:03,987 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:33:04,004 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:33:04,013 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:33:04,040 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:33:04,047 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:33:04,050 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:33:04,056 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:33:04,058 : INFO : EPOCH - 4 : training on 41519355 raw words (30349540 effective words) took 98.6s, 307943 effective words/s
2020-04-16 18:33:05,195 : INFO : EPOCH 5 - PROGRESS: at 0.89% examples, 262007 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:06,343 : INFO : EPOCH 5 - PROGRESS: at 2.08% examples, 288302 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:07,472 : INFO : EPOCH 5 - PROGRESS: at 3.28% examples, 298591 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:08,473 : INFO : EPOCH 5 - PROGRESS: at 4.44% examples, 310948 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:09,497 : INFO : EPOCH 5 - PROGRESS: at 5.40% examples, 306674 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:10,500 : INFO : EPOCH 5 - PROGRESS: at 6.43% examples, 307970 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:11,570 : INFO : EPOCH 5 - PROGRESS: at 7.50% examples, 308178 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:12,570 : INFO : EPOCH 5 - PROGRESS: at 8.48% examples, 308283 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:13,593 : INFO : EPOCH 5 - PROGRESS: at 9.44% examples, 309926 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:14,628 : INFO : EPOCH 5 - PROGRESS: at 10.17% examples, 307414 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:15,645 : INFO : EPOCH 5 - PROGRESS: at 11.08% examples, 308954 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:16,696 : INFO : EPOCH 5 - PROGRESS: at 11.90% examples, 308341 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:17,698 : INFO : EPOCH 5 - PROGRESS: at 12.81% examples, 310488 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:18,735 : INFO : EPOCH 5 - PROGRESS: at 13.77% examples, 309658 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:33:19,742 : INFO : EPOCH 5 - PROGRESS: at 14.75% examples, 311308 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:20,805 : INFO : EPOCH 5 - PROGRESS: at 15.71% examples, 310139 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:33:21,810 : INFO : EPOCH 5 - PROGRESS: at 16.61% examples, 312040 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:22,859 : INFO : EPOCH 5 - PROGRESS: at 17.44% examples, 310761 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:23,860 : INFO : EPOCH 5 - PROGRESS: at 18.28% examples, 310633 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:24,963 : INFO : EPOCH 5 - PROGRESS: at 19.18% examples, 310312 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:33:26,011 : INFO : EPOCH 5 - PROGRESS: at 20.00% examples, 310189 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:33:27,055 : INFO : EPOCH 5 - PROGRESS: at 20.80% examples, 310168 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:28,068 : INFO : EPOCH 5 - PROGRESS: at 21.99% examples, 311036 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:29,086 : INFO : EPOCH 5 - PROGRESS: at 22.83% examples, 310773 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:30,115 : INFO : EPOCH 5 - PROGRESS: at 23.66% examples, 311489 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:31,130 : INFO : EPOCH 5 - PROGRESS: at 24.45% examples, 311207 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:32,156 : INFO : EPOCH 5 - PROGRESS: at 25.65% examples, 311887 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:33,170 : INFO : EPOCH 5 - PROGRESS: at 26.81% examples, 311983 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:34,200 : INFO : EPOCH 5 - PROGRESS: at 28.01% examples, 311608 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:35,200 : INFO : EPOCH 5 - PROGRESS: at 29.12% examples, 311562 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:36,206 : INFO : EPOCH 5 - PROGRESS: at 30.17% examples, 311439 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:37,210 : INFO : EPOCH 5 - PROGRESS: at 31.34% examples, 311189 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:33:38,219 : INFO : EPOCH 5 - PROGRESS: at 32.45% examples, 311050 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:33:39,276 : INFO : EPOCH 5 - PROGRESS: at 33.58% examples, 311125 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:40,283 : INFO : EPOCH 5 - PROGRESS: at 34.67% examples, 311478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:41,309 : INFO : EPOCH 5 - PROGRESS: at 35.78% examples, 311636 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:42,311 : INFO : EPOCH 5 - PROGRESS: at 36.91% examples, 311758 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:43,316 : INFO : EPOCH 5 - PROGRESS: at 38.04% examples, 312008 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:44,327 : INFO : EPOCH 5 - PROGRESS: at 39.19% examples, 311868 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:45,337 : INFO : EPOCH 5 - PROGRESS: at 40.12% examples, 310716 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:46,350 : INFO : EPOCH 5 - PROGRESS: at 41.14% examples, 309763 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:47,353 : INFO : EPOCH 5 - PROGRESS: at 42.26% examples, 309548 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:48,359 : INFO : EPOCH 5 - PROGRESS: at 43.34% examples, 309519 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:49,387 : INFO : EPOCH 5 - PROGRESS: at 44.52% examples, 309358 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:50,408 : INFO : EPOCH 5 - PROGRESS: at 45.66% examples, 309367 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:51,471 : INFO : EPOCH 5 - PROGRESS: at 46.79% examples, 309414 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:52,484 : INFO : EPOCH 5 - PROGRESS: at 47.89% examples, 309649 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:53,491 : INFO : EPOCH 5 - PROGRESS: at 49.08% examples, 309896 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:54,492 : INFO : EPOCH 5 - PROGRESS: at 50.13% examples, 309878 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:55,510 : INFO : EPOCH 5 - PROGRESS: at 51.27% examples, 310324 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:56,527 : INFO : EPOCH 5 - PROGRESS: at 52.28% examples, 310188 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:57,529 : INFO : EPOCH 5 - PROGRESS: at 53.34% examples, 310696 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:58,543 : INFO : EPOCH 5 - PROGRESS: at 54.32% examples, 310220 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:33:59,570 : INFO : EPOCH 5 - PROGRESS: at 55.40% examples, 309693 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:00,573 : INFO : EPOCH 5 - PROGRESS: at 56.31% examples, 308913 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:01,590 : INFO : EPOCH 5 - PROGRESS: at 57.29% examples, 308244 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:02,593 : INFO : EPOCH 5 - PROGRESS: at 58.17% examples, 307517 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:03,602 : INFO : EPOCH 5 - PROGRESS: at 59.16% examples, 307043 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:04,650 : INFO : EPOCH 5 - PROGRESS: at 60.15% examples, 306519 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:05,662 : INFO : EPOCH 5 - PROGRESS: at 61.24% examples, 306546 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:06,665 : INFO : EPOCH 5 - PROGRESS: at 62.37% examples, 306961 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:07,665 : INFO : EPOCH 5 - PROGRESS: at 63.47% examples, 306793 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:08,704 : INFO : EPOCH 5 - PROGRESS: at 64.67% examples, 306539 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:09,727 : INFO : EPOCH 5 - PROGRESS: at 65.57% examples, 306131 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:10,727 : INFO : EPOCH 5 - PROGRESS: at 66.51% examples, 305834 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:11,755 : INFO : EPOCH 5 - PROGRESS: at 67.48% examples, 305420 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:12,791 : INFO : EPOCH 5 - PROGRESS: at 68.45% examples, 305015 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:13,832 : INFO : EPOCH 5 - PROGRESS: at 69.38% examples, 304589 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:14,884 : INFO : EPOCH 5 - PROGRESS: at 70.27% examples, 304128 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:15,914 : INFO : EPOCH 5 - PROGRESS: at 71.22% examples, 303800 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:16,930 : INFO : EPOCH 5 - PROGRESS: at 72.20% examples, 303529 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:17,957 : INFO : EPOCH 5 - PROGRESS: at 73.24% examples, 303204 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:18,969 : INFO : EPOCH 5 - PROGRESS: at 74.28% examples, 303046 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:19,987 : INFO : EPOCH 5 - PROGRESS: at 75.22% examples, 302868 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:20,999 : INFO : EPOCH 5 - PROGRESS: at 76.11% examples, 302633 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:22,039 : INFO : EPOCH 5 - PROGRESS: at 77.07% examples, 302478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:23,047 : INFO : EPOCH 5 - PROGRESS: at 77.95% examples, 302247 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:24,058 : INFO : EPOCH 5 - PROGRESS: at 78.84% examples, 301847 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:25,062 : INFO : EPOCH 5 - PROGRESS: at 79.78% examples, 301583 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:26,062 : INFO : EPOCH 5 - PROGRESS: at 80.66% examples, 301325 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:27,076 : INFO : EPOCH 5 - PROGRESS: at 81.56% examples, 300941 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:28,129 : INFO : EPOCH 5 - PROGRESS: at 82.59% examples, 300686 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:29,132 : INFO : EPOCH 5 - PROGRESS: at 83.54% examples, 300522 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:30,134 : INFO : EPOCH 5 - PROGRESS: at 84.43% examples, 300362 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:31,146 : INFO : EPOCH 5 - PROGRESS: at 85.33% examples, 300163 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:32,176 : INFO : EPOCH 5 - PROGRESS: at 86.37% examples, 300001 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:33,200 : INFO : EPOCH 5 - PROGRESS: at 87.41% examples, 299795 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:34,208 : INFO : EPOCH 5 - PROGRESS: at 88.46% examples, 299639 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:35,220 : INFO : EPOCH 5 - PROGRESS: at 89.40% examples, 299252 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:36,245 : INFO : EPOCH 5 - PROGRESS: at 90.39% examples, 298979 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:37,296 : INFO : EPOCH 5 - PROGRESS: at 91.41% examples, 298705 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:38,309 : INFO : EPOCH 5 - PROGRESS: at 92.41% examples, 298485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:39,377 : INFO : EPOCH 5 - PROGRESS: at 93.27% examples, 298085 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:40,388 : INFO : EPOCH 5 - PROGRESS: at 94.30% examples, 297958 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:41,409 : INFO : EPOCH 5 - PROGRESS: at 95.30% examples, 297793 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:42,434 : INFO : EPOCH 5 - PROGRESS: at 96.42% examples, 298004 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:43,472 : INFO : EPOCH 5 - PROGRESS: at 97.53% examples, 298132 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:44,479 : INFO : EPOCH 5 - PROGRESS: at 98.66% examples, 298452 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:45,502 : INFO : EPOCH 5 - PROGRESS: at 99.70% examples, 298355 words/s, in_qsize 12, out_qsize 0
2020-04-16 18:34:45,541 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:34:45,555 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:34:45,576 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:34:45,603 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:34:45,623 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:34:45,624 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:34:45,637 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:34:45,659 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:34:45,676 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:34:45,683 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:34:45,683 : INFO : EPOCH - 5 : training on 41519355 raw words (30348067 effective words) took 101.6s, 298641 effective words/s
2020-04-16 18:34:45,684 : INFO : training on a 207596775 raw words (151746598 effective words) took 486.9s, 311637 effective words/s
2020-04-16 18:34:45,686 : WARNING : Effective 'alpha' higher than previous training cycles
2020-04-16 18:34:45,687 : INFO : training model with 10 workers on 70538 vocabulary and 150 features, using sg=1 hs=0 sample=0.001 negative=5 window=10
2020-04-16 18:34:46,804 : INFO : EPOCH 1 - PROGRESS: at 0.69% examples, 202715 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:47,819 : INFO : EPOCH 1 - PROGRESS: at 1.61% examples, 238639 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:48,825 : INFO : EPOCH 1 - PROGRESS: at 2.46% examples, 249208 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:49,885 : INFO : EPOCH 1 - PROGRESS: at 3.51% examples, 260247 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:50,889 : INFO : EPOCH 1 - PROGRESS: at 4.55% examples, 271136 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:51,907 : INFO : EPOCH 1 - PROGRESS: at 5.60% examples, 277719 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:52,916 : INFO : EPOCH 1 - PROGRESS: at 6.47% examples, 276678 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:53,937 : INFO : EPOCH 1 - PROGRESS: at 7.41% examples, 277329 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:54,944 : INFO : EPOCH 1 - PROGRESS: at 8.31% examples, 278206 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:34:55,951 : INFO : EPOCH 1 - PROGRESS: at 9.22% examples, 280291 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:56,966 : INFO : EPOCH 1 - PROGRESS: at 9.91% examples, 280547 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:34:57,998 : INFO : EPOCH 1 - PROGRESS: at 10.75% examples, 280463 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:34:59,000 : INFO : EPOCH 1 - PROGRESS: at 11.49% examples, 280427 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:00,030 : INFO : EPOCH 1 - PROGRESS: at 12.26% examples, 281798 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:01,033 : INFO : EPOCH 1 - PROGRESS: at 13.17% examples, 282664 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:02,046 : INFO : EPOCH 1 - PROGRESS: at 14.10% examples, 284913 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:03,058 : INFO : EPOCH 1 - PROGRESS: at 14.85% examples, 283659 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:04,060 : INFO : EPOCH 1 - PROGRESS: at 15.75% examples, 283567 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:05,089 : INFO : EPOCH 1 - PROGRESS: at 16.50% examples, 282988 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:06,104 : INFO : EPOCH 1 - PROGRESS: at 17.27% examples, 283079 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:07,111 : INFO : EPOCH 1 - PROGRESS: at 18.05% examples, 283177 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:08,119 : INFO : EPOCH 1 - PROGRESS: at 18.84% examples, 283250 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:09,132 : INFO : EPOCH 1 - PROGRESS: at 19.52% examples, 282898 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:10,183 : INFO : EPOCH 1 - PROGRESS: at 20.26% examples, 282421 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:35:11,222 : INFO : EPOCH 1 - PROGRESS: at 20.97% examples, 282244 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:12,275 : INFO : EPOCH 1 - PROGRESS: at 22.05% examples, 281753 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:13,316 : INFO : EPOCH 1 - PROGRESS: at 22.83% examples, 281580 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:14,369 : INFO : EPOCH 1 - PROGRESS: at 23.53% examples, 281280 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:15,392 : INFO : EPOCH 1 - PROGRESS: at 24.27% examples, 281252 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:16,398 : INFO : EPOCH 1 - PROGRESS: at 25.25% examples, 281893 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:17,398 : INFO : EPOCH 1 - PROGRESS: at 26.50% examples, 283484 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:18,406 : INFO : EPOCH 1 - PROGRESS: at 27.66% examples, 284241 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:19,426 : INFO : EPOCH 1 - PROGRESS: at 28.78% examples, 284845 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:20,430 : INFO : EPOCH 1 - PROGRESS: at 29.80% examples, 284886 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:21,499 : INFO : EPOCH 1 - PROGRESS: at 30.79% examples, 284267 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:35:22,530 : INFO : EPOCH 1 - PROGRESS: at 31.92% examples, 284148 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:23,563 : INFO : EPOCH 1 - PROGRESS: at 32.93% examples, 284005 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:24,598 : INFO : EPOCH 1 - PROGRESS: at 33.82% examples, 283859 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:25,622 : INFO : EPOCH 1 - PROGRESS: at 34.79% examples, 283681 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:26,635 : INFO : EPOCH 1 - PROGRESS: at 35.78% examples, 283536 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:27,664 : INFO : EPOCH 1 - PROGRESS: at 36.82% examples, 283450 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:28,672 : INFO : EPOCH 1 - PROGRESS: at 37.83% examples, 283652 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:29,692 : INFO : EPOCH 1 - PROGRESS: at 38.91% examples, 283778 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:30,741 : INFO : EPOCH 1 - PROGRESS: at 39.96% examples, 283895 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:31,768 : INFO : EPOCH 1 - PROGRESS: at 41.03% examples, 283830 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:32,794 : INFO : EPOCH 1 - PROGRESS: at 42.14% examples, 283765 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:33,815 : INFO : EPOCH 1 - PROGRESS: at 43.11% examples, 283572 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:34,844 : INFO : EPOCH 1 - PROGRESS: at 44.09% examples, 283077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:35,873 : INFO : EPOCH 1 - PROGRESS: at 45.17% examples, 283009 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:36,881 : INFO : EPOCH 1 - PROGRESS: at 46.19% examples, 282943 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:37,895 : INFO : EPOCH 1 - PROGRESS: at 47.08% examples, 282812 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:38,906 : INFO : EPOCH 1 - PROGRESS: at 48.05% examples, 282724 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:39,908 : INFO : EPOCH 1 - PROGRESS: at 49.04% examples, 282419 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:40,922 : INFO : EPOCH 1 - PROGRESS: at 50.06% examples, 282579 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:41,931 : INFO : EPOCH 1 - PROGRESS: at 51.04% examples, 282636 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:42,991 : INFO : EPOCH 1 - PROGRESS: at 52.01% examples, 282525 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:44,044 : INFO : EPOCH 1 - PROGRESS: at 52.91% examples, 282365 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:35:45,097 : INFO : EPOCH 1 - PROGRESS: at 53.85% examples, 282210 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:46,171 : INFO : EPOCH 1 - PROGRESS: at 54.82% examples, 282003 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:47,222 : INFO : EPOCH 1 - PROGRESS: at 55.94% examples, 281879 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:48,229 : INFO : EPOCH 1 - PROGRESS: at 56.74% examples, 281165 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:49,273 : INFO : EPOCH 1 - PROGRESS: at 57.65% examples, 280638 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:50,278 : INFO : EPOCH 1 - PROGRESS: at 58.51% examples, 280281 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:35:51,290 : INFO : EPOCH 1 - PROGRESS: at 59.55% examples, 280370 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:52,302 : INFO : EPOCH 1 - PROGRESS: at 60.51% examples, 280366 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:53,326 : INFO : EPOCH 1 - PROGRESS: at 61.50% examples, 280405 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:35:54,342 : INFO : EPOCH 1 - PROGRESS: at 62.62% examples, 280989 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:55,343 : INFO : EPOCH 1 - PROGRESS: at 63.78% examples, 281310 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:56,349 : INFO : EPOCH 1 - PROGRESS: at 64.98% examples, 281780 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:57,359 : INFO : EPOCH 1 - PROGRESS: at 65.91% examples, 282125 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:58,398 : INFO : EPOCH 1 - PROGRESS: at 66.97% examples, 282418 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:35:59,402 : INFO : EPOCH 1 - PROGRESS: at 68.09% examples, 282969 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:00,404 : INFO : EPOCH 1 - PROGRESS: at 69.10% examples, 283219 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:01,452 : INFO : EPOCH 1 - PROGRESS: at 70.07% examples, 283478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:02,475 : INFO : EPOCH 1 - PROGRESS: at 71.11% examples, 283941 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:03,506 : INFO : EPOCH 1 - PROGRESS: at 72.23% examples, 284356 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:04,516 : INFO : EPOCH 1 - PROGRESS: at 73.39% examples, 284721 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:36:05,517 : INFO : EPOCH 1 - PROGRESS: at 74.49% examples, 285208 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:06,541 : INFO : EPOCH 1 - PROGRESS: at 75.48% examples, 285438 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:07,582 : INFO : EPOCH 1 - PROGRESS: at 76.40% examples, 285572 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:36:08,606 : INFO : EPOCH 1 - PROGRESS: at 77.43% examples, 285952 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:09,626 : INFO : EPOCH 1 - PROGRESS: at 78.43% examples, 286160 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:36:10,636 : INFO : EPOCH 1 - PROGRESS: at 79.39% examples, 286237 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:36:11,643 : INFO : EPOCH 1 - PROGRESS: at 80.48% examples, 286740 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:12,672 : INFO : EPOCH 1 - PROGRESS: at 81.43% examples, 286820 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:13,684 : INFO : EPOCH 1 - PROGRESS: at 82.38% examples, 286627 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:14,688 : INFO : EPOCH 1 - PROGRESS: at 83.31% examples, 286473 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:36:15,712 : INFO : EPOCH 1 - PROGRESS: at 84.22% examples, 286411 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:16,735 : INFO : EPOCH 1 - PROGRESS: at 85.02% examples, 286103 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:17,737 : INFO : EPOCH 1 - PROGRESS: at 86.00% examples, 286112 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:18,752 : INFO : EPOCH 1 - PROGRESS: at 86.98% examples, 285863 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:19,772 : INFO : EPOCH 1 - PROGRESS: at 88.01% examples, 285756 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:20,790 : INFO : EPOCH 1 - PROGRESS: at 89.04% examples, 285741 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:21,845 : INFO : EPOCH 1 - PROGRESS: at 90.09% examples, 285759 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:22,872 : INFO : EPOCH 1 - PROGRESS: at 91.23% examples, 286080 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:23,928 : INFO : EPOCH 1 - PROGRESS: at 92.39% examples, 286313 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:24,932 : INFO : EPOCH 1 - PROGRESS: at 93.36% examples, 286534 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:25,933 : INFO : EPOCH 1 - PROGRESS: at 94.30% examples, 286341 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:26,947 : INFO : EPOCH 1 - PROGRESS: at 95.30% examples, 286321 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:27,948 : INFO : EPOCH 1 - PROGRESS: at 96.44% examples, 286775 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:28,974 : INFO : EPOCH 1 - PROGRESS: at 97.53% examples, 286978 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:29,980 : INFO : EPOCH 1 - PROGRESS: at 98.66% examples, 287396 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:30,985 : INFO : EPOCH 1 - PROGRESS: at 99.65% examples, 287325 words/s, in_qsize 14, out_qsize 0
2020-04-16 18:36:31,156 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:36:31,168 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:36:31,171 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:36:31,172 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:36:31,177 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:36:31,192 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:36:31,218 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:36:31,235 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:36:31,237 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:36:31,242 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:36:31,243 : INFO : EPOCH - 1 : training on 41519355 raw words (30349995 effective words) took 105.5s, 287547 effective words/s
2020-04-16 18:36:32,267 : INFO : EPOCH 2 - PROGRESS: at 0.76% examples, 248478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:33,273 : INFO : EPOCH 2 - PROGRESS: at 1.65% examples, 257182 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:34,285 : INFO : EPOCH 2 - PROGRESS: at 2.66% examples, 275571 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:35,395 : INFO : EPOCH 2 - PROGRESS: at 3.76% examples, 280163 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:36:36,409 : INFO : EPOCH 2 - PROGRESS: at 4.81% examples, 286861 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:37,485 : INFO : EPOCH 2 - PROGRESS: at 5.85% examples, 290248 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:38,487 : INFO : EPOCH 2 - PROGRESS: at 6.96% examples, 295828 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:39,495 : INFO : EPOCH 2 - PROGRESS: at 7.91% examples, 297167 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:40,552 : INFO : EPOCH 2 - PROGRESS: at 8.84% examples, 295057 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:41,552 : INFO : EPOCH 2 - PROGRESS: at 9.73% examples, 296988 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:42,554 : INFO : EPOCH 2 - PROGRESS: at 10.51% examples, 297529 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:43,581 : INFO : EPOCH 2 - PROGRESS: at 11.36% examples, 297817 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:44,612 : INFO : EPOCH 2 - PROGRESS: at 12.08% examples, 296863 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:45,637 : INFO : EPOCH 2 - PROGRESS: at 13.01% examples, 298217 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:36:46,662 : INFO : EPOCH 2 - PROGRESS: at 13.92% examples, 298443 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:36:47,677 : INFO : EPOCH 2 - PROGRESS: at 14.82% examples, 298883 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:48,687 : INFO : EPOCH 2 - PROGRESS: at 15.80% examples, 300239 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:36:49,726 : INFO : EPOCH 2 - PROGRESS: at 16.59% examples, 299332 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:50,732 : INFO : EPOCH 2 - PROGRESS: at 17.33% examples, 297962 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:51,735 : INFO : EPOCH 2 - PROGRESS: at 18.17% examples, 298061 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:52,754 : INFO : EPOCH 2 - PROGRESS: at 18.99% examples, 298257 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:53,759 : INFO : EPOCH 2 - PROGRESS: at 19.81% examples, 299269 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:54,809 : INFO : EPOCH 2 - PROGRESS: at 20.60% examples, 299599 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:55,810 : INFO : EPOCH 2 - PROGRESS: at 21.76% examples, 300161 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:36:56,860 : INFO : EPOCH 2 - PROGRESS: at 22.58% examples, 300518 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:57,873 : INFO : EPOCH 2 - PROGRESS: at 23.35% examples, 300168 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:58,899 : INFO : EPOCH 2 - PROGRESS: at 24.13% examples, 300201 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:36:59,918 : INFO : EPOCH 2 - PROGRESS: at 25.19% examples, 301082 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:37:00,932 : INFO : EPOCH 2 - PROGRESS: at 26.30% examples, 301047 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:01,934 : INFO : EPOCH 2 - PROGRESS: at 27.47% examples, 301577 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:02,957 : INFO : EPOCH 2 - PROGRESS: at 28.68% examples, 302305 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:03,990 : INFO : EPOCH 2 - PROGRESS: at 29.83% examples, 302424 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:04,996 : INFO : EPOCH 2 - PROGRESS: at 30.97% examples, 303074 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:06,016 : INFO : EPOCH 2 - PROGRESS: at 32.16% examples, 303266 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:07,016 : INFO : EPOCH 2 - PROGRESS: at 33.30% examples, 303846 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:08,073 : INFO : EPOCH 2 - PROGRESS: at 34.35% examples, 303784 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:09,075 : INFO : EPOCH 2 - PROGRESS: at 35.33% examples, 303565 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:10,087 : INFO : EPOCH 2 - PROGRESS: at 36.50% examples, 303808 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:11,192 : INFO : EPOCH 2 - PROGRESS: at 37.59% examples, 303533 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:12,195 : INFO : EPOCH 2 - PROGRESS: at 38.77% examples, 303821 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:13,268 : INFO : EPOCH 2 - PROGRESS: at 39.92% examples, 303967 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:14,269 : INFO : EPOCH 2 - PROGRESS: at 41.25% examples, 305108 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:15,278 : INFO : EPOCH 2 - PROGRESS: at 42.33% examples, 304801 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:16,283 : INFO : EPOCH 2 - PROGRESS: at 43.52% examples, 305540 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:17,295 : INFO : EPOCH 2 - PROGRESS: at 44.73% examples, 305714 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:18,302 : INFO : EPOCH 2 - PROGRESS: at 45.83% examples, 305754 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:37:19,359 : INFO : EPOCH 2 - PROGRESS: at 46.93% examples, 305907 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:20,392 : INFO : EPOCH 2 - PROGRESS: at 48.03% examples, 305946 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:21,394 : INFO : EPOCH 2 - PROGRESS: at 49.22% examples, 306299 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:37:22,407 : INFO : EPOCH 2 - PROGRESS: at 50.27% examples, 306277 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:23,420 : INFO : EPOCH 2 - PROGRESS: at 51.24% examples, 305851 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:24,452 : INFO : EPOCH 2 - PROGRESS: at 52.25% examples, 305580 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:25,468 : INFO : EPOCH 2 - PROGRESS: at 53.31% examples, 306216 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:26,469 : INFO : EPOCH 2 - PROGRESS: at 54.38% examples, 306311 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:27,530 : INFO : EPOCH 2 - PROGRESS: at 55.52% examples, 306055 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:28,592 : INFO : EPOCH 2 - PROGRESS: at 56.65% examples, 306066 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:29,634 : INFO : EPOCH 2 - PROGRESS: at 57.76% examples, 306169 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:30,635 : INFO : EPOCH 2 - PROGRESS: at 58.88% examples, 306478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:31,683 : INFO : EPOCH 2 - PROGRESS: at 59.90% examples, 306079 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:32,693 : INFO : EPOCH 2 - PROGRESS: at 60.90% examples, 305653 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:33,743 : INFO : EPOCH 2 - PROGRESS: at 61.89% examples, 305269 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:37:34,823 : INFO : EPOCH 2 - PROGRESS: at 63.00% examples, 305084 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:35,825 : INFO : EPOCH 2 - PROGRESS: at 64.36% examples, 305596 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:37:36,866 : INFO : EPOCH 2 - PROGRESS: at 65.39% examples, 305462 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:37,866 : INFO : EPOCH 2 - PROGRESS: at 66.51% examples, 306039 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:38,886 : INFO : EPOCH 2 - PROGRESS: at 67.52% examples, 305868 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:39,887 : INFO : EPOCH 2 - PROGRESS: at 68.66% examples, 306350 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:40,957 : INFO : EPOCH 2 - PROGRESS: at 69.66% examples, 306081 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:37:41,957 : INFO : EPOCH 2 - PROGRESS: at 70.72% examples, 306440 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:43,075 : INFO : EPOCH 2 - PROGRESS: at 71.75% examples, 306097 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:44,083 : INFO : EPOCH 2 - PROGRESS: at 73.00% examples, 306606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:45,127 : INFO : EPOCH 2 - PROGRESS: at 74.09% examples, 306370 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:46,179 : INFO : EPOCH 2 - PROGRESS: at 75.09% examples, 306287 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:37:47,229 : INFO : EPOCH 2 - PROGRESS: at 76.13% examples, 306518 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:48,237 : INFO : EPOCH 2 - PROGRESS: at 77.21% examples, 306994 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:49,251 : INFO : EPOCH 2 - PROGRESS: at 78.17% examples, 306876 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:50,270 : INFO : EPOCH 2 - PROGRESS: at 79.10% examples, 306558 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:51,272 : INFO : EPOCH 2 - PROGRESS: at 79.97% examples, 306059 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:52,276 : INFO : EPOCH 2 - PROGRESS: at 80.85% examples, 305644 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:53,278 : INFO : EPOCH 2 - PROGRESS: at 81.85% examples, 305508 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:54,318 : INFO : EPOCH 2 - PROGRESS: at 82.90% examples, 305414 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:37:55,337 : INFO : EPOCH 2 - PROGRESS: at 83.83% examples, 305136 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:56,340 : INFO : EPOCH 2 - PROGRESS: at 84.67% examples, 304827 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:57,358 : INFO : EPOCH 2 - PROGRESS: at 85.59% examples, 304476 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:37:58,375 : INFO : EPOCH 2 - PROGRESS: at 86.61% examples, 304146 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:37:59,411 : INFO : EPOCH 2 - PROGRESS: at 87.66% examples, 303855 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:00,433 : INFO : EPOCH 2 - PROGRESS: at 88.73% examples, 303682 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:01,446 : INFO : EPOCH 2 - PROGRESS: at 89.79% examples, 303717 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:38:02,461 : INFO : EPOCH 2 - PROGRESS: at 90.98% examples, 303989 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:03,475 : INFO : EPOCH 2 - PROGRESS: at 92.13% examples, 304167 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:04,479 : INFO : EPOCH 2 - PROGRESS: at 93.06% examples, 304053 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:05,496 : INFO : EPOCH 2 - PROGRESS: at 94.19% examples, 304145 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:06,507 : INFO : EPOCH 2 - PROGRESS: at 95.17% examples, 303941 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:07,519 : INFO : EPOCH 2 - PROGRESS: at 96.14% examples, 303749 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:38:08,562 : INFO : EPOCH 2 - PROGRESS: at 97.15% examples, 303450 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:09,615 : INFO : EPOCH 2 - PROGRESS: at 98.06% examples, 302905 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:10,657 : INFO : EPOCH 2 - PROGRESS: at 99.08% examples, 302634 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:11,312 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:38:11,370 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:38:11,404 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:38:11,420 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:38:11,430 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:38:11,436 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:38:11,451 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:38:11,481 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:38:11,484 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:38:11,495 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:38:11,495 : INFO : EPOCH - 2 : training on 41519355 raw words (30347617 effective words) took 100.2s, 302730 effective words/s
2020-04-16 18:38:12,508 : INFO : EPOCH 3 - PROGRESS: at 0.74% examples, 244155 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:13,512 : INFO : EPOCH 3 - PROGRESS: at 1.68% examples, 262461 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:14,515 : INFO : EPOCH 3 - PROGRESS: at 2.59% examples, 270574 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:15,541 : INFO : EPOCH 3 - PROGRESS: at 3.56% examples, 273291 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:16,553 : INFO : EPOCH 3 - PROGRESS: at 4.52% examples, 277130 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:17,559 : INFO : EPOCH 3 - PROGRESS: at 5.54% examples, 282262 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:18,635 : INFO : EPOCH 3 - PROGRESS: at 6.57% examples, 283995 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:19,646 : INFO : EPOCH 3 - PROGRESS: at 7.58% examples, 287635 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:20,646 : INFO : EPOCH 3 - PROGRESS: at 8.53% examples, 288429 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:21,660 : INFO : EPOCH 3 - PROGRESS: at 9.28% examples, 285118 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:38:22,697 : INFO : EPOCH 3 - PROGRESS: at 9.99% examples, 284322 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:23,715 : INFO : EPOCH 3 - PROGRESS: at 10.95% examples, 288934 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:24,726 : INFO : EPOCH 3 - PROGRESS: at 11.69% examples, 289191 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:25,729 : INFO : EPOCH 3 - PROGRESS: at 12.59% examples, 292481 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:26,735 : INFO : EPOCH 3 - PROGRESS: at 13.56% examples, 293047 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:27,740 : INFO : EPOCH 3 - PROGRESS: at 14.34% examples, 292153 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:28,782 : INFO : EPOCH 3 - PROGRESS: at 15.22% examples, 292091 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:29,784 : INFO : EPOCH 3 - PROGRESS: at 16.13% examples, 293126 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:30,824 : INFO : EPOCH 3 - PROGRESS: at 17.05% examples, 294457 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:31,901 : INFO : EPOCH 3 - PROGRESS: at 17.83% examples, 293457 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:32,942 : INFO : EPOCH 3 - PROGRESS: at 18.63% examples, 292593 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:33,955 : INFO : EPOCH 3 - PROGRESS: at 19.34% examples, 292060 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:35,004 : INFO : EPOCH 3 - PROGRESS: at 20.16% examples, 292752 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:36,036 : INFO : EPOCH 3 - PROGRESS: at 20.97% examples, 293694 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:37,051 : INFO : EPOCH 3 - PROGRESS: at 22.16% examples, 294861 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:38,052 : INFO : EPOCH 3 - PROGRESS: at 22.92% examples, 294328 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:39,061 : INFO : EPOCH 3 - PROGRESS: at 23.57% examples, 293470 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:40,069 : INFO : EPOCH 3 - PROGRESS: at 24.32% examples, 293187 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:41,101 : INFO : EPOCH 3 - PROGRESS: at 25.27% examples, 292453 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:42,109 : INFO : EPOCH 3 - PROGRESS: at 26.30% examples, 292037 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:43,150 : INFO : EPOCH 3 - PROGRESS: at 27.37% examples, 291550 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:44,177 : INFO : EPOCH 3 - PROGRESS: at 28.44% examples, 291233 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:38:45,200 : INFO : EPOCH 3 - PROGRESS: at 29.46% examples, 290913 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:46,220 : INFO : EPOCH 3 - PROGRESS: at 30.44% examples, 290690 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:38:47,236 : INFO : EPOCH 3 - PROGRESS: at 31.65% examples, 290910 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:48,239 : INFO : EPOCH 3 - PROGRESS: at 32.76% examples, 291592 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:49,243 : INFO : EPOCH 3 - PROGRESS: at 33.80% examples, 292434 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:50,317 : INFO : EPOCH 3 - PROGRESS: at 34.87% examples, 292376 words/s, in_qsize 15, out_qsize 4
2020-04-16 18:38:51,344 : INFO : EPOCH 3 - PROGRESS: at 35.96% examples, 292643 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:52,349 : INFO : EPOCH 3 - PROGRESS: at 36.95% examples, 292311 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:53,386 : INFO : EPOCH 3 - PROGRESS: at 37.83% examples, 291077 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:38:54,413 : INFO : EPOCH 3 - PROGRESS: at 38.85% examples, 290647 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:55,424 : INFO : EPOCH 3 - PROGRESS: at 39.92% examples, 290856 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:56,478 : INFO : EPOCH 3 - PROGRESS: at 41.19% examples, 291583 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:57,491 : INFO : EPOCH 3 - PROGRESS: at 42.37% examples, 292183 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:58,526 : INFO : EPOCH 3 - PROGRESS: at 43.52% examples, 292659 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:38:59,531 : INFO : EPOCH 3 - PROGRESS: at 44.62% examples, 292550 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:00,558 : INFO : EPOCH 3 - PROGRESS: at 45.69% examples, 292437 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:01,566 : INFO : EPOCH 3 - PROGRESS: at 46.76% examples, 292878 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:02,634 : INFO : EPOCH 3 - PROGRESS: at 47.87% examples, 293120 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:03,651 : INFO : EPOCH 3 - PROGRESS: at 49.00% examples, 293475 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:04,658 : INFO : EPOCH 3 - PROGRESS: at 50.06% examples, 293604 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:05,663 : INFO : EPOCH 3 - PROGRESS: at 51.08% examples, 293741 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:06,667 : INFO : EPOCH 3 - PROGRESS: at 52.08% examples, 293851 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:07,690 : INFO : EPOCH 3 - PROGRESS: at 53.01% examples, 293884 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:39:08,706 : INFO : EPOCH 3 - PROGRESS: at 54.07% examples, 294206 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:09,757 : INFO : EPOCH 3 - PROGRESS: at 55.23% examples, 294369 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:10,814 : INFO : EPOCH 3 - PROGRESS: at 56.39% examples, 294718 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:11,817 : INFO : EPOCH 3 - PROGRESS: at 57.52% examples, 295109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:12,854 : INFO : EPOCH 3 - PROGRESS: at 58.62% examples, 295527 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:13,860 : INFO : EPOCH 3 - PROGRESS: at 59.68% examples, 295516 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:14,898 : INFO : EPOCH 3 - PROGRESS: at 60.78% examples, 295732 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:15,945 : INFO : EPOCH 3 - PROGRESS: at 61.86% examples, 295982 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:16,981 : INFO : EPOCH 3 - PROGRESS: at 62.94% examples, 296035 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:39:17,995 : INFO : EPOCH 3 - PROGRESS: at 64.28% examples, 296514 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:19,063 : INFO : EPOCH 3 - PROGRESS: at 65.35% examples, 296514 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:39:20,065 : INFO : EPOCH 3 - PROGRESS: at 66.38% examples, 296879 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:21,098 : INFO : EPOCH 3 - PROGRESS: at 67.48% examples, 297101 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:39:22,108 : INFO : EPOCH 3 - PROGRESS: at 68.57% examples, 297549 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:23,139 : INFO : EPOCH 3 - PROGRESS: at 69.64% examples, 297785 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:39:24,149 : INFO : EPOCH 3 - PROGRESS: at 70.68% examples, 298109 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:25,185 : INFO : EPOCH 3 - PROGRESS: at 71.71% examples, 298235 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:26,196 : INFO : EPOCH 3 - PROGRESS: at 72.79% examples, 298246 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:27,227 : INFO : EPOCH 3 - PROGRESS: at 73.97% examples, 298454 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:28,238 : INFO : EPOCH 3 - PROGRESS: at 74.98% examples, 298639 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:29,251 : INFO : EPOCH 3 - PROGRESS: at 75.91% examples, 298566 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:30,267 : INFO : EPOCH 3 - PROGRESS: at 76.87% examples, 298648 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:31,269 : INFO : EPOCH 3 - PROGRESS: at 77.90% examples, 299034 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:39:32,276 : INFO : EPOCH 3 - PROGRESS: at 78.90% examples, 299217 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:33,280 : INFO : EPOCH 3 - PROGRESS: at 79.98% examples, 299520 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:34,292 : INFO : EPOCH 3 - PROGRESS: at 80.94% examples, 299509 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:35,330 : INFO : EPOCH 3 - PROGRESS: at 82.07% examples, 299746 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:36,416 : INFO : EPOCH 3 - PROGRESS: at 83.15% examples, 299653 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:37,440 : INFO : EPOCH 3 - PROGRESS: at 84.21% examples, 299932 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:38,522 : INFO : EPOCH 3 - PROGRESS: at 85.17% examples, 299828 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:39,529 : INFO : EPOCH 3 - PROGRESS: at 86.19% examples, 299832 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:39:40,529 : INFO : EPOCH 3 - PROGRESS: at 87.41% examples, 300195 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:41,574 : INFO : EPOCH 3 - PROGRESS: at 88.51% examples, 300075 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:42,583 : INFO : EPOCH 3 - PROGRESS: at 89.68% examples, 300408 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:43,621 : INFO : EPOCH 3 - PROGRESS: at 90.81% examples, 300480 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:44,664 : INFO : EPOCH 3 - PROGRESS: at 91.98% examples, 300759 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:45,669 : INFO : EPOCH 3 - PROGRESS: at 93.02% examples, 300911 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:46,684 : INFO : EPOCH 3 - PROGRESS: at 94.19% examples, 301197 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:47,732 : INFO : EPOCH 3 - PROGRESS: at 95.28% examples, 301216 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:48,767 : INFO : EPOCH 3 - PROGRESS: at 96.42% examples, 301430 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:49,769 : INFO : EPOCH 3 - PROGRESS: at 97.48% examples, 301490 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:50,800 : INFO : EPOCH 3 - PROGRESS: at 98.51% examples, 301415 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:51,827 : INFO : EPOCH 3 - PROGRESS: at 99.65% examples, 301565 words/s, in_qsize 14, out_qsize 0
2020-04-16 18:39:51,956 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:39:51,961 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:39:51,968 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:39:51,971 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:39:51,996 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:39:52,008 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:39:52,019 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:39:52,040 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:39:52,054 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:39:52,062 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:39:52,063 : INFO : EPOCH - 3 : training on 41519355 raw words (30352021 effective words) took 100.6s, 301826 effective words/s
2020-04-16 18:39:53,091 : INFO : EPOCH 4 - PROGRESS: at 0.87% examples, 283208 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:54,149 : INFO : EPOCH 4 - PROGRESS: at 1.86% examples, 281592 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:55,205 : INFO : EPOCH 4 - PROGRESS: at 2.80% examples, 278526 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:56,224 : INFO : EPOCH 4 - PROGRESS: at 3.75% examples, 279650 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:57,230 : INFO : EPOCH 4 - PROGRESS: at 4.86% examples, 289642 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:58,251 : INFO : EPOCH 4 - PROGRESS: at 5.85% examples, 292861 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:39:59,256 : INFO : EPOCH 4 - PROGRESS: at 6.94% examples, 296997 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:00,263 : INFO : EPOCH 4 - PROGRESS: at 7.93% examples, 299979 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:01,304 : INFO : EPOCH 4 - PROGRESS: at 8.89% examples, 299604 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:02,312 : INFO : EPOCH 4 - PROGRESS: at 9.79% examples, 302286 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:03,403 : INFO : EPOCH 4 - PROGRESS: at 10.62% examples, 299998 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:04,407 : INFO : EPOCH 4 - PROGRESS: at 11.42% examples, 299967 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:05,408 : INFO : EPOCH 4 - PROGRESS: at 12.16% examples, 300075 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:40:06,435 : INFO : EPOCH 4 - PROGRESS: at 13.17% examples, 301726 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:07,446 : INFO : EPOCH 4 - PROGRESS: at 14.03% examples, 301528 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:08,449 : INFO : EPOCH 4 - PROGRESS: at 15.01% examples, 303750 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:09,504 : INFO : EPOCH 4 - PROGRESS: at 15.93% examples, 303245 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:10,518 : INFO : EPOCH 4 - PROGRESS: at 16.86% examples, 304458 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:11,569 : INFO : EPOCH 4 - PROGRESS: at 17.68% examples, 304381 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:12,582 : INFO : EPOCH 4 - PROGRESS: at 18.58% examples, 304755 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:13,591 : INFO : EPOCH 4 - PROGRESS: at 19.37% examples, 305350 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:14,593 : INFO : EPOCH 4 - PROGRESS: at 20.13% examples, 304788 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:15,614 : INFO : EPOCH 4 - PROGRESS: at 20.89% examples, 304426 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:16,618 : INFO : EPOCH 4 - PROGRESS: at 22.08% examples, 305604 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:17,621 : INFO : EPOCH 4 - PROGRESS: at 22.90% examples, 305451 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:18,642 : INFO : EPOCH 4 - PROGRESS: at 23.71% examples, 306180 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:19,660 : INFO : EPOCH 4 - PROGRESS: at 24.50% examples, 306094 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:20,667 : INFO : EPOCH 4 - PROGRESS: at 25.72% examples, 307154 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:21,736 : INFO : EPOCH 4 - PROGRESS: at 26.87% examples, 306573 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:22,792 : INFO : EPOCH 4 - PROGRESS: at 28.23% examples, 307551 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:23,798 : INFO : EPOCH 4 - PROGRESS: at 29.25% examples, 307112 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:24,804 : INFO : EPOCH 4 - PROGRESS: at 30.33% examples, 307353 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:25,815 : INFO : EPOCH 4 - PROGRESS: at 31.62% examples, 307785 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:26,856 : INFO : EPOCH 4 - PROGRESS: at 32.64% examples, 307059 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:27,871 : INFO : EPOCH 4 - PROGRESS: at 33.70% examples, 307230 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:28,966 : INFO : EPOCH 4 - PROGRESS: at 34.81% examples, 307144 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:40:29,979 : INFO : EPOCH 4 - PROGRESS: at 36.10% examples, 308279 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:30,995 : INFO : EPOCH 4 - PROGRESS: at 37.10% examples, 307807 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:32,015 : INFO : EPOCH 4 - PROGRESS: at 38.38% examples, 308735 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:40:33,018 : INFO : EPOCH 4 - PROGRESS: at 39.44% examples, 308417 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:34,031 : INFO : EPOCH 4 - PROGRESS: at 40.60% examples, 309025 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:35,097 : INFO : EPOCH 4 - PROGRESS: at 41.86% examples, 308601 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:36,109 : INFO : EPOCH 4 - PROGRESS: at 42.92% examples, 308829 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:40:37,125 : INFO : EPOCH 4 - PROGRESS: at 44.12% examples, 308940 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:38,133 : INFO : EPOCH 4 - PROGRESS: at 45.23% examples, 308599 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:39,173 : INFO : EPOCH 4 - PROGRESS: at 46.32% examples, 308374 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:40,234 : INFO : EPOCH 4 - PROGRESS: at 47.42% examples, 308601 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:41,250 : INFO : EPOCH 4 - PROGRESS: at 48.56% examples, 308821 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:42,254 : INFO : EPOCH 4 - PROGRESS: at 49.70% examples, 309093 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:43,269 : INFO : EPOCH 4 - PROGRESS: at 50.83% examples, 309163 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:44,274 : INFO : EPOCH 4 - PROGRESS: at 51.86% examples, 309101 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:45,316 : INFO : EPOCH 4 - PROGRESS: at 52.89% examples, 309284 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:46,335 : INFO : EPOCH 4 - PROGRESS: at 53.96% examples, 309442 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:47,366 : INFO : EPOCH 4 - PROGRESS: at 55.07% examples, 309452 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:48,404 : INFO : EPOCH 4 - PROGRESS: at 56.18% examples, 309131 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:49,405 : INFO : EPOCH 4 - PROGRESS: at 57.29% examples, 309284 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:50,425 : INFO : EPOCH 4 - PROGRESS: at 58.37% examples, 309439 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:51,458 : INFO : EPOCH 4 - PROGRESS: at 59.41% examples, 309045 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:52,465 : INFO : EPOCH 4 - PROGRESS: at 60.56% examples, 309432 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:53,495 : INFO : EPOCH 4 - PROGRESS: at 61.63% examples, 309423 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:54,505 : INFO : EPOCH 4 - PROGRESS: at 62.83% examples, 309858 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:55,513 : INFO : EPOCH 4 - PROGRESS: at 64.05% examples, 309815 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:56,514 : INFO : EPOCH 4 - PROGRESS: at 65.07% examples, 309362 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:57,514 : INFO : EPOCH 4 - PROGRESS: at 65.87% examples, 308701 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:40:58,541 : INFO : EPOCH 4 - PROGRESS: at 66.92% examples, 308650 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:40:59,561 : INFO : EPOCH 4 - PROGRESS: at 68.04% examples, 308790 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:00,585 : INFO : EPOCH 4 - PROGRESS: at 69.10% examples, 308794 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:01,593 : INFO : EPOCH 4 - PROGRESS: at 70.02% examples, 308661 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:41:02,625 : INFO : EPOCH 4 - PROGRESS: at 71.03% examples, 308651 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:03,631 : INFO : EPOCH 4 - PROGRESS: at 72.12% examples, 308758 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:04,662 : INFO : EPOCH 4 - PROGRESS: at 73.24% examples, 308629 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:05,678 : INFO : EPOCH 4 - PROGRESS: at 74.38% examples, 308776 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:06,686 : INFO : EPOCH 4 - PROGRESS: at 75.43% examples, 308960 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:07,706 : INFO : EPOCH 4 - PROGRESS: at 76.34% examples, 308868 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:08,728 : INFO : EPOCH 4 - PROGRESS: at 77.43% examples, 309258 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:09,780 : INFO : EPOCH 4 - PROGRESS: at 78.41% examples, 308960 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:10,800 : INFO : EPOCH 4 - PROGRESS: at 79.47% examples, 309069 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:11,889 : INFO : EPOCH 4 - PROGRESS: at 80.51% examples, 308918 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:12,935 : INFO : EPOCH 4 - PROGRESS: at 81.43% examples, 308480 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:13,945 : INFO : EPOCH 4 - PROGRESS: at 82.42% examples, 308192 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:14,961 : INFO : EPOCH 4 - PROGRESS: at 83.50% examples, 308240 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:15,962 : INFO : EPOCH 4 - PROGRESS: at 84.35% examples, 307816 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:16,987 : INFO : EPOCH 4 - PROGRESS: at 85.35% examples, 307898 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:18,071 : INFO : EPOCH 4 - PROGRESS: at 86.44% examples, 307620 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:19,084 : INFO : EPOCH 4 - PROGRESS: at 87.66% examples, 307865 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:20,110 : INFO : EPOCH 4 - PROGRESS: at 88.79% examples, 307794 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:21,120 : INFO : EPOCH 4 - PROGRESS: at 89.79% examples, 307631 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:22,121 : INFO : EPOCH 4 - PROGRESS: at 90.93% examples, 307741 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:23,164 : INFO : EPOCH 4 - PROGRESS: at 92.10% examples, 307863 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:24,166 : INFO : EPOCH 4 - PROGRESS: at 93.11% examples, 307951 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:25,213 : INFO : EPOCH 4 - PROGRESS: at 94.28% examples, 308056 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:26,237 : INFO : EPOCH 4 - PROGRESS: at 95.30% examples, 307847 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:27,243 : INFO : EPOCH 4 - PROGRESS: at 96.47% examples, 308165 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:28,322 : INFO : EPOCH 4 - PROGRESS: at 97.53% examples, 307913 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:29,332 : INFO : EPOCH 4 - PROGRESS: at 98.69% examples, 308207 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:30,376 : INFO : EPOCH 4 - PROGRESS: at 99.79% examples, 308084 words/s, in_qsize 9, out_qsize 1
2020-04-16 18:41:30,377 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:41:30,387 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:41:30,397 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:41:30,398 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:41:30,408 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:41:30,413 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:41:30,413 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:41:30,430 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:41:30,437 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:41:30,449 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:41:30,450 : INFO : EPOCH - 4 : training on 41519355 raw words (30348746 effective words) took 98.4s, 308480 effective words/s
2020-04-16 18:41:31,569 : INFO : EPOCH 5 - PROGRESS: at 0.89% examples, 266104 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:32,576 : INFO : EPOCH 5 - PROGRESS: at 2.04% examples, 303126 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:33,585 : INFO : EPOCH 5 - PROGRESS: at 3.05% examples, 302286 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:34,604 : INFO : EPOCH 5 - PROGRESS: at 4.14% examples, 307981 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:35,660 : INFO : EPOCH 5 - PROGRESS: at 5.16% examples, 306527 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:36,690 : INFO : EPOCH 5 - PROGRESS: at 6.30% examples, 312355 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:37,693 : INFO : EPOCH 5 - PROGRESS: at 7.27% examples, 309839 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:38,700 : INFO : EPOCH 5 - PROGRESS: at 8.30% examples, 312087 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:41:39,715 : INFO : EPOCH 5 - PROGRESS: at 9.24% examples, 311258 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:41:40,722 : INFO : EPOCH 5 - PROGRESS: at 9.97% examples, 309399 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:41,724 : INFO : EPOCH 5 - PROGRESS: at 10.83% examples, 308736 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:42,768 : INFO : EPOCH 5 - PROGRESS: at 11.67% examples, 310059 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:43,776 : INFO : EPOCH 5 - PROGRESS: at 12.48% examples, 309694 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:44,799 : INFO : EPOCH 5 - PROGRESS: at 13.56% examples, 311246 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:41:45,802 : INFO : EPOCH 5 - PROGRESS: at 14.41% examples, 310529 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:46,803 : INFO : EPOCH 5 - PROGRESS: at 15.44% examples, 312314 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:47,814 : INFO : EPOCH 5 - PROGRESS: at 16.27% examples, 311562 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:41:48,839 : INFO : EPOCH 5 - PROGRESS: at 17.11% examples, 311063 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:49,860 : INFO : EPOCH 5 - PROGRESS: at 17.98% examples, 311418 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:50,882 : INFO : EPOCH 5 - PROGRESS: at 18.82% examples, 310591 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:51,910 : INFO : EPOCH 5 - PROGRESS: at 19.59% examples, 310033 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:52,927 : INFO : EPOCH 5 - PROGRESS: at 20.41% examples, 310009 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:53,948 : INFO : EPOCH 5 - PROGRESS: at 21.48% examples, 309587 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:54,981 : INFO : EPOCH 5 - PROGRESS: at 22.35% examples, 310044 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:56,064 : INFO : EPOCH 5 - PROGRESS: at 23.16% examples, 309318 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:57,067 : INFO : EPOCH 5 - PROGRESS: at 23.95% examples, 309533 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:58,073 : INFO : EPOCH 5 - PROGRESS: at 24.64% examples, 307623 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:41:59,116 : INFO : EPOCH 5 - PROGRESS: at 25.72% examples, 306498 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:00,123 : INFO : EPOCH 5 - PROGRESS: at 26.92% examples, 307066 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:01,171 : INFO : EPOCH 5 - PROGRESS: at 28.18% examples, 307159 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:02,177 : INFO : EPOCH 5 - PROGRESS: at 29.28% examples, 307400 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:42:03,188 : INFO : EPOCH 5 - PROGRESS: at 30.42% examples, 308044 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:04,218 : INFO : EPOCH 5 - PROGRESS: at 31.65% examples, 307848 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:05,222 : INFO : EPOCH 5 - PROGRESS: at 32.84% examples, 308696 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:06,225 : INFO : EPOCH 5 - PROGRESS: at 33.78% examples, 308308 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:07,274 : INFO : EPOCH 5 - PROGRESS: at 34.81% examples, 307789 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:08,289 : INFO : EPOCH 5 - PROGRESS: at 35.99% examples, 308330 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:09,304 : INFO : EPOCH 5 - PROGRESS: at 37.08% examples, 308233 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:10,313 : INFO : EPOCH 5 - PROGRESS: at 38.14% examples, 307816 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:11,315 : INFO : EPOCH 5 - PROGRESS: at 39.36% examples, 308557 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:12,352 : INFO : EPOCH 5 - PROGRESS: at 40.43% examples, 308306 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:13,367 : INFO : EPOCH 5 - PROGRESS: at 41.76% examples, 308941 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:14,404 : INFO : EPOCH 5 - PROGRESS: at 42.79% examples, 308659 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:15,453 : INFO : EPOCH 5 - PROGRESS: at 44.12% examples, 309335 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:16,478 : INFO : EPOCH 5 - PROGRESS: at 45.36% examples, 309643 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:17,486 : INFO : EPOCH 5 - PROGRESS: at 46.44% examples, 309750 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:18,501 : INFO : EPOCH 5 - PROGRESS: at 47.45% examples, 309488 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:19,510 : INFO : EPOCH 5 - PROGRESS: at 48.62% examples, 309897 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:20,542 : INFO : EPOCH 5 - PROGRESS: at 49.70% examples, 309684 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:21,542 : INFO : EPOCH 5 - PROGRESS: at 50.80% examples, 309691 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:22,576 : INFO : EPOCH 5 - PROGRESS: at 51.90% examples, 309865 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:23,594 : INFO : EPOCH 5 - PROGRESS: at 52.89% examples, 309889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:24,610 : INFO : EPOCH 5 - PROGRESS: at 53.98% examples, 310181 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:25,624 : INFO : EPOCH 5 - PROGRESS: at 55.07% examples, 310146 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:42:26,638 : INFO : EPOCH 5 - PROGRESS: at 56.27% examples, 310455 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:27,647 : INFO : EPOCH 5 - PROGRESS: at 57.39% examples, 310549 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:28,681 : INFO : EPOCH 5 - PROGRESS: at 58.49% examples, 310724 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:29,733 : INFO : EPOCH 5 - PROGRESS: at 59.62% examples, 310574 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:30,739 : INFO : EPOCH 5 - PROGRESS: at 60.66% examples, 310461 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:31,757 : INFO : EPOCH 5 - PROGRESS: at 61.74% examples, 310494 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:32,805 : INFO : EPOCH 5 - PROGRESS: at 62.85% examples, 310373 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:33,807 : INFO : EPOCH 5 - PROGRESS: at 64.14% examples, 310589 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:34,872 : INFO : EPOCH 5 - PROGRESS: at 65.26% examples, 310478 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:35,883 : INFO : EPOCH 5 - PROGRESS: at 66.26% examples, 310604 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:36,909 : INFO : EPOCH 5 - PROGRESS: at 67.38% examples, 310662 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:37,921 : INFO : EPOCH 5 - PROGRESS: at 68.49% examples, 310919 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:38,924 : INFO : EPOCH 5 - PROGRESS: at 69.51% examples, 310982 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:39,937 : INFO : EPOCH 5 - PROGRESS: at 70.57% examples, 311217 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:40,942 : INFO : EPOCH 5 - PROGRESS: at 71.59% examples, 311092 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:41,965 : INFO : EPOCH 5 - PROGRESS: at 72.63% examples, 310889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:42,983 : INFO : EPOCH 5 - PROGRESS: at 73.70% examples, 310485 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:43,989 : INFO : EPOCH 5 - PROGRESS: at 74.71% examples, 310346 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:45,027 : INFO : EPOCH 5 - PROGRESS: at 75.54% examples, 309709 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:46,048 : INFO : EPOCH 5 - PROGRESS: at 76.58% examples, 309980 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:47,094 : INFO : EPOCH 5 - PROGRESS: at 77.59% examples, 309975 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:48,097 : INFO : EPOCH 5 - PROGRESS: at 78.67% examples, 310237 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:49,099 : INFO : EPOCH 5 - PROGRESS: at 79.69% examples, 310219 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:50,105 : INFO : EPOCH 5 - PROGRESS: at 80.73% examples, 310461 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:42:51,113 : INFO : EPOCH 5 - PROGRESS: at 81.78% examples, 310422 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:42:52,120 : INFO : EPOCH 5 - PROGRESS: at 82.90% examples, 310656 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:53,121 : INFO : EPOCH 5 - PROGRESS: at 83.88% examples, 310548 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:54,154 : INFO : EPOCH 5 - PROGRESS: at 84.85% examples, 310486 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:55,194 : INFO : EPOCH 5 - PROGRESS: at 85.94% examples, 310487 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:56,208 : INFO : EPOCH 5 - PROGRESS: at 87.06% examples, 310437 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:57,219 : INFO : EPOCH 5 - PROGRESS: at 88.27% examples, 310721 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:58,248 : INFO : EPOCH 5 - PROGRESS: at 89.38% examples, 310631 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:42:59,278 : INFO : EPOCH 5 - PROGRESS: at 90.40% examples, 310287 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:00,308 : INFO : EPOCH 5 - PROGRESS: at 91.41% examples, 309944 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:01,310 : INFO : EPOCH 5 - PROGRESS: at 92.44% examples, 309787 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:02,323 : INFO : EPOCH 5 - PROGRESS: at 93.52% examples, 309978 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:03,354 : INFO : EPOCH 5 - PROGRESS: at 94.62% examples, 309963 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:04,357 : INFO : EPOCH 5 - PROGRESS: at 95.71% examples, 309967 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:05,359 : INFO : EPOCH 5 - PROGRESS: at 96.79% examples, 310106 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:06,421 : INFO : EPOCH 5 - PROGRESS: at 97.89% examples, 309959 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:07,432 : INFO : EPOCH 5 - PROGRESS: at 98.99% examples, 309936 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:43:08,145 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:43:08,166 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:43:08,194 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:43:08,199 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:43:08,220 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:43:08,233 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:43:08,270 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:43:08,271 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:43:08,278 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:43:08,289 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:43:08,290 : INFO : EPOCH - 5 : training on 41519355 raw words (30348063 effective words) took 97.8s, 310196 effective words/s
2020-04-16 18:43:09,296 : INFO : EPOCH 6 - PROGRESS: at 0.80% examples, 267597 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:10,359 : INFO : EPOCH 6 - PROGRESS: at 1.86% examples, 284009 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:11,379 : INFO : EPOCH 6 - PROGRESS: at 3.03% examples, 304493 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:12,406 : INFO : EPOCH 6 - PROGRESS: at 4.01% examples, 302165 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:13,418 : INFO : EPOCH 6 - PROGRESS: at 5.14% examples, 309993 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:14,444 : INFO : EPOCH 6 - PROGRESS: at 6.12% examples, 307217 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:15,468 : INFO : EPOCH 6 - PROGRESS: at 7.23% examples, 311616 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:16,484 : INFO : EPOCH 6 - PROGRESS: at 8.18% examples, 309756 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:17,487 : INFO : EPOCH 6 - PROGRESS: at 9.22% examples, 312703 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:18,551 : INFO : EPOCH 6 - PROGRESS: at 9.99% examples, 310382 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:19,557 : INFO : EPOCH 6 - PROGRESS: at 10.87% examples, 310793 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:20,573 : INFO : EPOCH 6 - PROGRESS: at 11.66% examples, 310262 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:43:21,596 : INFO : EPOCH 6 - PROGRESS: at 12.47% examples, 309552 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:22,611 : INFO : EPOCH 6 - PROGRESS: at 13.53% examples, 310807 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:23,629 : INFO : EPOCH 6 - PROGRESS: at 14.41% examples, 310785 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:24,634 : INFO : EPOCH 6 - PROGRESS: at 15.38% examples, 311537 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:25,700 : INFO : EPOCH 6 - PROGRESS: at 16.29% examples, 311111 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:26,716 : INFO : EPOCH 6 - PROGRESS: at 17.16% examples, 311579 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:27,757 : INFO : EPOCH 6 - PROGRESS: at 18.05% examples, 311558 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:28,770 : INFO : EPOCH 6 - PROGRESS: at 18.94% examples, 312257 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:29,777 : INFO : EPOCH 6 - PROGRESS: at 19.73% examples, 312260 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:30,790 : INFO : EPOCH 6 - PROGRESS: at 20.54% examples, 312215 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:31,825 : INFO : EPOCH 6 - PROGRESS: at 21.69% examples, 312404 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:32,838 : INFO : EPOCH 6 - PROGRESS: at 22.48% examples, 311534 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:33,849 : INFO : EPOCH 6 - PROGRESS: at 23.31% examples, 312184 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:34,890 : INFO : EPOCH 6 - PROGRESS: at 24.09% examples, 311566 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:35,903 : INFO : EPOCH 6 - PROGRESS: at 25.07% examples, 311595 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:36,952 : INFO : EPOCH 6 - PROGRESS: at 26.30% examples, 311791 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:37,953 : INFO : EPOCH 6 - PROGRESS: at 27.56% examples, 312711 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:43:38,957 : INFO : EPOCH 6 - PROGRESS: at 28.68% examples, 312582 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:39,970 : INFO : EPOCH 6 - PROGRESS: at 29.78% examples, 312130 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:40,971 : INFO : EPOCH 6 - PROGRESS: at 30.92% examples, 312542 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:41,976 : INFO : EPOCH 6 - PROGRESS: at 32.07% examples, 312385 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:43,000 : INFO : EPOCH 6 - PROGRESS: at 33.28% examples, 312917 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:44,011 : INFO : EPOCH 6 - PROGRESS: at 34.27% examples, 312593 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:45,050 : INFO : EPOCH 6 - PROGRESS: at 35.29% examples, 312005 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:46,056 : INFO : EPOCH 6 - PROGRESS: at 36.48% examples, 312288 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:47,146 : INFO : EPOCH 6 - PROGRESS: at 37.57% examples, 311882 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:48,149 : INFO : EPOCH 6 - PROGRESS: at 38.85% examples, 312861 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:49,181 : INFO : EPOCH 6 - PROGRESS: at 39.92% examples, 312379 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:50,258 : INFO : EPOCH 6 - PROGRESS: at 41.25% examples, 312791 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:43:51,277 : INFO : EPOCH 6 - PROGRESS: at 42.40% examples, 312893 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:52,319 : INFO : EPOCH 6 - PROGRESS: at 43.57% examples, 312871 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:53,333 : INFO : EPOCH 6 - PROGRESS: at 44.87% examples, 313347 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:54,359 : INFO : EPOCH 6 - PROGRESS: at 45.97% examples, 313099 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:55,369 : INFO : EPOCH 6 - PROGRESS: at 47.11% examples, 313722 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:56,417 : INFO : EPOCH 6 - PROGRESS: at 48.15% examples, 313185 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:57,438 : INFO : EPOCH 6 - PROGRESS: at 49.34% examples, 313262 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:58,515 : INFO : EPOCH 6 - PROGRESS: at 50.44% examples, 312989 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:43:59,559 : INFO : EPOCH 6 - PROGRESS: at 51.56% examples, 312920 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:00,567 : INFO : EPOCH 6 - PROGRESS: at 52.56% examples, 312803 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:44:01,625 : INFO : EPOCH 6 - PROGRESS: at 53.35% examples, 311584 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:02,650 : INFO : EPOCH 6 - PROGRESS: at 54.35% examples, 311032 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:03,658 : INFO : EPOCH 6 - PROGRESS: at 55.54% examples, 311242 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:04,710 : INFO : EPOCH 6 - PROGRESS: at 56.66% examples, 311208 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:05,729 : INFO : EPOCH 6 - PROGRESS: at 57.79% examples, 311350 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:06,766 : INFO : EPOCH 6 - PROGRESS: at 58.91% examples, 311377 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:44:07,785 : INFO : EPOCH 6 - PROGRESS: at 60.00% examples, 311407 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:08,832 : INFO : EPOCH 6 - PROGRESS: at 61.18% examples, 311530 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:09,857 : INFO : EPOCH 6 - PROGRESS: at 62.23% examples, 311522 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:10,934 : INFO : EPOCH 6 - PROGRESS: at 63.46% examples, 311474 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:11,948 : INFO : EPOCH 6 - PROGRESS: at 64.71% examples, 311488 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:12,957 : INFO : EPOCH 6 - PROGRESS: at 65.70% examples, 311620 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:13,975 : INFO : EPOCH 6 - PROGRESS: at 66.72% examples, 311468 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:14,985 : INFO : EPOCH 6 - PROGRESS: at 67.81% examples, 311390 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:16,008 : INFO : EPOCH 6 - PROGRESS: at 68.89% examples, 311470 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:17,013 : INFO : EPOCH 6 - PROGRESS: at 69.90% examples, 311513 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:18,045 : INFO : EPOCH 6 - PROGRESS: at 70.92% examples, 311665 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:19,049 : INFO : EPOCH 6 - PROGRESS: at 71.99% examples, 311733 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:20,059 : INFO : EPOCH 6 - PROGRESS: at 73.20% examples, 311964 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:21,087 : INFO : EPOCH 6 - PROGRESS: at 74.34% examples, 312009 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:22,119 : INFO : EPOCH 6 - PROGRESS: at 75.38% examples, 312046 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:23,158 : INFO : EPOCH 6 - PROGRESS: at 76.30% examples, 311844 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:44:24,162 : INFO : EPOCH 6 - PROGRESS: at 77.31% examples, 311887 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:25,164 : INFO : EPOCH 6 - PROGRESS: at 78.27% examples, 311851 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:26,201 : INFO : EPOCH 6 - PROGRESS: at 79.34% examples, 311759 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:27,225 : INFO : EPOCH 6 - PROGRESS: at 80.41% examples, 311917 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:28,233 : INFO : EPOCH 6 - PROGRESS: at 81.41% examples, 311941 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:29,246 : INFO : EPOCH 6 - PROGRESS: at 82.55% examples, 312124 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:30,260 : INFO : EPOCH 6 - PROGRESS: at 83.59% examples, 312129 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:31,298 : INFO : EPOCH 6 - PROGRESS: at 84.61% examples, 312200 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:44:32,303 : INFO : EPOCH 6 - PROGRESS: at 85.67% examples, 312309 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:33,339 : INFO : EPOCH 6 - PROGRESS: at 86.84% examples, 312316 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:44:34,341 : INFO : EPOCH 6 - PROGRESS: at 87.99% examples, 312291 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:35,360 : INFO : EPOCH 6 - PROGRESS: at 89.08% examples, 312207 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:36,397 : INFO : EPOCH 6 - PROGRESS: at 90.21% examples, 312138 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:37,409 : INFO : EPOCH 6 - PROGRESS: at 91.28% examples, 312080 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:38,427 : INFO : EPOCH 6 - PROGRESS: at 92.43% examples, 312163 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:39,443 : INFO : EPOCH 6 - PROGRESS: at 93.40% examples, 312077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:40,478 : INFO : EPOCH 6 - PROGRESS: at 94.52% examples, 312022 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:41,489 : INFO : EPOCH 6 - PROGRESS: at 95.65% examples, 312053 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:42,539 : INFO : EPOCH 6 - PROGRESS: at 96.77% examples, 312168 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:43,560 : INFO : EPOCH 6 - PROGRESS: at 97.89% examples, 312212 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:44,596 : INFO : EPOCH 6 - PROGRESS: at 99.02% examples, 312232 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:45,262 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:44:45,274 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:44:45,275 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:44:45,304 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:44:45,316 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:44:45,331 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:44:45,342 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:44:45,358 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:44:45,367 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:44:45,383 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:44:45,384 : INFO : EPOCH - 6 : training on 41519355 raw words (30345733 effective words) took 97.1s, 312561 effective words/s
2020-04-16 18:44:46,500 : INFO : EPOCH 7 - PROGRESS: at 0.87% examples, 260620 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:47,507 : INFO : EPOCH 7 - PROGRESS: at 1.93% examples, 286378 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:48,527 : INFO : EPOCH 7 - PROGRESS: at 2.94% examples, 292090 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:44:49,568 : INFO : EPOCH 7 - PROGRESS: at 3.99% examples, 295367 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:44:50,568 : INFO : EPOCH 7 - PROGRESS: at 5.05% examples, 301013 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:51,581 : INFO : EPOCH 7 - PROGRESS: at 6.10% examples, 303883 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:52,587 : INFO : EPOCH 7 - PROGRESS: at 7.14% examples, 305452 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:53,590 : INFO : EPOCH 7 - PROGRESS: at 8.13% examples, 307483 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:54,599 : INFO : EPOCH 7 - PROGRESS: at 9.12% examples, 308983 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:55,634 : INFO : EPOCH 7 - PROGRESS: at 9.93% examples, 309271 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:56,667 : INFO : EPOCH 7 - PROGRESS: at 10.80% examples, 307766 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:57,686 : INFO : EPOCH 7 - PROGRESS: at 11.64% examples, 308638 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:44:58,690 : INFO : EPOCH 7 - PROGRESS: at 12.44% examples, 308500 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:44:59,713 : INFO : EPOCH 7 - PROGRESS: at 13.40% examples, 307659 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:00,714 : INFO : EPOCH 7 - PROGRESS: at 14.30% examples, 308647 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:45:01,726 : INFO : EPOCH 7 - PROGRESS: at 15.22% examples, 309009 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:02,728 : INFO : EPOCH 7 - PROGRESS: at 16.00% examples, 306603 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:03,730 : INFO : EPOCH 7 - PROGRESS: at 16.74% examples, 304329 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:04,735 : INFO : EPOCH 7 - PROGRESS: at 17.58% examples, 304594 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:05,736 : INFO : EPOCH 7 - PROGRESS: at 18.44% examples, 304807 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:06,751 : INFO : EPOCH 7 - PROGRESS: at 19.26% examples, 305341 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:07,780 : INFO : EPOCH 7 - PROGRESS: at 20.08% examples, 305703 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:45:08,826 : INFO : EPOCH 7 - PROGRESS: at 20.89% examples, 305880 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:09,880 : INFO : EPOCH 7 - PROGRESS: at 22.04% examples, 305797 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:10,889 : INFO : EPOCH 7 - PROGRESS: at 22.90% examples, 306123 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:11,912 : INFO : EPOCH 7 - PROGRESS: at 23.64% examples, 305715 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:12,920 : INFO : EPOCH 7 - PROGRESS: at 24.45% examples, 306001 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:13,935 : INFO : EPOCH 7 - PROGRESS: at 25.57% examples, 306215 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:14,971 : INFO : EPOCH 7 - PROGRESS: at 26.81% examples, 307014 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:15,971 : INFO : EPOCH 7 - PROGRESS: at 28.01% examples, 307097 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:16,992 : INFO : EPOCH 7 - PROGRESS: at 29.21% examples, 307915 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:17,995 : INFO : EPOCH 7 - PROGRESS: at 30.26% examples, 307929 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:18,998 : INFO : EPOCH 7 - PROGRESS: at 31.57% examples, 308638 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:20,022 : INFO : EPOCH 7 - PROGRESS: at 32.64% examples, 308444 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:21,042 : INFO : EPOCH 7 - PROGRESS: at 33.66% examples, 308134 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:22,110 : INFO : EPOCH 7 - PROGRESS: at 34.77% examples, 308261 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:23,151 : INFO : EPOCH 7 - PROGRESS: at 35.86% examples, 307983 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:24,152 : INFO : EPOCH 7 - PROGRESS: at 37.03% examples, 308576 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:25,152 : INFO : EPOCH 7 - PROGRESS: at 38.10% examples, 308398 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:26,177 : INFO : EPOCH 7 - PROGRESS: at 39.27% examples, 308416 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:45:27,200 : INFO : EPOCH 7 - PROGRESS: at 40.43% examples, 308961 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:28,239 : INFO : EPOCH 7 - PROGRESS: at 41.66% examples, 308734 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:45:29,262 : INFO : EPOCH 7 - PROGRESS: at 42.79% examples, 309230 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:30,280 : INFO : EPOCH 7 - PROGRESS: at 43.96% examples, 309151 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:31,332 : INFO : EPOCH 7 - PROGRESS: at 45.25% examples, 309582 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:32,350 : INFO : EPOCH 7 - PROGRESS: at 46.32% examples, 309331 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:33,356 : INFO : EPOCH 7 - PROGRESS: at 47.37% examples, 309584 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:45:34,417 : INFO : EPOCH 7 - PROGRESS: at 48.45% examples, 309211 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:35,427 : INFO : EPOCH 7 - PROGRESS: at 49.55% examples, 309018 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:36,443 : INFO : EPOCH 7 - PROGRESS: at 50.64% examples, 309075 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:45:37,481 : INFO : EPOCH 7 - PROGRESS: at 51.77% examples, 309250 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:38,491 : INFO : EPOCH 7 - PROGRESS: at 52.78% examples, 309469 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:39,494 : INFO : EPOCH 7 - PROGRESS: at 53.81% examples, 309592 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:40,512 : INFO : EPOCH 7 - PROGRESS: at 54.82% examples, 309392 words/s, in_qsize 19, out_qsize 2
2020-04-16 18:45:41,525 : INFO : EPOCH 7 - PROGRESS: at 56.14% examples, 309977 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:42,543 : INFO : EPOCH 7 - PROGRESS: at 57.19% examples, 309785 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:43,548 : INFO : EPOCH 7 - PROGRESS: at 58.30% examples, 310141 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:44,559 : INFO : EPOCH 7 - PROGRESS: at 59.38% examples, 310093 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:45,569 : INFO : EPOCH 7 - PROGRESS: at 60.46% examples, 310077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:46,572 : INFO : EPOCH 7 - PROGRESS: at 61.49% examples, 309967 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:47,610 : INFO : EPOCH 7 - PROGRESS: at 62.60% examples, 309899 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:48,648 : INFO : EPOCH 7 - PROGRESS: at 63.87% examples, 310077 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:49,654 : INFO : EPOCH 7 - PROGRESS: at 65.05% examples, 310147 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:50,676 : INFO : EPOCH 7 - PROGRESS: at 66.06% examples, 310360 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:51,726 : INFO : EPOCH 7 - PROGRESS: at 67.13% examples, 310178 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:52,742 : INFO : EPOCH 7 - PROGRESS: at 68.26% examples, 310418 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:53,789 : INFO : EPOCH 7 - PROGRESS: at 69.33% examples, 310390 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:54,817 : INFO : EPOCH 7 - PROGRESS: at 70.36% examples, 310566 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:55,824 : INFO : EPOCH 7 - PROGRESS: at 71.42% examples, 310638 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:56,880 : INFO : EPOCH 7 - PROGRESS: at 72.53% examples, 310696 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:57,929 : INFO : EPOCH 7 - PROGRESS: at 73.72% examples, 310564 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:45:59,013 : INFO : EPOCH 7 - PROGRESS: at 74.82% examples, 310482 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:00,018 : INFO : EPOCH 7 - PROGRESS: at 75.80% examples, 310561 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:01,071 : INFO : EPOCH 7 - PROGRESS: at 76.83% examples, 310611 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:02,093 : INFO : EPOCH 7 - PROGRESS: at 77.82% examples, 310695 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:03,099 : INFO : EPOCH 7 - PROGRESS: at 78.86% examples, 310830 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:04,112 : INFO : EPOCH 7 - PROGRESS: at 79.76% examples, 310226 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:05,143 : INFO : EPOCH 7 - PROGRESS: at 80.62% examples, 309643 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:46:06,155 : INFO : EPOCH 7 - PROGRESS: at 81.65% examples, 309680 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:46:07,158 : INFO : EPOCH 7 - PROGRESS: at 82.73% examples, 309675 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:08,174 : INFO : EPOCH 7 - PROGRESS: at 83.78% examples, 309784 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:09,189 : INFO : EPOCH 7 - PROGRESS: at 84.76% examples, 309795 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:10,212 : INFO : EPOCH 7 - PROGRESS: at 85.81% examples, 309784 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:11,213 : INFO : EPOCH 7 - PROGRESS: at 86.94% examples, 309869 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:12,240 : INFO : EPOCH 7 - PROGRESS: at 88.11% examples, 309935 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:13,260 : INFO : EPOCH 7 - PROGRESS: at 89.12% examples, 309547 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:14,270 : INFO : EPOCH 7 - PROGRESS: at 90.12% examples, 309198 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:15,285 : INFO : EPOCH 7 - PROGRESS: at 91.06% examples, 308680 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:16,316 : INFO : EPOCH 7 - PROGRESS: at 92.07% examples, 308364 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:17,352 : INFO : EPOCH 7 - PROGRESS: at 93.08% examples, 308335 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:18,390 : INFO : EPOCH 7 - PROGRESS: at 94.19% examples, 308239 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:19,405 : INFO : EPOCH 7 - PROGRESS: at 95.17% examples, 307980 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:20,419 : INFO : EPOCH 7 - PROGRESS: at 96.12% examples, 307661 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:21,433 : INFO : EPOCH 7 - PROGRESS: at 97.09% examples, 307333 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:46:22,467 : INFO : EPOCH 7 - PROGRESS: at 98.13% examples, 307165 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:23,481 : INFO : EPOCH 7 - PROGRESS: at 99.10% examples, 306794 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:24,230 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:46:24,241 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:46:24,260 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:46:24,284 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:46:24,300 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:46:24,310 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:46:24,317 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:46:24,344 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:46:24,350 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:46:24,371 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:46:24,371 : INFO : EPOCH - 7 : training on 41519355 raw words (30349705 effective words) took 99.0s, 306618 effective words/s
2020-04-16 18:46:25,416 : INFO : EPOCH 8 - PROGRESS: at 0.69% examples, 217128 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:26,439 : INFO : EPOCH 8 - PROGRESS: at 1.63% examples, 249414 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:27,442 : INFO : EPOCH 8 - PROGRESS: at 2.71% examples, 278025 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:28,470 : INFO : EPOCH 8 - PROGRESS: at 3.73% examples, 282219 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:29,472 : INFO : EPOCH 8 - PROGRESS: at 4.60% examples, 279262 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:30,481 : INFO : EPOCH 8 - PROGRESS: at 5.43% examples, 274301 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:46:31,512 : INFO : EPOCH 8 - PROGRESS: at 6.33% examples, 273908 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:32,514 : INFO : EPOCH 8 - PROGRESS: at 7.36% examples, 279086 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:33,582 : INFO : EPOCH 8 - PROGRESS: at 8.38% examples, 281815 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:34,613 : INFO : EPOCH 8 - PROGRESS: at 9.24% examples, 281506 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:35,622 : INFO : EPOCH 8 - PROGRESS: at 9.99% examples, 283069 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:36,627 : INFO : EPOCH 8 - PROGRESS: at 10.85% examples, 285142 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:37,643 : INFO : EPOCH 8 - PROGRESS: at 11.63% examples, 285587 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:38,647 : INFO : EPOCH 8 - PROGRESS: at 12.40% examples, 286563 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:39,754 : INFO : EPOCH 8 - PROGRESS: at 13.34% examples, 285637 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:40,755 : INFO : EPOCH 8 - PROGRESS: at 14.28% examples, 288357 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:41,842 : INFO : EPOCH 8 - PROGRESS: at 15.19% examples, 288586 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:42,844 : INFO : EPOCH 8 - PROGRESS: at 16.18% examples, 290958 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:43,887 : INFO : EPOCH 8 - PROGRESS: at 17.05% examples, 291617 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:44,906 : INFO : EPOCH 8 - PROGRESS: at 17.94% examples, 293651 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:45,925 : INFO : EPOCH 8 - PROGRESS: at 18.80% examples, 294091 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:46,930 : INFO : EPOCH 8 - PROGRESS: at 19.63% examples, 295563 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:46:47,963 : INFO : EPOCH 8 - PROGRESS: at 20.45% examples, 295983 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:48,983 : INFO : EPOCH 8 - PROGRESS: at 21.57% examples, 297032 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:50,030 : INFO : EPOCH 8 - PROGRESS: at 22.45% examples, 297534 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:51,039 : INFO : EPOCH 8 - PROGRESS: at 23.27% examples, 298716 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:52,073 : INFO : EPOCH 8 - PROGRESS: at 24.07% examples, 298961 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:53,096 : INFO : EPOCH 8 - PROGRESS: at 25.03% examples, 299101 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:54,155 : INFO : EPOCH 8 - PROGRESS: at 26.27% examples, 299856 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:55,164 : INFO : EPOCH 8 - PROGRESS: at 27.41% examples, 300102 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:56,216 : INFO : EPOCH 8 - PROGRESS: at 28.65% examples, 300860 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:46:57,220 : INFO : EPOCH 8 - PROGRESS: at 29.78% examples, 301066 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:58,300 : INFO : EPOCH 8 - PROGRESS: at 31.01% examples, 301749 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:46:59,313 : INFO : EPOCH 8 - PROGRESS: at 32.25% examples, 302466 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:00,332 : INFO : EPOCH 8 - PROGRESS: at 33.35% examples, 302709 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:01,332 : INFO : EPOCH 8 - PROGRESS: at 34.42% examples, 303150 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:02,371 : INFO : EPOCH 8 - PROGRESS: at 35.53% examples, 303612 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:03,402 : INFO : EPOCH 8 - PROGRESS: at 36.72% examples, 304097 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:04,442 : INFO : EPOCH 8 - PROGRESS: at 37.85% examples, 304284 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:05,444 : INFO : EPOCH 8 - PROGRESS: at 38.88% examples, 303865 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:06,470 : INFO : EPOCH 8 - PROGRESS: at 39.85% examples, 303152 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:47:07,509 : INFO : EPOCH 8 - PROGRESS: at 40.96% examples, 302875 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:08,517 : INFO : EPOCH 8 - PROGRESS: at 42.19% examples, 303114 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:09,540 : INFO : EPOCH 8 - PROGRESS: at 43.28% examples, 303268 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:10,555 : INFO : EPOCH 8 - PROGRESS: at 44.44% examples, 303180 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:11,580 : INFO : EPOCH 8 - PROGRESS: at 45.58% examples, 303155 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:12,600 : INFO : EPOCH 8 - PROGRESS: at 46.66% examples, 303464 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:13,638 : INFO : EPOCH 8 - PROGRESS: at 47.77% examples, 303654 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:14,648 : INFO : EPOCH 8 - PROGRESS: at 48.94% examples, 304150 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:15,681 : INFO : EPOCH 8 - PROGRESS: at 50.06% examples, 304188 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:16,685 : INFO : EPOCH 8 - PROGRESS: at 51.16% examples, 304680 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:17,694 : INFO : EPOCH 8 - PROGRESS: at 52.23% examples, 304830 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:18,695 : INFO : EPOCH 8 - PROGRESS: at 53.17% examples, 304902 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:19,776 : INFO : EPOCH 8 - PROGRESS: at 54.32% examples, 305096 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:20,813 : INFO : EPOCH 8 - PROGRESS: at 55.52% examples, 305246 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:21,858 : INFO : EPOCH 8 - PROGRESS: at 56.65% examples, 305357 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:22,887 : INFO : EPOCH 8 - PROGRESS: at 57.76% examples, 305545 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:23,918 : INFO : EPOCH 8 - PROGRESS: at 58.91% examples, 305828 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:24,940 : INFO : EPOCH 8 - PROGRESS: at 60.00% examples, 305940 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:47:25,979 : INFO : EPOCH 8 - PROGRESS: at 61.15% examples, 306080 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:26,990 : INFO : EPOCH 8 - PROGRESS: at 62.20% examples, 306232 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:27,998 : INFO : EPOCH 8 - PROGRESS: at 63.30% examples, 306044 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:47:29,011 : INFO : EPOCH 8 - PROGRESS: at 64.61% examples, 306374 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:30,020 : INFO : EPOCH 8 - PROGRESS: at 65.59% examples, 306363 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:31,042 : INFO : EPOCH 8 - PROGRESS: at 66.65% examples, 306606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:32,096 : INFO : EPOCH 8 - PROGRESS: at 67.76% examples, 306495 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:33,104 : INFO : EPOCH 8 - PROGRESS: at 68.89% examples, 306933 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:34,113 : INFO : EPOCH 8 - PROGRESS: at 69.88% examples, 306926 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:35,130 : INFO : EPOCH 8 - PROGRESS: at 70.83% examples, 306799 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:36,158 : INFO : EPOCH 8 - PROGRESS: at 71.88% examples, 306931 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:47:37,207 : INFO : EPOCH 8 - PROGRESS: at 73.06% examples, 306956 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:38,208 : INFO : EPOCH 8 - PROGRESS: at 74.24% examples, 307283 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:47:39,216 : INFO : EPOCH 8 - PROGRESS: at 75.22% examples, 307279 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:40,224 : INFO : EPOCH 8 - PROGRESS: at 76.15% examples, 307190 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:41,226 : INFO : EPOCH 8 - PROGRESS: at 77.15% examples, 307299 words/s, in_qsize 17, out_qsize 2
2020-04-16 18:47:42,230 : INFO : EPOCH 8 - PROGRESS: at 78.10% examples, 307304 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:43,237 : INFO : EPOCH 8 - PROGRESS: at 79.14% examples, 307299 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:44,243 : INFO : EPOCH 8 - PROGRESS: at 80.16% examples, 307413 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:45,258 : INFO : EPOCH 8 - PROGRESS: at 81.18% examples, 307464 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:46,289 : INFO : EPOCH 8 - PROGRESS: at 82.31% examples, 307633 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:47,313 : INFO : EPOCH 8 - PROGRESS: at 83.41% examples, 307744 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:48,323 : INFO : EPOCH 8 - PROGRESS: at 84.39% examples, 307810 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:49,356 : INFO : EPOCH 8 - PROGRESS: at 85.41% examples, 307943 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:50,375 : INFO : EPOCH 8 - PROGRESS: at 86.56% examples, 307988 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:51,401 : INFO : EPOCH 8 - PROGRESS: at 87.75% examples, 308097 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:52,418 : INFO : EPOCH 8 - PROGRESS: at 88.88% examples, 308145 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:53,427 : INFO : EPOCH 8 - PROGRESS: at 90.04% examples, 308384 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:47:54,440 : INFO : EPOCH 8 - PROGRESS: at 91.16% examples, 308443 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:55,442 : INFO : EPOCH 8 - PROGRESS: at 92.31% examples, 308620 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:56,477 : INFO : EPOCH 8 - PROGRESS: at 93.32% examples, 308667 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:57,490 : INFO : EPOCH 8 - PROGRESS: at 94.48% examples, 308803 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:58,511 : INFO : EPOCH 8 - PROGRESS: at 95.56% examples, 308754 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:47:59,531 : INFO : EPOCH 8 - PROGRESS: at 96.60% examples, 308775 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:00,544 : INFO : EPOCH 8 - PROGRESS: at 97.66% examples, 308728 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:48:01,549 : INFO : EPOCH 8 - PROGRESS: at 98.83% examples, 308889 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:48:02,414 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:48:02,434 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:48:02,438 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:48:02,466 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:48:02,468 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:48:02,475 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:48:02,501 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:48:02,513 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:48:02,524 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:48:02,526 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:48:02,527 : INFO : EPOCH - 8 : training on 41519355 raw words (30349958 effective words) took 98.1s, 309227 effective words/s
2020-04-16 18:48:03,636 : INFO : EPOCH 9 - PROGRESS: at 0.89% examples, 268923 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:04,637 : INFO : EPOCH 9 - PROGRESS: at 1.95% examples, 291903 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:05,715 : INFO : EPOCH 9 - PROGRESS: at 3.05% examples, 297310 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:06,715 : INFO : EPOCH 9 - PROGRESS: at 4.06% examples, 300394 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:07,802 : INFO : EPOCH 9 - PROGRESS: at 4.94% examples, 289288 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:08,817 : INFO : EPOCH 9 - PROGRESS: at 5.85% examples, 288142 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:09,858 : INFO : EPOCH 9 - PROGRESS: at 6.96% examples, 292430 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:10,871 : INFO : EPOCH 9 - PROGRESS: at 7.93% examples, 294853 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:11,891 : INFO : EPOCH 9 - PROGRESS: at 8.95% examples, 298041 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:12,908 : INFO : EPOCH 9 - PROGRESS: at 9.80% examples, 299238 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:48:13,925 : INFO : EPOCH 9 - PROGRESS: at 10.72% examples, 301618 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:14,936 : INFO : EPOCH 9 - PROGRESS: at 11.54% examples, 302548 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:15,954 : INFO : EPOCH 9 - PROGRESS: at 12.39% examples, 304149 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:16,986 : INFO : EPOCH 9 - PROGRESS: at 13.38% examples, 304414 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:48:18,000 : INFO : EPOCH 9 - PROGRESS: at 14.28% examples, 305366 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:19,028 : INFO : EPOCH 9 - PROGRESS: at 15.22% examples, 306029 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:20,041 : INFO : EPOCH 9 - PROGRESS: at 16.18% examples, 306912 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:21,045 : INFO : EPOCH 9 - PROGRESS: at 17.05% examples, 307344 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:22,049 : INFO : EPOCH 9 - PROGRESS: at 17.83% examples, 306710 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:23,066 : INFO : EPOCH 9 - PROGRESS: at 18.69% examples, 306540 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:24,080 : INFO : EPOCH 9 - PROGRESS: at 19.48% examples, 307012 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:25,120 : INFO : EPOCH 9 - PROGRESS: at 20.30% examples, 306814 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:48:26,183 : INFO : EPOCH 9 - PROGRESS: at 21.48% examples, 307519 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:27,197 : INFO : EPOCH 9 - PROGRESS: at 22.35% examples, 308300 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:28,282 : INFO : EPOCH 9 - PROGRESS: at 23.16% examples, 307619 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:29,291 : INFO : EPOCH 9 - PROGRESS: at 24.02% examples, 308911 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:30,291 : INFO : EPOCH 9 - PROGRESS: at 24.94% examples, 308672 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:31,317 : INFO : EPOCH 9 - PROGRESS: at 26.18% examples, 309460 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:32,343 : INFO : EPOCH 9 - PROGRESS: at 27.37% examples, 309451 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:33,353 : INFO : EPOCH 9 - PROGRESS: at 28.58% examples, 310091 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:34,354 : INFO : EPOCH 9 - PROGRESS: at 29.69% examples, 310044 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:35,387 : INFO : EPOCH 9 - PROGRESS: at 30.79% examples, 309771 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:36,403 : INFO : EPOCH 9 - PROGRESS: at 32.00% examples, 309866 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:48:37,450 : INFO : EPOCH 9 - PROGRESS: at 33.09% examples, 309614 words/s, in_qsize 19, out_qsize 1
2020-04-16 18:48:38,451 : INFO : EPOCH 9 - PROGRESS: at 34.07% examples, 309455 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:39,452 : INFO : EPOCH 9 - PROGRESS: at 35.16% examples, 309688 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:40,466 : INFO : EPOCH 9 - PROGRESS: at 36.37% examples, 309953 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:41,468 : INFO : EPOCH 9 - PROGRESS: at 37.43% examples, 310121 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:42,510 : INFO : EPOCH 9 - PROGRESS: at 38.65% examples, 310298 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:43,511 : INFO : EPOCH 9 - PROGRESS: at 39.70% examples, 310285 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:44,522 : INFO : EPOCH 9 - PROGRESS: at 40.87% examples, 310534 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:48:45,572 : INFO : EPOCH 9 - PROGRESS: at 42.16% examples, 310645 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:46,583 : INFO : EPOCH 9 - PROGRESS: at 43.28% examples, 310878 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:47,586 : INFO : EPOCH 9 - PROGRESS: at 44.54% examples, 311343 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:48,641 : INFO : EPOCH 9 - PROGRESS: at 45.70% examples, 311086 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:49,647 : INFO : EPOCH 9 - PROGRESS: at 46.79% examples, 311315 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:50,686 : INFO : EPOCH 9 - PROGRESS: at 47.87% examples, 311213 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:51,719 : INFO : EPOCH 9 - PROGRESS: at 48.97% examples, 310974 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:52,746 : INFO : EPOCH 9 - PROGRESS: at 50.11% examples, 311059 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:53,761 : INFO : EPOCH 9 - PROGRESS: at 51.19% examples, 311216 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:54,795 : INFO : EPOCH 9 - PROGRESS: at 52.29% examples, 311366 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:55,818 : INFO : EPOCH 9 - PROGRESS: at 53.31% examples, 311599 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:56,848 : INFO : EPOCH 9 - PROGRESS: at 54.43% examples, 311828 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:57,860 : INFO : EPOCH 9 - PROGRESS: at 55.66% examples, 312000 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:58,864 : INFO : EPOCH 9 - PROGRESS: at 56.74% examples, 312085 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:48:59,867 : INFO : EPOCH 9 - PROGRESS: at 57.79% examples, 311914 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:00,870 : INFO : EPOCH 9 - PROGRESS: at 58.94% examples, 312249 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:01,892 : INFO : EPOCH 9 - PROGRESS: at 60.00% examples, 312129 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:02,907 : INFO : EPOCH 9 - PROGRESS: at 61.10% examples, 312041 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:03,909 : INFO : EPOCH 9 - PROGRESS: at 62.12% examples, 312022 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:49:04,910 : INFO : EPOCH 9 - PROGRESS: at 63.26% examples, 311992 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:05,916 : INFO : EPOCH 9 - PROGRESS: at 64.45% examples, 311705 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:06,919 : INFO : EPOCH 9 - PROGRESS: at 65.53% examples, 311980 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:07,966 : INFO : EPOCH 9 - PROGRESS: at 66.55% examples, 311797 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:08,984 : INFO : EPOCH 9 - PROGRESS: at 67.50% examples, 311221 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:10,019 : INFO : EPOCH 9 - PROGRESS: at 68.44% examples, 310519 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:49:11,023 : INFO : EPOCH 9 - PROGRESS: at 69.43% examples, 310474 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:12,032 : INFO : EPOCH 9 - PROGRESS: at 70.49% examples, 310734 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:13,063 : INFO : EPOCH 9 - PROGRESS: at 71.55% examples, 310709 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:14,078 : INFO : EPOCH 9 - PROGRESS: at 72.67% examples, 310939 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:49:15,089 : INFO : EPOCH 9 - PROGRESS: at 73.84% examples, 310969 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:16,091 : INFO : EPOCH 9 - PROGRESS: at 74.86% examples, 310938 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:17,100 : INFO : EPOCH 9 - PROGRESS: at 75.86% examples, 311090 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:18,122 : INFO : EPOCH 9 - PROGRESS: at 76.78% examples, 310785 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:19,128 : INFO : EPOCH 9 - PROGRESS: at 77.80% examples, 311015 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:20,207 : INFO : EPOCH 9 - PROGRESS: at 78.82% examples, 310770 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:21,232 : INFO : EPOCH 9 - PROGRESS: at 79.93% examples, 311027 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:22,237 : INFO : EPOCH 9 - PROGRESS: at 80.92% examples, 310985 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:49:23,264 : INFO : EPOCH 9 - PROGRESS: at 82.07% examples, 311218 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:24,274 : INFO : EPOCH 9 - PROGRESS: at 83.13% examples, 311165 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:25,275 : INFO : EPOCH 9 - PROGRESS: at 84.19% examples, 311404 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:26,284 : INFO : EPOCH 9 - PROGRESS: at 85.15% examples, 311416 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:27,293 : INFO : EPOCH 9 - PROGRESS: at 86.29% examples, 311606 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:28,299 : INFO : EPOCH 9 - PROGRESS: at 87.41% examples, 311572 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:29,315 : INFO : EPOCH 9 - PROGRESS: at 88.54% examples, 311500 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:30,344 : INFO : EPOCH 9 - PROGRESS: at 89.62% examples, 311394 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:31,385 : INFO : EPOCH 9 - PROGRESS: at 90.78% examples, 311407 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:32,434 : INFO : EPOCH 9 - PROGRESS: at 91.91% examples, 311383 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:33,435 : INFO : EPOCH 9 - PROGRESS: at 92.97% examples, 311517 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:34,437 : INFO : EPOCH 9 - PROGRESS: at 94.07% examples, 311585 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:35,467 : INFO : EPOCH 9 - PROGRESS: at 95.20% examples, 311626 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:36,470 : INFO : EPOCH 9 - PROGRESS: at 96.29% examples, 311762 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:37,491 : INFO : EPOCH 9 - PROGRESS: at 97.41% examples, 311739 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:38,494 : INFO : EPOCH 9 - PROGRESS: at 98.51% examples, 311860 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:49:39,506 : INFO : EPOCH 9 - PROGRESS: at 99.62% examples, 311875 words/s, in_qsize 15, out_qsize 0
2020-04-16 18:49:39,648 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:49:39,678 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:49:39,682 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:49:39,702 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:49:39,728 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:49:39,735 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:49:39,767 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:49:39,786 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:49:39,793 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:49:39,804 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:49:39,805 : INFO : EPOCH - 9 : training on 41519355 raw words (30348495 effective words) took 97.3s, 311994 effective words/s
2020-04-16 18:49:40,811 : INFO : EPOCH 10 - PROGRESS: at 0.82% examples, 274909 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:41,853 : INFO : EPOCH 10 - PROGRESS: at 1.86% examples, 286859 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:42,862 : INFO : EPOCH 10 - PROGRESS: at 2.82% examples, 288758 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:49:43,862 : INFO : EPOCH 10 - PROGRESS: at 3.90% examples, 297595 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:44,918 : INFO : EPOCH 10 - PROGRESS: at 4.97% examples, 299878 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:45,931 : INFO : EPOCH 10 - PROGRESS: at 6.03% examples, 304155 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:46,966 : INFO : EPOCH 10 - PROGRESS: at 7.07% examples, 304460 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:47,973 : INFO : EPOCH 10 - PROGRESS: at 8.11% examples, 308311 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:48,990 : INFO : EPOCH 10 - PROGRESS: at 9.05% examples, 307845 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:49,995 : INFO : EPOCH 10 - PROGRESS: at 9.91% examples, 310530 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:51,028 : INFO : EPOCH 10 - PROGRESS: at 10.81% examples, 309594 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:52,036 : INFO : EPOCH 10 - PROGRESS: at 11.62% examples, 309957 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:53,038 : INFO : EPOCH 10 - PROGRESS: at 12.44% examples, 310286 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:54,041 : INFO : EPOCH 10 - PROGRESS: at 13.40% examples, 309708 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:55,082 : INFO : EPOCH 10 - PROGRESS: at 14.25% examples, 308375 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:56,110 : INFO : EPOCH 10 - PROGRESS: at 15.22% examples, 309713 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:57,121 : INFO : EPOCH 10 - PROGRESS: at 16.13% examples, 309603 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:58,135 : INFO : EPOCH 10 - PROGRESS: at 17.05% examples, 310509 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:49:59,162 : INFO : EPOCH 10 - PROGRESS: at 17.89% examples, 310457 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:00,164 : INFO : EPOCH 10 - PROGRESS: at 18.80% examples, 311350 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:01,184 : INFO : EPOCH 10 - PROGRESS: at 19.59% examples, 311224 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:02,200 : INFO : EPOCH 10 - PROGRESS: at 20.42% examples, 311476 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:03,204 : INFO : EPOCH 10 - PROGRESS: at 21.52% examples, 311522 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:04,212 : INFO : EPOCH 10 - PROGRESS: at 22.35% examples, 311625 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:05,226 : INFO : EPOCH 10 - PROGRESS: at 23.18% examples, 311969 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:06,259 : INFO : EPOCH 10 - PROGRESS: at 23.93% examples, 311181 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:07,269 : INFO : EPOCH 10 - PROGRESS: at 24.75% examples, 310472 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:08,351 : INFO : EPOCH 10 - PROGRESS: at 26.03% examples, 310820 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:09,353 : INFO : EPOCH 10 - PROGRESS: at 27.19% examples, 310543 words/s, in_qsize 18, out_qsize 1
2020-04-16 18:50:10,401 : INFO : EPOCH 10 - PROGRESS: at 28.23% examples, 308889 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:11,456 : INFO : EPOCH 10 - PROGRESS: at 29.23% examples, 307719 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:12,476 : INFO : EPOCH 10 - PROGRESS: at 30.33% examples, 308017 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:13,522 : INFO : EPOCH 10 - PROGRESS: at 31.62% examples, 308113 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:14,526 : INFO : EPOCH 10 - PROGRESS: at 32.84% examples, 309154 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:15,545 : INFO : EPOCH 10 - PROGRESS: at 33.80% examples, 308826 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:16,546 : INFO : EPOCH 10 - PROGRESS: at 34.89% examples, 309102 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:17,581 : INFO : EPOCH 10 - PROGRESS: at 36.10% examples, 309436 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:18,582 : INFO : EPOCH 10 - PROGRESS: at 37.14% examples, 309420 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:19,622 : INFO : EPOCH 10 - PROGRESS: at 38.38% examples, 309802 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:20,632 : INFO : EPOCH 10 - PROGRESS: at 39.49% examples, 309945 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:21,646 : INFO : EPOCH 10 - PROGRESS: at 40.64% examples, 310336 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:22,675 : INFO : EPOCH 10 - PROGRESS: at 41.92% examples, 310301 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:23,690 : INFO : EPOCH 10 - PROGRESS: at 43.04% examples, 310657 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:24,724 : INFO : EPOCH 10 - PROGRESS: at 44.24% examples, 310591 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:25,760 : INFO : EPOCH 10 - PROGRESS: at 45.49% examples, 310802 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:26,821 : INFO : EPOCH 10 - PROGRESS: at 46.54% examples, 310537 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:27,843 : INFO : EPOCH 10 - PROGRESS: at 47.63% examples, 310678 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:28,879 : INFO : EPOCH 10 - PROGRESS: at 48.78% examples, 310739 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:29,892 : INFO : EPOCH 10 - PROGRESS: at 49.93% examples, 311049 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:50:30,900 : INFO : EPOCH 10 - PROGRESS: at 51.04% examples, 311121 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:31,910 : INFO : EPOCH 10 - PROGRESS: at 52.05% examples, 311003 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:32,916 : INFO : EPOCH 10 - PROGRESS: at 53.10% examples, 311475 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:33,916 : INFO : EPOCH 10 - PROGRESS: at 54.12% examples, 311317 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:34,932 : INFO : EPOCH 10 - PROGRESS: at 55.37% examples, 311757 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:35,963 : INFO : EPOCH 10 - PROGRESS: at 56.42% examples, 311431 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:36,969 : INFO : EPOCH 10 - PROGRESS: at 57.59% examples, 311790 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:38,007 : INFO : EPOCH 10 - PROGRESS: at 58.65% examples, 311675 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:39,026 : INFO : EPOCH 10 - PROGRESS: at 59.77% examples, 311689 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:40,061 : INFO : EPOCH 10 - PROGRESS: at 60.93% examples, 311881 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:41,085 : INFO : EPOCH 10 - PROGRESS: at 62.00% examples, 311876 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:42,139 : INFO : EPOCH 10 - PROGRESS: at 63.18% examples, 311931 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:43,153 : INFO : EPOCH 10 - PROGRESS: at 64.41% examples, 311832 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:44,162 : INFO : EPOCH 10 - PROGRESS: at 65.51% examples, 312085 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:45,164 : INFO : EPOCH 10 - PROGRESS: at 66.47% examples, 311893 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:50:46,171 : INFO : EPOCH 10 - PROGRESS: at 67.58% examples, 312017 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:50:47,174 : INFO : EPOCH 10 - PROGRESS: at 68.66% examples, 312191 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:48,187 : INFO : EPOCH 10 - PROGRESS: at 69.66% examples, 312079 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:49,188 : INFO : EPOCH 10 - PROGRESS: at 70.70% examples, 312250 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:50,225 : INFO : EPOCH 10 - PROGRESS: at 71.71% examples, 312067 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:51,239 : INFO : EPOCH 10 - PROGRESS: at 72.92% examples, 312373 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:52,265 : INFO : EPOCH 10 - PROGRESS: at 74.07% examples, 312316 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:53,280 : INFO : EPOCH 10 - PROGRESS: at 75.10% examples, 312501 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:54,285 : INFO : EPOCH 10 - PROGRESS: at 76.09% examples, 312548 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:55,288 : INFO : EPOCH 10 - PROGRESS: at 77.11% examples, 312680 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:56,297 : INFO : EPOCH 10 - PROGRESS: at 78.08% examples, 312691 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:57,306 : INFO : EPOCH 10 - PROGRESS: at 79.14% examples, 312708 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:58,384 : INFO : EPOCH 10 - PROGRESS: at 80.16% examples, 312467 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:50:59,401 : INFO : EPOCH 10 - PROGRESS: at 81.19% examples, 312531 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:51:00,401 : INFO : EPOCH 10 - PROGRESS: at 82.28% examples, 312582 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:01,409 : INFO : EPOCH 10 - PROGRESS: at 83.33% examples, 312524 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:02,411 : INFO : EPOCH 10 - PROGRESS: at 84.35% examples, 312649 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:03,424 : INFO : EPOCH 10 - PROGRESS: at 85.31% examples, 312545 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:04,450 : INFO : EPOCH 10 - PROGRESS: at 86.47% examples, 312669 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:05,496 : INFO : EPOCH 10 - PROGRESS: at 87.64% examples, 312566 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:06,506 : INFO : EPOCH 10 - PROGRESS: at 88.86% examples, 312841 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:07,535 : INFO : EPOCH 10 - PROGRESS: at 89.94% examples, 312711 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:08,551 : INFO : EPOCH 10 - PROGRESS: at 91.14% examples, 312958 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:09,588 : INFO : EPOCH 10 - PROGRESS: at 92.21% examples, 312725 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:10,615 : INFO : EPOCH 10 - PROGRESS: at 93.27% examples, 312914 words/s, in_qsize 20, out_qsize 0
2020-04-16 18:51:11,674 : INFO : EPOCH 10 - PROGRESS: at 94.32% examples, 312532 words/s, in_qsize 20, out_qsize 1
2020-04-16 18:51:12,694 : INFO : EPOCH 10 - PROGRESS: at 95.30% examples, 312132 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:13,714 : INFO : EPOCH 10 - PROGRESS: at 96.19% examples, 311592 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:14,729 : INFO : EPOCH 10 - PROGRESS: at 97.35% examples, 311667 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:15,753 : INFO : EPOCH 10 - PROGRESS: at 98.43% examples, 311718 words/s, in_qsize 19, out_qsize 0
2020-04-16 18:51:16,784 : INFO : EPOCH 10 - PROGRESS: at 99.54% examples, 311679 words/s, in_qsize 18, out_qsize 0
2020-04-16 18:51:16,973 : INFO : worker thread finished; awaiting finish of 9 more threads
2020-04-16 18:51:17,024 : INFO : worker thread finished; awaiting finish of 8 more threads
2020-04-16 18:51:17,027 : INFO : worker thread finished; awaiting finish of 7 more threads
2020-04-16 18:51:17,045 : INFO : worker thread finished; awaiting finish of 6 more threads
2020-04-16 18:51:17,047 : INFO : worker thread finished; awaiting finish of 5 more threads
2020-04-16 18:51:17,053 : INFO : worker thread finished; awaiting finish of 4 more threads
2020-04-16 18:51:17,060 : INFO : worker thread finished; awaiting finish of 3 more threads
2020-04-16 18:51:17,090 : INFO : worker thread finished; awaiting finish of 2 more threads
2020-04-16 18:51:17,098 : INFO : worker thread finished; awaiting finish of 1 more threads
2020-04-16 18:51:17,108 : INFO : worker thread finished; awaiting finish of 0 more threads
2020-04-16 18:51:17,109 : INFO : EPOCH - 10 : training on 41519355 raw words (30350680 effective words) took 97.3s, 311936 effective words/s
2020-04-16 18:51:17,109 : INFO : training on a 415193550 raw words (303491013 effective words) took 991.4s, 306118 effective words/s

CPU times: user 2h 5min 47s, sys: 18 s, total: 2h 6min 5s
Wall time: 16min 31s

(303491013, 415193550)

Save the models

# save only the word vectors
model_cbow.wv.save("cbow_vector.bin")
model_subword.wv.save("subword_vector.bin")
model_skipgram.wv.save("skipgram_vector.bin")

2020-04-16 18:51:17,117 : INFO : saving Word2VecKeyedVectors object under cbow_vector.bin, separately None
2020-04-16 18:51:17,118 : INFO : storing np array 'vectors' to cbow_vector.bin.vectors.npy
2020-04-16 18:51:18,814 : INFO : not storing attribute vectors_norm
2020-04-16 18:51:19,090 : INFO : saved cbow_vector.bin
2020-04-16 18:51:19,091 : INFO : saving FastTextKeyedVectors object under subword_vector.bin, separately None
2020-04-16 18:51:19,092 : INFO : storing np array 'vectors' to subword_vector.bin.vectors.npy
2020-04-16 18:51:21,169 : INFO : storing np array 'vectors_vocab' to subword_vector.bin.vectors_vocab.npy
2020-04-16 18:51:23,616 : INFO : storing np array 'vectors_ngrams' to subword_vector.bin.vectors_ngrams.npy
2020-04-16 18:51:33,844 : INFO : not storing attribute vectors_norm
2020-04-16 18:51:33,846 : INFO : not storing attribute vectors_vocab_norm
2020-04-16 18:51:33,846 : INFO : not storing attribute vectors_ngrams_norm
2020-04-16 18:51:33,848 : INFO : not storing attribute buckets_word
2020-04-16 18:51:34,266 : INFO : saved subword_vector.bin
2020-04-16 18:51:34,267 : INFO : saving Word2VecKeyedVectors object under skipgram_vector.bin, separately None
2020-04-16 18:51:34,268 : INFO : storing np array 'vectors' to skipgram_vector.bin.vectors.npy
2020-04-16 18:51:35,608 : INFO : not storing attribute vectors_norm
2020-04-16 18:51:35,870 : INFO : saved skipgram_vector.bin

from gensim.models import KeyedVectors
from IPython.display import display_html
import pandas as pd 

cbow_vectors = KeyedVectors.load("cbow_vector.bin")
subword_vectors = KeyedVectors.load("subword_vector.bin")
skipgram_vectors = KeyedVectors.load("skipgram_vector.bin")

2020-04-16 18:51:37,336 : INFO : loading Word2VecKeyedVectors object from cbow_vector.bin
2020-04-16 18:51:38,283 : INFO : loading vectors from cbow_vector.bin.vectors.npy with mmap=None
2020-04-16 18:51:38,320 : INFO : setting ignored attribute vectors_norm to None
2020-04-16 18:51:38,322 : INFO : loaded cbow_vector.bin
2020-04-16 18:51:38,322 : INFO : loading Word2VecKeyedVectors object from subword_vector.bin
2020-04-16 18:51:38,479 : INFO : loading vectors from subword_vector.bin.vectors.npy with mmap=None
2020-04-16 18:51:38,509 : INFO : loading vectors_vocab from subword_vector.bin.vectors_vocab.npy with mmap=None
2020-04-16 18:51:38,538 : INFO : loading vectors_ngrams from subword_vector.bin.vectors_ngrams.npy with mmap=None
2020-04-16 18:51:38,650 : INFO : setting ignored attribute vectors_norm to None
2020-04-16 18:51:38,651 : INFO : setting ignored attribute vectors_vocab_norm to None
2020-04-16 18:51:38,652 : INFO : setting ignored attribute vectors_ngrams_norm to None
2020-04-16 18:51:38,652 : INFO : setting ignored attribute buckets_word to None
2020-04-16 18:51:38,653 : INFO : loaded subword_vector.bin
2020-04-16 18:51:38,653 : INFO : loading Word2VecKeyedVectors object from skipgram_vector.bin
2020-04-16 18:51:38,760 : INFO : loading vectors from skipgram_vector.bin.vectors.npy with mmap=None
2020-04-16 18:51:38,787 : INFO : setting ignored attribute vectors_norm to None
2020-04-16 18:51:38,788 : INFO : loaded skipgram_vector.bin

Get most similar concepts

def display_html_table(html_str):
    """Change the look and display style of table"""
    
    display_html(html_str.replace('table','table style="padding:20px;display:inline;color:navy;font-size:1.1em"'),raw=True)
    
def display_side_by_side(*args):
    html_str=''
    
    for df in args:
        html_str+=df.to_html()    
    
    display_html_table(html_str)
 
def display_similar(positive:list,topn=10):
    """get similar concepts from 3 different models"""
    
    topn_cbow=cbow_vectors.wv.most_similar(positive=w1, topn=topn)
    topn_subword=subword_vectors.wv.most_similar(positive=w1, topn=topn)
    topn_skipgram=skipgram_vectors.wv.most_similar(positive=w1, topn=topn)
    
    display_side_by_side(
                     pd.DataFrame(topn_cbow,columns=['cbow','cosine_sim']),
                     pd.DataFrame(topn_skipgram,columns=['skipgram','cosine_sim']),
                     pd.DataFrame(topn_subword,columns=['skipgramsi','cosine_sim']))

w1=['room','hotel']
display_similar(w1,topn=8)

2020-04-16 18:51:38,804 : INFO : precomputing L2-norms of word weight vectors
2020-04-16 18:51:38,884 : INFO : precomputing L2-norms of word weight vectors
2020-04-16 18:51:38,947 : INFO : precomputing L2-norms of ngram weight vectors
2020-04-16 18:51:39,317 : INFO : precomputing L2-norms of word weight vectors

w1=['bathroom']
display_similar(w1,topn=8)

w1=['cheap']
display_similar(w1,topn=8)

w1=['fire']
display_similar(w1,topn=8)

Compute similarity between words

# similarity between two related words
def get_word_sim(w1,w2,concept_type):

    sim_cbow=model_cbow.wv.similarity(w1=w1,w2=w2)
    sim_skipgram=model_skipgram.wv.similarity(w1=w1,w2=w2)
    sim_subword=model_subword.wv.similarity(w1=w1,w2=w2)
    
    return {"a_word":w1,"b_word":w2,"score_cbow":sim_cbow,"score_skipgram":sim_skipgram,"score_skipgramsi":sim_subword,"concept_type":concept_type}

# word pairs
word_pairs=[['friendly','staff','neighboring'],['shower','curtain','neighboring'],['very','clean','neighboring'],['hotel','property','synonymous'],['dirty','filthy','synonymous'],['washroom','bathroom','synonymous'],['staff','staffs','near_duplicates'],['calendar','calender','near_duplicates'],['bathrroom','bathrooms','near_duplicates']]

# get similarity
results=[]
for p in word_pairs:
    results.append(get_word_sim(p[0],p[1],p[2]))

#put in dataframe
df=pd.DataFrame(results)    
display_html_table(df.to_html())

Evaluate Similarity Between Phrases

def get_phrase_similarity(p1,p2,model):
    
     
    tokens_1=[t for t in p1.split() if t in model.wv.vocab]
    tokens_2=[t for t in p2.split() if t in model.wv.vocab]

    #compute cosine similarity using word embedings 
    cosine=0
    if (len(tokens_1) > 0 and len(tokens_2)>0):
        cosine=model.wv.n_similarity(tokens_1,tokens_2)
        
        if cosine > 0.6:
            return 1
        else:
            return 0
    else:
        return 0

items=[["room was very tidy","neat rooms"],["took a shower","had a bath"], ["staff was friendly","very polite manager"],["friendly staff","polite manager"],["friendly staff","rude personnel"],["the room was super dirty","very clean room"]]

import pandas as pd
df=pd.read_csv("similarity_test.txt")

df['cbow_sim']=df.apply(lambda x:get_phrase_similarity(x.phrase1,x.phrase2,model_cbow),axis=1)
df['skipgram_sim']=df.apply(lambda x:get_phrase_similarity(x.phrase1,x.phrase2,model_skipgram),axis=1)
df['skipgramsi_sim']=df.apply(lambda x:get_phrase_similarity(x.phrase1,x.phrase2,model_subword),axis=1)


display_html_table(df.to_html())

Evaluation of Phrase Similarity

from sklearn.metrics import precision_recall_fscore_support   

def get_prf(model_type,x_true,x_pred):
    """Compute precision, recall and f-score"""
    
    per_class_prf=precision_recall_fscore_support(x_true,x_pred,average='binary')
    
    precision = per_class_prf[0]
    recall = per_class_prf[1]
    fscore = per_class_prf[2]
    
    return {"a_model_type":model_type,"b_precision":precision,"c_recall":recall,"d_fscore":fscore}
    

results=[]
results.append(get_prf("cbow_sim",df['similar'].values,df['cbow_sim'].values))
results.append(get_prf("skipgram_sim",df['similar'].values,df['skipgram_sim'].values))
results.append(get_prf("skipgramsi_sim",df['similar'].values,df['skipgramsi_sim'].values))

df_results=pd.DataFrame(results)
display_html_table(df_results.to_html())