Search results

if the word not in vocab， what should I do？ or it always can't happen because the FullTokenizer

Status: Open.

#6 In ciprian-chelba/1-billion-word-language-modeling-benchmark;

· wangwang110 opened on Dec 14, 2018

Some Training Data Duplicated in Heldout Data

Status: Open.

#5 In ciprian-chelba/1-billion-word-language-modeling-benchmark;

· bjascob opened on Sep 10, 2018

Dead code.google.com link

Status: Open.

#3 In ciprian-chelba/1-billion-word-language-modeling-benchmark;

· charlesreid1 opened on Oct 14, 2017

question on the corpus size / script

Status: Open.

#1 In ciprian-chelba/1-billion-word-language-modeling-benchmark;

· vince62s opened on Oct 3, 2016