We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 12813c7 commit dac5814Copy full SHA for dac5814
src/llm/configs/llm_1.7b.yaml src/llm/configs/llm_3.55b.yamlsrc/llm/configs/llm_1.7b.yaml renamed to src/llm/configs/llm_3.55b.yaml
@@ -1,4 +1,4 @@
1
-vocab_size: 50257
+vocab_size: 200019
2
context_length: 2048
3
embedding_dim: 2560
4
n_heads: 32
0 commit comments