johanobandoc
/

rlooG

Text Generation

text-generation-inference

Model card Files Files and versions

johanobandoc commited on Nov 21, 2024

Commit

598e4a2

·

verified ·

1 Parent(s): 4573b7b

Upload LlamaForCausalLM

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -18,7 +18,7 @@
   "num_attention_heads": 32,
   "num_hidden_layers": 22,
   "num_key_value_heads": 4,
-  "pad_token_id": 32000,
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": null,

   "num_attention_heads": 32,
   "num_hidden_layers": 22,
   "num_key_value_heads": 4,
+  "pad_token_id": 0,
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": null,