Mozilla
/

OLMo-7B-0424-llamafile

Model card Files Files and versions

jartine commited on Jul 19, 2024

Commit

909c2cd

·

verified ·

1 Parent(s): 332f123

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -33,8 +33,8 @@ chmod +x OLMo-7B-0424.Q6_K.llamafile
 You then need to fill out the prompt / history template (see below).
-This model has a max context window size of 8k tokens. By default, a
-context window size of 512 tokens is used. You may increase this to the
 maximum by passing the `-c 0` flag.
 On GPUs with sufficient RAM, the `-ngl 999` flag may be passed to use

 You then need to fill out the prompt / history template (see below).
+This model has a max context window size of 4k tokens. By default, a
+context window size of 2k tokens is used. You may increase this to the
 maximum by passing the `-c 0` flag.
 On GPUs with sufficient RAM, the `-ngl 999` flag may be passed to use