[AUTO] CVST Tokenizer Badger

#49
by pandora-s - opened
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -4,6 +4,14 @@ license: apache-2.0
4
 
5
  # Model Card for Mistral-7B-Instruct-v0.3
6
 
 
 
 
 
 
 
 
 
7
  The Mistral-7B-Instruct-v0.3 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.3.
8
 
9
  Mistral-7B-v0.3 has the following changes compared to [Mistral-7B-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/edit/main/README.md)
 
4
 
5
  # Model Card for Mistral-7B-Instruct-v0.3
6
 
7
+ ###
8
+
9
+ > [!IMPORTANT]
10
+ > ❗
11
+ > We recommend using `mistral_common` for tokenization as the transformers tokenizer has not been tested by the Mistral team and might give incorrect results.
12
+
13
+ ---
14
+
15
  The Mistral-7B-Instruct-v0.3 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.3.
16
 
17
  Mistral-7B-v0.3 has the following changes compared to [Mistral-7B-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/edit/main/README.md)