Upload folder using huggingface_hub

README.md

@@ -14,10 +14,16 @@ inference:
 # pcuenq/My-Mistral-7B-v0.1-4bit
 This model was converted to MLX format from [`mistralai/Mistral-7B-v0.1`]().
 Refer to the [original model card](https://huggingface.co/mistralai/Mistral-7B-v0.1) for more details on the model.
+
 ## Use with mlx
+
 ```bash
-pip install mlx
-git clone https://github.com/ml-explore/mlx-examples.git
-cd mlx-examples/llms/hf_llm
-python generate.py --model pcuenq/My-Mistral-7B-v0.1-4bit --prompt "My name is"
+pip install mlx-lm
+```
+
+```python
+from mlx_lm import load, generate
+
+model, tokenizer = load("pcuenq/My-Mistral-7B-v0.1-4bit")
+response = generate(model, tokenizer, prompt="hello", verbose=True)
 ```