Update README.md
Browse files
README.md
CHANGED
|
@@ -188,6 +188,17 @@ The model was evaluated on the OpenLLM leaderboard task, using [lm-evaluation-ha
|
|
| 188 |
--greedy
|
| 189 |
```
|
| 190 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 191 |
</details>
|
| 192 |
|
| 193 |
|
|
|
|
| 188 |
--greedy
|
| 189 |
```
|
| 190 |
|
| 191 |
+
|
| 192 |
+
**Multimodal Evaluation**
|
| 193 |
+
```
|
| 194 |
+
lm_eval \
|
| 195 |
+
--model vllm-vlm \
|
| 196 |
+
--model_args pretrained="nm-testing/Llama-4-Maverick-17B-128E-Instruct-block-FP8",dtype=auto,add_bos_token=False,max_model_len=1000000,tensor_parallel_size=8,gpu_memory_utilization=0.9,enable_chunked_prefill=True,trust_remote_code=True,max_images=10 \
|
| 197 |
+
--tasks mmlu \
|
| 198 |
+
--apply_chat_template \
|
| 199 |
+
--batch_size auto
|
| 200 |
+
```
|
| 201 |
+
|
| 202 |
</details>
|
| 203 |
|
| 204 |
|