krishnateja95 commited on
Commit
65651c0
·
verified ·
1 Parent(s): 6e9b648

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -188,6 +188,17 @@ The model was evaluated on the OpenLLM leaderboard task, using [lm-evaluation-ha
188
  --greedy
189
  ```
190
 
 
 
 
 
 
 
 
 
 
 
 
191
  </details>
192
 
193
 
 
188
  --greedy
189
  ```
190
 
191
+
192
+ **Multimodal Evaluation**
193
+ ```
194
+ lm_eval \
195
+ --model vllm-vlm \
196
+ --model_args pretrained="nm-testing/Llama-4-Maverick-17B-128E-Instruct-block-FP8",dtype=auto,add_bos_token=False,max_model_len=1000000,tensor_parallel_size=8,gpu_memory_utilization=0.9,enable_chunked_prefill=True,trust_remote_code=True,max_images=10 \
197
+ --tasks mmlu \
198
+ --apply_chat_template \
199
+ --batch_size auto
200
+ ```
201
+
202
  </details>
203
 
204