Hugging Face's logo

ivanfioravanti
/
Step-3.7-Flash-3bit-gs32

Image-Text-to-Text
MLX
Safetensors
English
step3p7
vision-language
multimodal
Mixture of Experts
conversational
custom_code
3-bit
Model card Files
xet
 Community
How to use from
Hermes Agent
Start the MLX server 
# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "ivanfioravanti/Step-3.7-Flash-3bit-gs32"
Configure Hermes 
# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default ivanfioravanti/Step-3.7-Flash-3bit-gs32
Run Hermes 
hermes
Quick Links

ivanfioravanti/Step-3.7-Flash-3bit-gs32

This model was converted to MLX format from stepfun-ai/Step-3.7-Flash using mlx-vlm version 0.5.0. Refer to the original model card for more details on the model.

Use with mlx 

pip install -U mlx-vlm

python -m mlx_vlm.generate --model ivanfioravanti/Step-3.7-Flash-3bit-gs32 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
Downloads last month
130
Safetensors
Model size
33B params
Tensor type
BF16
·
U32
·
F32
·
MLX
Hardware compatibility
Log In to add your hardware

3-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ivanfioravanti/Step-3.7-Flash-3bit-gs32

Base model

stepfun-ai/Step-3.7-Flash
Quantized
(32)
this model

Collection including ivanfioravanti/Step-3.7-Flash-3bit-gs32