Hi, you mentioned an open PR on the VLLM repo, but I can’t find it.Do you have any fork where you built your image: docker.io/amant555/vllm_apriel:latest? @amant555 Thanks in advance !
You can refer to https://github.com/aman-servicenow/vllm
Thanks, @amant555 . I see some edge-case issues with the streaming tool call, so I need to do a quick fix for you.
Well done on all your work @amant555 — I really love your model, and it’s way too underrated by the community.
· Sign up or log in to comment
