Upload model.onnx

#4
by bergum - opened

Add ONNX model artifact for efficient inference using onnxruntime.

okhattab changed pull request status to merged

Hi @bergum , I want to convert jina-colbert checkpoint to ONNX and use the same exported format with ColBERTv2's. Would you mind sharing how you convert?

Hi @bergum , I want to convert jina-colbert checkpoint to ONNX and use the same exported format with ColBERTv2's. Would you mind sharing how you convert?

https://github.com/vespa-engine/sample-apps/blob/master/colbert/model2onnx.py

Sign up or log in to comment