ONNX version?
#2
by
charnould
- opened
Hello,
First, thanks for your work!
I'd like to use this embedding model through transformers.js, any way to get this model in ONNX format?
Hi! While it should be possible to convert the model to onnx, I wouldn't recommend it as this would require disabling flash attention which goes a long way into making this model efficient.
See here for details :
https://github.com/AnswerDotAI/ModernBERT/issues/173#issuecomment-2667400927
Thanks, I’ll wait for the issue to be closed.
charnould
changed discussion status to
closed