change max_position_embeddings to be compatible with cpu + optimum
#1
by
ishootlaser
- opened
max_position_embeddings ==514 caused optimum to fail.
The original model has this set to 514: https://huggingface.co/BAAI/bge-reranker-large/blob/main/config.json#L22
Can you post the error message you are getting?
Dear Xenova,
The issue is identical to this github issue: https://github.com/michaelfeil/infinity/issues/218
514 won't load on optimum.
I need it to be 512 so that my build pipeline can produce an optimum container image.
Please do not approve this PR and leave it as is, so my pipeline can pull from this branch.
Thank you.