Running issue: when running the model as the steps of the model card

#11
by buyiasd - opened

I met the issue below. Do you have some advice?

C:\Users\nxf76091\Downloads\work\huggingface\node_modules\onnxruntime-node\dist\backend.js:45
resolve(__classPrivateFieldGet(this, _OnnxruntimeSessionHandler_inferenceSession, "f").run(feeds, fetches, options));
^

Error: Non-zero status code returned while running Cast node. Name:'InsertedPrecisionFreeCast_/model/layers.1/attn/v_proj/repeat_kv/Reshape_4/output_0' Sta
tus Message: D:\a_work\1\s\onnxruntime\core\framework\op_kernel.cc:83 onnxruntime::OpKernelContext::OutputMLValue status.IsOK() was false. Shape mismatch
attempting to re-use buffer. {1,1,1536} != {1,22,1536}. Validate usage of dim_value (values should be > 0) and dim_param (all values with the same string s
hould equate to the same size) in shapes in the model.

at Immediate.<anonymous> (C:\Users\nxf76091\Downloads\work\huggingface\node_modules\onnxruntime-node\dist\backend.js:45:108)
at process.processImmediate (node:internal/timers:476:21)

Node.js v18.20.6

Sign up or log in to comment