You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Python: Bug: Simple python onnx connector sample not working as the library has not been updated with onnxruntime_genai api changes over past year #13001
Describe the bug
('Failed Inference with ONNX', AttributeError("'onnxruntime_genai.onnxruntime_genai.GeneratorParams' object has no attribute 'input_ids'")).
To Reproduce
Steps to reproduce the behavior:
Just try to run the sample code given downloading the Phi-4-mini-instruct-onnx model from HF
changed the title [-]Bug: Simple python onnx connector sample not working as the library has not been updated with onnxruntime_genai api changes over past year[/-][+]Python: Bug: Simple python onnx connector sample not working as the library has not been updated with onnxruntime_genai api changes over past year[/+]on Aug 25, 2025
cmonto This PR #13162 updates the Connector to support the new methods provided by onnxruntime-genai. This will enable you to run phi4-mini-instruct. With the upgrades you also don't need to provide the template since it's already in the tokenizer object from onnx. The only case where you need the template is when you plan to use multimodality.
Activity
[-]Bug: Simple python onnx connector sample not working as the library has not been updated with onnxruntime_genai api changes over past year[/-][+]Python: Bug: Simple python onnx connector sample not working as the library has not been updated with onnxruntime_genai api changes over past year[/+]nmoeller commentedon Sep 21, 2025
cmonto This PR #13162 updates the Connector to support the new methods provided by onnxruntime-genai. This will enable you to run phi4-mini-instruct. With the upgrades you also don't need to provide the template since it's already in the tokenizer object from onnx. The only case where you need the template is when you plan to use multimodality.
Python: Upgrade Onnx Connector to use 0.9.0 (#13162)