Understanding ONNX Runtime: Overview, Usage, and Source Code Analysis
1. Overview The structure of onnx-runtime is as follows: Overall, this is a heterogeneous model execution framework that first performs hardware-independent graph optimization on the original ONNX model, retrieves the operator library corresponding to the currently supported hardware, then splits the model into multiple sub-models, and finally dispatches them to various hardware platforms for execution. … Read more