If you are creating an Intelligent Edge project that uses vision machine learning models in the ONNX (Open Neural Network eXchange) format, the recent ONNX Runtime 0.5 release provides support and tutorials for using the NVIDIDA Jetson Nano and Intel's OpenVINO Toolkit for hardware-based optimization.
ONNX Runtime is a performance-focused complete scoring engine for Open Neural Network Exchange (ONNX) models, with an open extensible architecture to continually address the latest developments in AI and Deep Learning. ONNX Runtime stays up to date with the ONNX standard with complete implementation of all ONNX operators, and supports all ONNX releases (1.2+) with both future and backwards compatibility. Please refer to this page for ONNX opset compatibility details.
ONNX is an interoperable format for machine learning models supported by various ML and DNN frameworks and tools. The universal format makes it easier to interoperate between frameworks and maximize the reach of hardware optimization investments.
Read the complete blog announcement on the Microsoft Open Source Blog - Now available: ONNX Runtime 0.5 with support for edge hardware acceleration
Additional Resources -
Find more resources for Intelligent Edge device builders at the Intelligent Edge Device Builder Resource Center.
