Blog Post

Azure AI Foundry Blog
4 MIN READ

CustomVision: Accelerating a model with ONNX Runtime on a CPU, GPU or Movidius Neural Compute Stick

KevinSaye's avatar
KevinSaye
Icon for Microsoft rankMicrosoft
May 15, 2020
While I have written before about the speed of the Movidius: Up and running with a Movidius container in just minutes on Linux, there were always challenges “compiling” models to run on that ASIC.  S...
Updated Jun 22, 2020
Version 13.0
azure ai services
computer vision
Custom Vision
noumanqaiser's avatar
noumanqaiser
Copper Contributor
Dec 24, 2021

Thanks for sharing. 

While going upto 6fps is an improvement, I am not sure if it is significant enough. ONNX models exported from Custom vision can already be used for inferencing using ONNX Runtime and Intel CPUs with an inference time of around 40ms per image. Do you believe there is substantial advantage in using The USB computer sticks?