In this two-part blog series, we explore how to perform optimized training and inference of large language models from Hugging Face, at scale, on Azure Databricks.
In the first part we focused ...
Published Sep 19, 2022
Version 1.0
Blog Post
4 MIN READ
Optimized Training and Inference of Hugging Face Models on Azure Databricks – Part 2
Try installing the CUDA toolkit, if you find it is trying to compile some extensions from source at runtime
%sh apt-get install -y cuda-toolkit-11-3