Getting Started - Generative AI with Phi-3-mini: A Guide to Inference and Deployment

kinfey, your script above will start downloading 2 shards, like this:  model.safetensors.index.json: 0%| | 0.00/16.3k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 16.3k/16.3k [00:00<?, ?B/s]
Downloading shards: 0%| | 0/2 [00:00<?, ?it/s]
model-00001-of-00002.safetensors: 0%| | 0.00/4.97G [00:00<?, ?B/s]
model-00001-of-00002.safetensors: 0%| | 10.5M/4.97G [00:02<21:53, 3.78MB/s]
model-00001-of-00002.safetensors: 0%| | 21.0M/4.97G [00:05<20:04, 4.11MB/s]
model-00001-of-00002.safetensors: 1%| | 31.5M/4.97G [00:07<19:41, 4. But I already have downloaded both shards (model-00001-of-00002.safetensors, model-00002-of-00002.safetensors), as I described above. So, how to prompt the model locally?