Microsoft Developer Community Blog

Options
8,165
kinfey on Apr 23 2024 09:10 AM
707
Subashri_Vasu on Apr 22 2024 12:32 AM
979
Lee Stott on Apr 22 2024 12:00 AM
1,175
glaucia_lemos86 on Apr 21 2024 03:11 PM
1,822
LBugnion on Apr 18 2024 12:27 AM
2,242
sagar_lankala on Apr 16 2024 12:07 PM
899
carlottacaste on Apr 15 2024 12:00 AM
2,461
carlottacaste on Apr 14 2024 12:00 AM
2,576
Pamela_Fox on Apr 12 2024 12:00 AM
1,755
glaucia_lemos86 on Apr 11 2024 06:03 PM
1,728
LBugnion on Apr 11 2024 12:11 AM
2,397
_aditisingh on Apr 11 2024 12:00 AM
1,537
Andreas Helland on Apr 10 2024 09:33 AM
1,264
Pamela_Fox on Apr 10 2024 12:00 AM
1,571
LBugnion on Apr 09 2024 12:02 AM
696
SumitGhosh on Apr 08 2024 09:00 AM
6,440
glaucia_lemos86 on Apr 04 2024 09:00 AM
803
sonjagu on Apr 04 2024 09:00 AM
1,640
LBugnion on Apr 04 2024 03:58 AM
950
LBugnion on Apr 02 2024 01:04 PM
1,878
MeganNesbitt on Apr 02 2024 08:01 AM
1,033
Jamesdld23 on Apr 02 2024 12:00 AM
2,359
glaucia_lemos86 on Mar 29 2024 07:22 PM
1,239
LBugnion on Mar 28 2024 08:43 AM
3,455
LBugnion on Mar 26 2024 01:59 AM
3,761
LBugnion on Mar 21 2024 12:01 AM
902
Julia_Liuson on Mar 19 2024 08:00 AM
2,909
LBugnion on Mar 19 2024 12:01 AM
1,596
hannahhunter on Mar 08 2024 09:28 AM
6,890
SumitGhosh on Mar 04 2024 09:00 AM

Latest Comments

I execute the command:wasmedge --dir .:. --nn-preload default:GGML:AUTO: Phi-3-mini-4k-instruct-q4.gguf llama-api-server.wasm -p phi-3-chat but the command say: unknown option nn-preload
0 Likes
please follow hugging face guideline microsoft/Phi-3-mini-128k-instruct · Hugging Face import torch from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline torch.random.manual_seed(0) model = AutoModelForCausalLM.from_pretrained( "microsoft/Phi-3-mini-128k-instruct", device_map="cuda"...
0 Likes
I have downloaded phi 3 mini 128k instruct model in 2 safetensors files using model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3-mini-128k-instruct",device_map="cuda",torch_dtype="auto",trust_remote_code=True,). How to merge those files for inference (mayne merge is not needed). Just how ...
0 Likes
Hi @adrian_hall Greetings. Today I tried spinning Azure APIM with Synthetic GraphQL. It works great with Postman. When I try using Straberry Shake Tool, it fails. Could you please advise. PS D:\TSA\minimal-apis\GraphQL.ToDos> dotnet graphql init https://apim-micro-services-dev.azure-api.net/graphql/...
0 Likes