Azure Compute Blog

Options
1,042
Micah McKittrick on May 28 2024 03:44 PM
2,830
AnkitJain1515 on May 28 2024 08:00 AM
895
shreyab on May 21 2024 09:16 AM
2,206
shreyab on May 21 2024 09:15 AM
3,406
Rajeesh_Azure on May 21 2024 09:00 AM
3,245
kyleikeda on Mar 08 2024 09:27 AM
4,331
shreyab on Dec 14 2023 09:14 AM
2,998
brittanyrowe on Nov 15 2023 02:43 PM
22K
Lauren_Britton on Nov 15 2023 08:00 AM
7,619
AnkitJain1515 on Nov 15 2023 08:00 AM
3,636
maulikshah23 on Oct 12 2023 09:00 AM
7,540
Jerry Steele on Oct 09 2023 02:30 PM
11.9K
AjKundnani on Sep 26 2023 08:30 AM
4,473
kyleikeda on Sep 19 2023 11:21 AM
3,084
kyleikeda on Aug 31 2023 02:51 PM
3,028
kyleikeda on Aug 31 2023 02:51 PM
5,926
AriyaKhamvongsa on Aug 11 2023 08:50 AM
15.4K
rishabv90 on Jul 10 2023 12:49 PM

Latest Comments

To get the latest version of the Azure Functions runtime, update the Core Tools version as described here Develop Azure Functions locally using Core Tools | Microsoft Learn
0 Likes
Hi all, there is a bug where HTTP streaming is not working as expected on Dedicated plans. Here is the issue where you can track this - [Bug] HTTP Streaming doesn't work on Premium plans · Issue #1504 · Azure/azure-functions-python-worker (github.com) and we will update this as we make progress. Tha...
0 Likes
Yep, we're getting true streaming responses - we're streaming an OpenAI LLM response and can see the results coming back a word or two at a time - make sure your client is handling the streaming response, not everything does! Still struggling to get this deployed to always-on premium though!
0 Likes
Hibernation for general purpose sizes is now generally available : https://azure.microsoft.com/en-us/updates/general-availability-vm-hibernation-general-purpose/Additionally, you can now enable hibernation on existing VMs. More details are available here - Linux Hibernation Windows VMs
0 Likes
One more question. Have you checked if it is truly streaming? I have looked at flask using wsgiFunctionApp and while the flask streaming code is standard. The middleware seems to be waiting for the full results before releasing downstream. Given you are using fastapi, i assume it has some middleware...
0 Likes