Forum Discussion

Richard_Wray's avatar
Richard_Wray
Copper Contributor
Jun 04, 2024

Azure OpenAI Whisper From Power Automate

Hi all,     I've successfully created a working Whisper Model In Azure OpenAI Service (tested at  Speech Studio - Whisper Model in Azure OpenAI Service ) to do audio transcriptions.  I've had the ...
ymuto's avatar
ymuto
Icon for Microsoft rankMicrosoft
Jun 14, 2024

Hello Richard_Wray 

 

api-version in your URI is incorrected.

api-version should be 2024-02-01

 

Like this.
https://azureopenaispeechjuneeastus2.openai.azure.com/openai/deployments/wmcazureopenaiwhisper/audio/transcriptions?api-version=2024-02-01

 

 

Thanks,

Yoshihiko Muto(@ymuto)

  • Richard_Wray's avatar
    Richard_Wray
    Copper Contributor
    Jun 14, 2024

    ymuto 

     

    Thanks.  I actually cracked it in the end (found a blog, that I can't find now 😞  ).  You are correct.  The line should have read 'https://azureopenaispeechjuneeastus2.openai.azure.com/openai/deployments/wmcazureopenaiwhisper/audio/transcriptions?api-version=2024-02-01'

     

    Here's the full flow to pass the contents from a Power App Mic control to Azure OpenAI Whisper and then pass the transcribed text back to the Power App.  In this case the flow is called 'AzureTextTranscription1.0'

     

    This was called using the following line in the 'On Stop' setting on the Mic in the Power App.

     

    Set(TempRecordingVar,MicrophoneQ1.Audio);
    Set(TempJason,JSON(MicrophoneQ1.Audio,JSONFormat.IncludeBinaryData));
    Set(StringB64Var,Mid(TempJason,25,Len(TempJason)-25));
    Set(flowResonseQ1, 'AzureTextTranscription1.0'.Run(Q1UserDetails,", ",StringB64Var));

     

     

     

     

     

    Take the feed from Power Apps

     

    Convert the audio content

     

    Compose

    {
    "$content-type": "multipart/form-data",
    "$multipart": [
    {
    "headers": {
    "Content-Disposition": "form-data; name=\"file\"; filename=\".mp3\""
    },
    "body": {
    "$Content-type": "audio/webm",
    "$content":
    }
    }
    ]
    }

     

    HTTP Action (I've removed my key from this image)

     

    Parse the response

     

    {
        "type": "object",
        "properties": {
            "text": {
                "type": "string"
            }
        }
    }
     
    Respond back to the Power App with the Azure Open AI Whisper results
     

     

    It works great on browsers, but still a few issues on making it work through ther the Power Apps app on my Android phone.  Works fine on the browsers on the phone though.  Weird!!!!

     

    That will be later though.  I think it is to do with how phones store audio.

     

     

     

     

     

Resources