Forum Discussion

Anjan_Chidige's avatar
Anjan_Chidige
Copper Contributor
May 03, 2024

Getting truncated response from Azure OpenAI API

Hi All,

I am calling the Azure OpenAI API to get the data. I am using the below model. I am passing the data as prompt. I am trying to extract the data from a 65 page PDF file. One of the field has little more data.

 

Model name: gpt-4-32k

Model version: 0613

Tokens per Minute Rate Limit (thousands): 30

Rate limit (Tokens per minute): 30000

Rate limit (Requests per minute): 180

 

Here is the response I got. The last field i.e. 'Limitation of Liability' content is truncated. The total token details given in the below JSON. 

 

{
  "choices": [
    {
      "finish_reason": "stop",
      "index": 0,
      "message": {
        "content": "{\n  \"Trust Name\": \"XXXXXX\",\n  \"Trustee name\": \"XXXX\",\n  \"ACN\": \"XXXX\",\n  \"ABN\": \"XXXXX\",\n  \"Address\": \"XXXXXXXX\",\n  \"Trust Deed Date(a.k.a Commencement Date)\": \"XXXX\",\n  \"Expiry Date\": \"XXXXX\",\n  \"Lease Term\": \"XXXXX\",\n  \"Officer Name\": \"XXXXX\",\n  \"Officer Tile(a.k.a Designation)\": \"Director, Director\",\n  \"Limitation of liability\": \"XXXXXXXXXXXXXXXXXXX\"\n}",
        "role": "assistant"
      }
    }
  ],
  "created": XXXX,
  "id": "XXXXXX",
  "model": "gpt-4-32k",
  "object": "chat.completion",
  "system_fingerprint": null,
  "usage": {
    "completion_tokens": 341,
    "prompt_tokens": 24600,
    "total_tokens": 24941
  }
}

 

 

Please let me know how to fix it.

 

REgards

Anjan

No RepliesBe the first to reply

Resources