Forum Discussion
Anjan_Chidige
May 03, 2024Copper Contributor
Getting truncated response from Azure OpenAI API
Hi All,
I am calling the Azure OpenAI API to get the data. I am using the below model. I am passing the data as prompt. I am trying to extract the data from a 65 page PDF file. One of the field has little more data.
Model name: gpt-4-32k
Model version: 0613
Tokens per Minute Rate Limit (thousands): 30
Rate limit (Tokens per minute): 30000
Rate limit (Requests per minute): 180
Here is the response I got. The last field i.e. 'Limitation of Liability' content is truncated. The total token details given in the below JSON.
{
"choices": [
{
"finish_reason": "stop",
"index": 0,
"message": {
"content": "{\n \"Trust Name\": \"XXXXXX\",\n \"Trustee name\": \"XXXX\",\n \"ACN\": \"XXXX\",\n \"ABN\": \"XXXXX\",\n \"Address\": \"XXXXXXXX\",\n \"Trust Deed Date(a.k.a Commencement Date)\": \"XXXX\",\n \"Expiry Date\": \"XXXXX\",\n \"Lease Term\": \"XXXXX\",\n \"Officer Name\": \"XXXXX\",\n \"Officer Tile(a.k.a Designation)\": \"Director, Director\",\n \"Limitation of liability\": \"XXXXXXXXXXXXXXXXXXX\"\n}",
"role": "assistant"
}
}
],
"created": XXXX,
"id": "XXXXXX",
"model": "gpt-4-32k",
"object": "chat.completion",
"system_fingerprint": null,
"usage": {
"completion_tokens": 341,
"prompt_tokens": 24600,
"total_tokens": 24941
}
}
Please let me know how to fix it.
REgards
Anjan
No RepliesBe the first to reply