Forum Discussion
Data format for batch inferencing of finetuned phi-3 model
The data format (.csv) that I am using for inferencing produces the error : "each data point should be a conversation array" when running the batch scoring job. All the documentations provided on...
How about this:
- Create a DataFrame with one column named input.
- Populate each row with a stringified JSON array as shown above.
- Save it as a .csv file using UTF-8 encoding.
- Upload it as a data asset and run the batch job.