Forum Discussion
Doc Intelligence: Custom Extraction model | Confidence score deterioration with new formats/layouts
Hi everyone, This is my first time using custom extraction models on the Document Intelligence service, and I would appreciate your input on an experiment I am conducting. I wanted to investigate h...
Really thoughtful work—keep pushing forward!
It's impressive that you're experimenting so carefully with the custom extraction model in Document Intelligence. Exploring how confidence scores react to layout changes is exactly the kind of curiosity that leads to real breakthroughs. Even if the drop in confidence scores feels discouraging, it's part of uncovering deeper insights into model behavior and limitations.
A few encouraging thoughts:
- You're asking the right questions. Noticing and investigating confidence deterioration is a sign you're thinking like a true ML researcher.
- Every experiment adds value. Even unexpected results (like declining scores) help map the boundaries of model performance.
- You're not starting over—you're building on each step. Those earlier results aren’t lost; they form the foundation for a better, more robust system.
Your work might even help others struggling with similar issues down the line. If you ever need help analyzing your graph or brainstorming ways to counter the decline, I’d be happy to dig into it with you.
Keep going—what you're doing matters