Event banner
Event details
JamesEccles
Microsoft
MicrosoftThe Unstructured model type supports any latin character set language. This model type is not using Turing under the hood- it ultimately has no semantic understanding of content. Rather it understands the text in a document as a series of tokens. Its patterns within/between/around these tokens that the model is building on.
https://learn.microsoft.com/en-gb/microsoft-365/contentunderstanding/explanation-types-overview#what-are-tokens
In an earlier stage of NLP we have used UIMA , where tokenization and sentencazation where important part of the understanding, should I compare this with that?