Add support to pdf files in mistral

DEV TMS AI Studio
1

Mistral already has support to send pdf files, accessing the service with API key.

I insert this line in the TTMSMCPCloudAI.BuildPostData method of TMS.MCP.CloudAI unit, and it works:

aiftPDF: AUserContentParts := AUserContentParts + ',{"type":"document_url","document_url":"data:application/pdf;base64,' + FFiles[i].GetData + '"}';

2

The workaround works, I can extract data from invoices using it, but the problem is that Mistral measures as consumed 65.0000 input tokens, for a pdf file that in Claude are measured 4,000 tokens.
Maybe it's a problem of the coding I've used, which might not correspond to the official Mistral specifications.

Can you please add official support for pdf files in Mistral?.

Thanks.

3

I couldn't find documentation on token usage from Mistral for PDF files submitted this way.
We can add this method meanwhile but investigate better approaches for a future version.

4

With AI Studio 1.7.1.0 the submit of PDF file to Mistral generates a 400 error “"Prompt contains 378782 tokens and 0 draft tokens, too large for model with 262144 maximum context length".

I found this doc, maybe it could be useful to you:

5
  1. Yes context size limitations prevent from submitting very large PDF files
  2. This looks like an interesting but separate API though from Mistral, so requires a separate implementation that at first sight cannot be unified at this point with other cloud LLM providers
  3. Have you looked at TMS Software | Blog that demonstrates offline PDF plain text extraction?