TTMSMCPCloudAI synchronous call

DEV TMS AI Studio
1

I use TTMSMCPCloudAI component with Claude API to extract invoice data from an invoice file.

Currently the TTMSMCPCloudAI component is on our frontend application.

But I would like to move TTMSMCPCloudAI component to our server, which is based on WebBroker.

Is it possible to use TTMSMCPCloudAI component to make synchronous calls to LLM service, so I do not need to manually handle threads internally in our server code ?

Thanks in advance

2

At this moment there is not a built-in setting to switch between synchronous & asynchronous calls. In order to avoid any UI freeze, we've opted to have it by default always asynchronous.
We can consider to expose a setting for Windows specifically to have it run sychronously, but not sure if it is desirable to block a server thread waiting for HTTP request results?

3

I agree with you, the default call mode must be asynchronous.

I only ask for synchronous because until now, in the server, when I have to call another services, I use SOAP, synchronous calls. In webbroker, the code is executed in a worker thread, so only “blocks” the current worker thread.

With asynchronous calls, for first time I have to use TThread.Synchronize, o TEvent, in the server, to wait for the response. I would prefer not to do it, but is not a big problem, I will sorted out it.

Thanks,