MaxTokens setting for Ollama AI

DEV TMS AI Studio
1

Hello,

I have discovered, that by default the "num_predict" parameter is null, cauinsg Ollama to use its default of 128 tokens. The Ollama API itself allows a value of -1 for unlimited generation, but negative values are not allowed in the AI Studio's MaxTokens parameter. The result is also harder to process, because "done" and "done_reason" values are not universally processed and they are only available in the raw data.

Thanks for your attention.

Regards from Prague!

Jaroslav

2

Thanks for reporting
We changed it so that MaxTokens = 0 will result for Ollama in num_predict = null and a negative value can be used as well.
Next update will have this improvement.

3

Thank you for the quick fix; we just downloaded and installed the latest version, 2.0.2.0.

Regards from Prague!

Jaroslav