Hi Bruno — are there any plans to support structured output?
https://docs.x.ai/docs/guides/structured-outputs
Most applications need to know how the data is coming back. It seems like a logical thing to support, but I imagine it's a pain to support all the various models.
Thanks — Steve
Good suggestion.
We aim for exposing this capability for the LLM services that support it.
Any update on the JSON structured output? Is this planned?
Thanks, Steve
Sorry, didn't move to top priority yet due to no requests from other users.
I would expect you can meanwhile specify this in the SystemRole?