Using tools parameter for generation guidance

[Shiniri]

Hi everyone,

unfortunately the chat/ endpoint does not support the grammar parameter the same way as generate/ does (Why is that btw?). Instead, it uses the tools parameter. But I am confused by the documentation of how to use tools for Guidance:

https://huggingface.co/docs/text-generation-inference/en/guidance#tools-and-functions-

I'm basically looking for more detailed information on how to use tools for guidance and how to create a tools dict.

Thanks a lot!