Adopt to new function calling format - allow function calling on Groq & other non-openai models

[tijszwinkels]

Update function calling to use the new 'tool use' format. This format is compatible with litellm proxies, groq, etc.

[TheR1D]

Hi @tijszwinkels thank you for the pull request. There are few issues I found during testing the changes:

When functions folder is empty (user doesn't have any functions) sgpt will fail because of OpenAI API error:

Invalid value for 'tool_choice': 'tool_choice' is only allowed when 'tools' are specified

This error can be fixed by adding if condition:

if functions:
    additional_kwargs["tool_choice"] = "auto"
    additional_kwargs["tools"] = functions

Seems there is another issue when LLM tries to call mutliple functions at once. For example sgpt "echo foo and echo bar" fails with JSONDecodeError since arguments from LLM coming in just one response: '{"shell_command": "echo foo"}{"shell_command": "echo bar"}'

[tijszwinkels]

@TheR1D Thank you for testing this well!

I have addressed your comments:

• No 'tool_choice' option if no functions defined
• parallel_tool_calls = False to prevent parallel tool calls
• Updated the openai library to support the parallel_tool_calls option

Tested by prompting it to perform multiple action at once, as well as with an empty functions directory.

[HejiaZ2023]

Hi @tijszwinkels @TheR1D ,

I’ve noticed that this PR is almost complete, but there are some lint test failures. I’d love to help out and get this merged as I'm also interested in this feature.

I’ve made the necessary changes to fix the lint issues and pushed them to a branch on my fork. You can review my changes here:
HejiaZ2023#1

If you’re okay with it, I can either create a new PR with these changes or, if the PR owner add me as a collaborator, I guess I can push the changes directly to this branch.

Please let me know how you’d like to proceed.

Thanks again for your work on this feature!

[tijszwinkels]

@HejiaZ2023 Thanks! - I merged and pushed your changes onto this branch. I've added you as a colaborator as well for now.

[tijszwinkels]

@TheR1D Any more changes you'd like to see? Anything we can do to reduce your workload?

[TheR1D]

Hi @tijszwinkels, @HejiaZ2023, sorry for the late reply. The PR has been merged. Thank you for your contribution!