fix: set topP from config

[muscionig]

Closes #1052

📑 Description

This PR allows for setting topP from the config yaml for the openai provider.

✅ Checks

• My pull request adheres to the code style of this project
• My code requires changes to the documentation
• I have updated the documentation as required
• All the tests have passed

ℹ Additional Information

I took the liberty of opening both the issue and the PR fixing it, please let me know if I should follow any other process.

[AlexsJones]

Thanks for opening a PR, I think for this to work though, you'll need to update the command/auth with a new flag for topP and link it into the configuration object

[muscionig]

@AlexsJones thanks for the comment. That flag is already there in the auth command and if --topp is passed it is properly saved in the config yaml. However, because of the const value in the openai code, that flag is never set properly, which is the reason why I opened this as a fix and not an enhancement.

With the edits in this PR, that parameter is properly set from the config if the user provides it.

[arbreezy]

@AlexsJones thanks for the comment. That flag is already there in the auth command and if --topp is passed it is properly saved in the config yaml. However, because of the const value in the openai code, that flag is never set properly, which is the reason why I opened this as a fix and not an enhancement.

With the edits in this PR, that parameter is properly set from the config if the user provides it.

You are right, probably we never removed the constant when introducing the topP as a cli argument.

Could you please, also add it as an env variable in server's cmd file so we can use it in the operator?

[muscionig]

@arbreezy thanks for reviewing this. I took care of the format and I have also enabled the setting of topP in the operator, I followed the way temperature is set. For the default value, I did not alter the previous behavior (which is also the recommended use from openai and other providers).

[arbreezy]

@arbreezy thanks for reviewing this. I took care of the format and I have also enabled the setting of topP in the operator, I followed the way temperature is set. For the default value, I did not alter the previous behavior (which is also the recommended use from openai and other providers).

It looks good, after resolving the conflicts I'll approve 👍

[muscionig]

@arbreezy I rebased off of main. Thanks!