CohereGenerator

[anakin87]

Develop a Generator that uses Cohere models, similar to GPTGenerator.

(@bilgeyucel please add details if you want).

[sunilkumardash9]

Hi @anakin87, I can give it a shot. Do I need to be assigned, or should I go for a PR?

[anakin87]

Hey, @sunilkumardash9!

Feel free to open a PR...

• You can take GPTGenerator as a similar example.
• Be sure to lazy import the Cohere SDK. Something similar to this:

with LazyImport(message="Run 'pip install cohere'") as cohere_import:
    from cohere import Client

[sunilkumardash9]

@anakin I was wondering which cohere endpoint we should go with, Chat or Generate. And what should we return as metadata? If we go with the Chat endpoint, Should we add citations and documents as metadata?
https://docs.cohere.com/reference/chat

[anakin87]

I'm not an expert on Cohere models.
@bilgeyucel feel free to add your observations...

[bilgeyucel]

@sunilkumardash9 we should use the /generate endpoint for CohereGenerator.
As the metadata, you can return the meta object that Cohere returns in the response. It would have been nice if we could provide token information but as far as I can understand, Cohere doesn't provide this information through /generate endpoint