ChatRPC is a framework that allows large language models to interact with external services.
Users of the library define methods and services:
const isEven = new Method({
handler: async (input: number) => input % 2 === 0,
input: { type: 'number' },
output: { type: 'boolean' },
});
const calculatorService = new Service({ name: 'calculator' })
.registerMethod('isEven',isEven);The LLM's will be prompted to output only valid JSON that can either contain a message to the user or a method call, for example:
User: {"message":"Hello, I would like to get information about currency conversion."}
Assistant: {"message":"I have have access to a realtime currency conversion service. What currency would you like to convert from?"}
User: {"message":"I would like to convert 500 USD to EUR."}
Assistant: {"service":"currency","method":"convert","input":{"amount":500,"from":"USD","to":"EUR"}}
System: {"output":415.53}
Assistant: {"message":"500 USD is equivalent to 415.53 EUR."}
A working example that integrates TMDB into ChatGPT can be found here: examples/tmdb-openai.
Distributed under the MIT License. See LICENSE.txt for more information.
- typescript-starter has helped me get started with this project.