Client Side Tool Calling with the OpenAI WebRTC Realtime API

This project is a Cloudflare Workers app using Hono to relay the OpenAI Realtime API over WebRTC. The main files are just static assets.

Develop

Copy .dev.vars.example to .dev.vars and fill out your OpenAI API Key.

Install your dependencies

npm install

Run local server

npm run dev

Upload your secret

npx wrangler secret put OPENAI_API_KEY

npm run deploy

The hand is a HiWonder AI Hand. AI and I reverse-engineered the mobile app to make it work over Bluetooth, see the code in hand.js

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
public		public
src		src
test		test
.dev.vars.example		.dev.vars.example
.editorconfig		.editorconfig
.gitignore		.gitignore
.prettierrc		.prettierrc
README.md		README.md
package-lock.json		package-lock.json
package.json		package.json
tsconfig.json		tsconfig.json
vitest.config.mts		vitest.config.mts
worker-configuration.d.ts		worker-configuration.d.ts
wrangler.toml		wrangler.toml