connect with 3rd party OpenAI compatible API #245
Replies: 9 comments
-
Yes it should be possible @eschmidbauer , can you show your code? |
Beta Was this translation helpful? Give feedback.
-
basically just these two changes and it doesn't seem to work. |
Beta Was this translation helpful? Give feedback.
-
Also in the manifest.content_scripts.matches you should add the vLLM site URL. Could you share the URL with me so I can test making it work by modifying chatgpt.js if necessary? |
Beta Was this translation helpful? Give feedback.
-
sorry it's a private URL- i will update the |
Beta Was this translation helpful? Give feedback.
-
What's the errors in console say? also vLLM probably accepts different format payloads than OpenAI ones, so I would need to study their API to add a method to use theirs |
Beta Was this translation helpful? Give feedback.
-
it's the same API spec as OpenAI's |
Beta Was this translation helpful? Give feedback.
-
For ChatGPT.js it started off as a library of functions to interact with chat.openai.com so uses DOM as the description states. Only recently are API methods slowly being added (like chatgpt.getChatData()) which rely on the access token provided to client when logged in to chat.openai.com. So a method to send prompts hasn't been implemented yet, but it is in the works (if you goto https://github.com/kudoai/duckduckgpt , it will work like that getShowReply(prompt), except you would type chatgpt.send(prompt)) |
Beta Was this translation helpful? Give feedback.
-
can we extend current solution to be compatible with chatGPT via azure connection : https://learn.microsoft.com/en-us/azure/ai-services/openai/reference ? |
Beta Was this translation helpful? Give feedback.
-
vLLM supports an OpenAI-Compatible API. is it possible to configure this code to connect to another service other than OpenAI?
![image](https://private-user-images.githubusercontent.com/7139998/253314228-7757e9cb-6c6d-4c80-83b5-8036ffe72697.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU5NzE3OTAsIm5iZiI6MTcyNTk3MTQ5MCwicGF0aCI6Ii83MTM5OTk4LzI1MzMxNDIyOC03NzU3ZTljYi02YzZkLTRjODAtODNiNS04MDM2ZmZlNzI2OTcucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDkxMCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA5MTBUMTIzMTMwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OGIwNjEwNDlmNzAyYmFjMzQyYTQ3YWI2ZGFjMDFhMmQ0MzFhYzgzZmU2ZDI4ODVmYjNjNmI1NGYyMDVmZmQzNCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.VdvC5O_42iUfrN2hifCl6d3brm25tvO8fb4f99emwjs)
I've tried modifying the code but i am getting errors.
Beta Was this translation helpful? Give feedback.
All reactions