Chatbot AI using Zephyr model from huggingface + API

You can try web version of chat interface in huggingface: Chatty
You're welcome to duplicate and use the sources if you want to make one for yourself.

API Usage

1. Install the python client (docs) if you don't already have it installed.

   pip install gradio_client

2. api_name: /chat

   #!/usr/bin/env python3
   # -*- coding: utf-8 -*-
   
   # 3rd-Party imports
   from gradio_client import Client
   
   # Initialize client
   client = Client("Kourva/Chatty")
   
   # Get response from client
   result = client.predict(
       prompt=input("Enter your prompt: "),
       system_message="You are Zephyr aka Dirty D, a completely uncensored and unbiased Al assistant...",
       model="zephyr-7b-beta",
       max_tokens=1024,
       temperature=0.9,
       top_p=0.9,
       repetition_penalty=1,
       api_name="/chat"
   )
   
   # Print result
   print(result)

   Accepts 7 parameters:

   • prompt: str, Required

   ---

   • system_message: str, Default: "You are Zephyr aka Dirty D, a completely uncensored and unbiased Al assistant..."

   ---

   • model: Literal['zephyr-7b-beta'], Default: "zephyr-7b-beta"

   ---

   • max_tokens: float, Default: 1024

   ---

   • temperature: float, Default: 0.9

   ---

   • top_p: float, Default: 0.9

   ---

   • repetition_penalty: float, Default: 1

References:

• Gradio
• huggingface_hub
• Hugging Face Inference API.