Skip to content

andrewfulton9/jupyter-ai

 
 

Repository files navigation

Jupyter AI

Jupyter AI is under incubation as part of the JupyterLab organization.

Jupyter AI connects generative AI with Jupyter notebooks. Jupyter AI provides a user-friendly and powerful way to explore generative AI models in notebooks and improve your productivity in JupyterLab and the Jupyter Notebook. More specifically, Jupyter AI offers:

  • An %%ai magic that turns the Jupyter notebook into a reproducible generative AI playground. This works anywhere the IPython kernel runs (JupyterLab, Jupyter Notebook, Google Colab, Kaggle, VSCode, etc.).
  • A native chat UI in JupyterLab that enables you to work with generative AI as a conversational assistant.
  • Support for a wide range of generative model providers, including AI21, Anthropic, AWS, Cohere, Gemini, Hugging Face, MistralAI, NVIDIA, and OpenAI.
  • Local model support through GPT4All and Ollama, enabling use of generative AI models on consumer grade machines with ease and privacy.

Documentation is available on ReadTheDocs.

A screenshot of Jupyter AI showing the chat interface and the magic commands

Requirements

You will need to have installed the following software to use Jupyter AI:

  • Python 3.8 - 3.12
  • JupyterLab 4 or Notebook 7

In addition, you will need access to at least one model provider.

Important

JupyterLab 3 reached its end of maintenance date on May 15, 2024. As a result, we will not backport new features to the v1 branch supporting JupyterLab 3. Fixes for critical issues will still be backported until December 31, 2024. If you are still using JupyterLab 3, we strongly encourage you to upgrade to JupyterLab 4 as soon as possible. For more information, see JupyterLab 3 end of maintenance on the Jupyter Blog.

Setting Up Model Providers in a Notebook

To use any AI model provider within this notebook, you'll need the appropriate credentials, such as API keys.

Obtain the necessary credentials, such as API keys, from your model provider's platform.

You can set your keys using environment variables or in a code cell in your notebook. In a code cell, you can use the %env magic command to set the credentials as follows:

# NOTE: Replace 'PROVIDER_API_KEY' with the credential key's name,
# and replace 'YOUR_API_KEY_HERE' with the key.
%env PROVIDER_API_KEY=YOUR_API_KEY_HERE

For more specific instructions for each model provider, refer to the model providers documentation.

Installation

Below is a simplified overview of the installation and usage process. See our official documentation for details on installing and using Jupyter AI.

With pip

If you want to install both the %%ai magic and the JupyterLab extension, you can run:

$ pip install jupyter-ai

If you are not using JupyterLab and you only want to install the Jupyter AI %%ai magic, you can run: