AI News Summarizer with Cloudflare Workers AI and public LoRAs
![coverimg](https://private-user-images.githubusercontent.com/8932430/348360431-a9b9920b-a2a8-460f-95f2-6e919b397a78.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk3NTg2NDksIm5iZiI6MTczOTc1ODM0OSwicGF0aCI6Ii84OTMyNDMwLzM0ODM2MDQzMS1hOWI5OTIwYi1hMmE4LTQ2MGYtOTVmMi02ZTkxOWIzOTdhNzgucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxNyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTdUMDIxMjI5WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OTM2NGY4MWFkZDFhOTM3Njk3YzAxZjUwMTEwYWFkYzFkZGMyMjM3NTk5MWQ3NzYzMzQxMzg2ZDk2NGZiYjNiNiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.EZUa_Ge8o_YVNHdT2xKoFnMIPpsqyhGKzBUuyPdMDFQ)
Run fine-tuned inference with adapters trained with Low-Rank Adaptation for free.
This project uses the mistral-7b-instruct-v0.1
fine-tune and cf-public-cnn-summarization
LoRA adapter.
To run the app--
-
Install the necessary libraries with
pip install -r requirements.txt
. -
Make a .env file with the following, replacing the Cloudflare API Token and Cloudflare Account ID with your own credentials from your Cloudflare dashboard Workers & Pages Overview:
CF_API_TOKEN=XXX
CF_ACCOUNT_ID=XXX
- Run
streamlit run app.py
to run the app. - ✨tada🎉