You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
aim is to make everyones life easier to experiment with AI
requirements & deliverables
create python script to setup a VM in VAST.AI (all automated)
easy install (integrated with the setup script on VAST.AI)
bash script for installing all required components (use Ubuntu 22.04)
requirements script for pip install (required python components)
a test script to check the cuda is working in right version & the GPU is found with minimal requirements
a python script which parses pdf (use pdf2text commandline, not the python version), uses wiki txt files, download a website e.g. manual.grid.tf and question/answer files for finetuning and populates the model
experiment with multiple models and demonstrate results (timing, quality, ...): see below
bring openai compatible API life on top of Avast GPU machine (ok to do SSH portforwarding)
all scripts use 'set -ex' to make sure they stop when error
can also use vscript (see vlang) as alternative to bash, we have quite some primitives working see crystallib (ask codescalers team for help if needed)
put some example pdf, and text files in this repo' so its easy for people to experiment
use info from threefold and see how the results are for questions and answer: https://manual.grid.tf/
The text was updated successfully, but these errors were encountered:
aim is to make everyones life easier to experiment with AI
requirements & deliverables
gpu usage
models
experiment with following models
some info which can be used
Fine-tuning Large Language Model (LLM) on a Custom Dataset with QLoRA _ MLExpert - Crush Your Machine Learning interview.pdf
implementation details
The text was updated successfully, but these errors were encountered: