- First, make sure you're in the main branch with
git checkout main
, and update withgit pull origin
- Then, make a branch with
git checkout -b <name>
- After preparing your prompt/test following the example in smoke, push with
git push origin <name>
- Go to the repo URL and open a PR from pull requests tab
- You will see a report with the result (did it pass), responses, and prompts after combining with context
- Topic: cheminf, spectroscopy, qm, md, bio, genchem, numerics, other, stats, thermo, vis
- Eval: code, human
- Special: disabled
Files can be accessed by the test scripts relative to the example yml
file directory using the _FILE_DIR_
variable. For example (from dipole
):
import numpy as np
import os
coordinates = np.loadtxt(os.path.join(_FILE_DIR_,"water.xyz"),usecols=(1,2,3))
papermill -f output.yml human_eval_template.ipynb test.ipynb
jupyter-nbconvert --to=html --no-input test.ipynb