Add pre-commit: black+flake8+pylint+mypy+isort+bandit

[NanoCode012]

Closes #43

• black
• pylint
• flake8
• mypy
• isort
• bandit
• Run on previous files
• Test

[NanoCode012]

• Successfully ran a simple fine-tune using QuickStart openllama lora.
• Verify all configs are accurate.

Make sure this PR is squashed or things will be messy

[NanoCode012]

I could not apply isort to pre-commit. black and isort kept circular fixing each other despite setting profile in isort.

Fixed in c97a31c

[NanoCode012]

I will rebase before squash merge when you have finished review or when you think it's proper. I don't want to break the branch since you may be testing on it now.

[winglian]

I ran this dataset (Set shards high so it runs a quicker)

  - path: ehartford/wizard_vicuna_70k_unfiltered
    type: sharegpt:chat
    shards: 20

it's still correct on main

but the entire conversation is attention masked out on this branch

[NanoCode012]

I refactored this function out due to mypy. However, would this be a performance loss since we call this function, then return the result and overwrite previous result object?

[NanoCode012]

Tested that it can finetune openllama config to step 25. Please make sure to squash into 1 commit.