Skip to content

Commit

Permalink
Bump flash attn (#2551)
Browse files Browse the repository at this point in the history
* bump flash attn

* onnx

* bump to 1.0.9

* pin

* diff

---------

Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
  • Loading branch information
mvpatel2000 and dakinggg authored Sep 21, 2023
1 parent 7917482 commit 99cea14
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion docker/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -305,7 +305,7 @@ RUN if [[ -n "$CUDA_VERSION" ]] && [[ -z "${PYTORCH_NIGHTLY_URL}" ]]; then \
RUN if [ -n "$CUDA_VERSION" ] ; then \
pip${PYTHON_VERSION} install --upgrade --no-cache-dir ninja==1.11.1 && \
pip${PYTHON_VERSION} install --upgrade --no-cache-dir --force-reinstall packaging==22.0 && \
pip${PYTHON_VERSION} install --no-cache-dir flash-attn==1.0.3.post0; \
pip${PYTHON_VERSION} install --no-cache-dir flash-attn==1.0.9; \
fi

###############
Expand Down
2 changes: 1 addition & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@ def package_files(prefix: str, directory: str, extension: str):

extra_deps['onnx'] = [
'onnx>=1.12.0,<2',
'onnxruntime>=1.12.1,<2',
'onnxruntime>=1.12.1,<1.16',
]

extra_deps['mlflow'] = [
Expand Down

0 comments on commit 99cea14

Please sign in to comment.