Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve CI build time #139

Merged
merged 6 commits into from
Jul 16, 2024
Merged

Improve CI build time #139

merged 6 commits into from
Jul 16, 2024

Conversation

vmilosevic
Copy link
Contributor

@vmilosevic vmilosevic commented Jul 15, 2024

Improve CI build time

Cache /opt/ttmlir-toolchain

  • moved ttmlir-toolchain build to separate action
  • build ttmlir-toolchain only if files in env/ are changed or there is no cache

Use ccache for builds

  • Add ccache to build
  • Ccache folder will be cached between pipeline runs

env/CMakeLists.txt

  • Moved dependency versions to variables

Note:
Github can access the cache from "parent" branches, but not the other way around. This means that we will sometimes get one more full build, for example if we make a change in a branch to update the flatbuffer version we will have full build for branch, and again full build for main after merging. This is just how Github works

Build time with toolchain caching and cache added:

image

Closes: #36
Closes: #51

- add action to build and cache /opt/ttmlir-toolchain
- build only if files in env/ changes
@vmilosevic vmilosevic requested a review from nsmithtt as a code owner July 15, 2024 16:19
@nsmithtt
Copy link
Contributor

Do you think it'd be possible to cache ccache directory? That should really speed up the Mac build.

@vmilosevic vmilosevic changed the title Improve CI build time [Draft] Improve CI build time Jul 16, 2024
@vmilosevic vmilosevic changed the title [Draft] Improve CI build time Improve CI build time Jul 16, 2024
@vmilosevic vmilosevic merged commit 8f9799e into main Jul 16, 2024
3 checks passed
@vmilosevic vmilosevic deleted the vmilosevic/speed-up-ci branch July 16, 2024 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cache llvm build to avoid rebuilding in CI Figure out how to make our build runner work faster.
2 participants