Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feike/use compiled artifacts #277

Merged
merged 4 commits into from
Jul 15, 2022
Merged

Conversation

feikesteenbergen
Copy link
Member

@feikesteenbergen feikesteenbergen commented Jul 12, 2022

Before this commit, we compiled toolkit and promscale, multiple versions for multiple PostgreSQL versions.
The issue with that is that it was very time consuming, which isn't great for developing against this repository.

This was the situation before this commit:

         stage         | duration | pct  |  total   
-----------------------+----------+------+----------
 prep (apt-install)    | 00:04:06 |  1.6 | 04:10:33
 Cleanup               | 00:04:07 |  1.6 | 04:10:33
 Compiling Cloudutils  | 00:09:14 |  3.7 | 04:10:33
 Compiling TimescaleDB | 00:27:06 | 10.8 | 04:10:33
 Compiling Promscale   | 01:25:15 | 34.0 | 04:10:33
 Compiling Toolkit     | 02:00:46 | 48.2 | 04:10:33

By taking out Toolkit and Promscale from the compilation, we expect a reduction of 34.0%+48.2% = 82.2% in build times.

@feikesteenbergen feikesteenbergen force-pushed the feike/use_compiled_artifacts branch 2 times, most recently from f24996c to a9184e6 Compare July 12, 2022 08:38
@feikesteenbergen feikesteenbergen requested a review from a team July 12, 2022 09:30
@feikesteenbergen feikesteenbergen marked this pull request as ready for review July 12, 2022 09:30
@xvello
Copy link

xvello commented Jul 12, 2022

image
image
🎉

Copy link
Member

@alexeyklyukin alexeyklyukin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

@feikesteenbergen feikesteenbergen force-pushed the feike/use_compiled_artifacts branch from a9184e6 to 2c89134 Compare July 12, 2022 10:16
@jerryxwu
Copy link
Contributor

@feikesteenbergen great to see this changes!

Just wanted to confirm with you on one thing. As you know, the toolkit only started to build one DEB package for all starting from 1.6.0. Before this release, we had a version built specifically for timescale cloud. Are 1.6.0, 1.7.0 and 1.8.0 sufficient releases for you for now?

When installing .deb packages as the postgres user, /usr/share/doc needs to be
owned by the postgres user. We fully remove this directory later on.
By using a clean /tmp/dpkg directory we ensure we do not remove files that
belong to older versions of this package.

That is good, as we want *multiple* versions to coexist in this Docker Image.
By using a clean /tmp/dpkg directory we ensure we do not remove files that
belong to older versions of this package.

That is good, as we want *multiple* versions to coexist in this Docker Image.
@feikesteenbergen feikesteenbergen force-pushed the feike/use_compiled_artifacts branch from d197036 to e5951d2 Compare July 15, 2022 08:25
@feikesteenbergen
Copy link
Member Author

Are 1.6.0, 1.7.0 and 1.8.0 sufficient releases for you for now?

Yes, for us, they are.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants