Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to golang 1.22 #1753

Merged
merged 8 commits into from
Mar 4, 2024
Merged

Upgrade to golang 1.22 #1753

merged 8 commits into from
Mar 4, 2024

Conversation

gargnitingoogle
Copy link
Collaborator

@gargnitingoogle gargnitingoogle commented Feb 28, 2024

Description

Upgrade to golang 1.22

Link to the issue in case of a bug fix.

NA

Testing details

  1. Manual - Did sanity testing.
  2. Unit tests - NA
  3. Integration tests - Ran through presubmit - passed
  4. Perf tests results

First run
---------

+--------+------------+--------------+------------+-------------+--------------+
| Branch | File Size  |   Read BW    |  Write BW  | RandRead BW | RandWrite BW |
+--------+------------+--------------+------------+-------------+--------------+
| Master |  0.25MiB   |  496.7MiB/s  | 1.21MiB/s  |  71.83MiB/s |  1.27MiB/s   |
|   PR   |  0.25MiB   |  509.3MiB/s  |  1.3MiB/s  |  71.32MiB/s |  1.08MiB/s   |
|        |            |              |            |             |              |
|        |            |              |            |             |              |
| Master | 48.828MiB  | 4754.43MiB/s | 77.42MiB/s | 256.34MiB/s |  47.12MiB/s  |
|   PR   | 48.828MiB  | 4722.55MiB/s | 76.01MiB/s | 210.91MiB/s |  44.0MiB/s   |
|        |            |              |            |             |              |
|        |            |              |            |             |              |
| Master | 976.562MiB | 954.63MiB/s  | 3.28MiB/s  |  73.9MiB/s  |  3.18MiB/s   |
|   PR   | 976.562MiB | 575.55MiB/s  | 0.94MiB/s  |  38.65MiB/s |  1.41MiB/s   |
|        |            |              |            |             |              |
|        |            |              |            |             |              |
+--------+------------+--------------+------------+-------------+--------------+

Second run
----------

+--------+------------+--------------+------------+-------------+--------------+
| Branch | File Size  |   Read BW    |  Write BW  | RandRead BW | RandWrite BW |
+--------+------------+--------------+------------+-------------+--------------+
| Master |  0.25MiB   | 458.24MiB/s  | 1.21MiB/s  |  61.87MiB/s |  1.17MiB/s   |
|   PR   |  0.25MiB   | 509.53MiB/s  | 1.28MiB/s  |  73.72MiB/s |  1.36MiB/s   |
|        |            |              |            |             |              |
|        |            |              |            |             |              |
| Master | 48.828MiB  | 744.32MiB/s  | 41.56MiB/s |  54.4MiB/s  |  41.57MiB/s  |
|   PR   | 48.828MiB  | 2348.94MiB/s | 56.97MiB/s | 127.66MiB/s |  38.79MiB/s  |
|        |            |              |            |             |              |
|        |            |              |            |             |              |
| Master | 976.562MiB | 313.15MiB/s  |  0.7MiB/s  |  20.95MiB/s |  0.64MiB/s   |
|   PR   | 976.562MiB | 409.36MiB/s  | 0.78MiB/s  |  24.03MiB/s |  0.77MiB/s   |
|        |            |              |            |             |              |
|        |            |              |            |             |              |
+--------+------------+--------------+------------+-------------+--------------+

Third run
---------

+--------+------------+-------------+------------+-------------+--------------+
| Branch | File Size  |   Read BW   |  Write BW  | RandRead BW | RandWrite BW |
+--------+------------+-------------+------------+-------------+--------------+
| Master |  0.25MiB   | 469.33MiB/s | 1.16MiB/s  |  63.59MiB/s |  1.18MiB/s   |
|   PR   |  0.25MiB   | 465.15MiB/s | 1.27MiB/s  |  55.75MiB/s |  1.18MiB/s   |
|        |            |             |            |             |              |
|        |            |             |            |             |              |
| Master | 48.828MiB  | 774.08MiB/s | 44.89MiB/s |  71.5MiB/s  |  40.31MiB/s  |
|   PR   | 48.828MiB  | 536.99MiB/s | 40.58MiB/s |  57.61MiB/s |  40.58MiB/s  |
|        |            |             |            |             |              |
|        |            |             |            |             |              |
| Master | 976.562MiB |  326.9MiB/s | 0.67MiB/s  |  27.56MiB/s |  0.78MiB/s   |
|   PR   | 976.562MiB |  624.6MiB/s | 1.96MiB/s  |  45.29MiB/s |  1.98MiB/s   |
|        |            |             |            |             |              |
|        |            |             |            |             |              |
+--------+------------+-------------+------------+-------------+--------------+

@gargnitingoogle gargnitingoogle added execute-perf-test Execute performance test in PR execute-integration-tests Run only integration tests labels Feb 28, 2024
To address the following build errors in ci workflow:

Autobuilder was built with go1.21.7, environment has go1.21.7.
Error: We were unable to automatically build your code. Please replace the call to the autobuild action with your custom build steps. Encountered a fatal error while running "/opt/hostedtoolcache/CodeQL/2.16.3/x64/codeql/go/tools/autobuild.sh". Exit code was 1 and last log line was: 2024/02/28 18:16:40 Extraction failed: exit status 1. See the logs for more details.
@gargnitingoogle gargnitingoogle added execute-perf-test Execute performance test in PR execute-integration-tests Run only integration tests and removed execute-perf-test Execute performance test in PR execute-integration-tests Run only integration tests labels Feb 28, 2024
go.mod Show resolved Hide resolved
@gargnitingoogle gargnitingoogle added execute-perf-test Execute performance test in PR and removed execute-perf-test Execute performance test in PR execute-integration-tests Run only integration tests labels Feb 29, 2024
Copy link
Collaborator

@ashmeenkaur ashmeenkaur left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approval for code changes.
Would request @sethiay or @raj-prince to check perf tests once. Overall from all the runs, I think the regression is not because of the PR changes.

@gargnitingoogle gargnitingoogle merged commit 3adecdf into master Mar 4, 2024
8 checks passed
@gargnitingoogle gargnitingoogle deleted the gargnitin/golang-1.22 branch March 4, 2024 07:48
gargnitingoogle added a commit that referenced this pull request Mar 5, 2024
gargnitingoogle added a commit that referenced this pull request Mar 5, 2024
This reverts commit 3adecdf.

This is to address internal bug id 328071755 .
gargnitingoogle added a commit that referenced this pull request Mar 5, 2024
gargnitingoogle added a commit that referenced this pull request Mar 5, 2024
gargnitingoogle added a commit that referenced this pull request Mar 6, 2024
gargnitingoogle added a commit that referenced this pull request Mar 7, 2024
Reapply "Upgrade to golang 1.22 (#1753)" (#1766)

This reverts commit a63a46f and fixes
merge conflicts with golang 1.21.7 upgrade which went in earlier.
gargnitingoogle added a commit that referenced this pull request Mar 8, 2024
Reapply "Upgrade to golang 1.22 (#1753)" (#1766)

This reverts commit a63a46f and fixes
merge conflicts with golang 1.21.7 upgrade which went in earlier.
gargnitingoogle added a commit that referenced this pull request Mar 11, 2024
Reapply "Upgrade to golang 1.22 (#1753)" (#1766)

This reverts commit a63a46f and fixes
merge conflicts with golang 1.21.7 upgrade which went in earlier.
gargnitingoogle added a commit that referenced this pull request Mar 12, 2024
Reapply "Upgrade to golang 1.22 (#1753)" (#1766)

This reverts commit a63a46f and fixes
merge conflicts with golang 1.21.7 upgrade which went in earlier.
gargnitingoogle added a commit that referenced this pull request Mar 12, 2024
* Upgrade to golang 1.22 (without dockerfile fix)

Reapply "Upgrade to golang 1.22 (#1753)" (#1766)

This reverts commit a63a46f and fixes
merge conflicts with golang 1.21.7 upgrade which went in earlier.

* Fix containerize_gcsfuse/dockerfile for go 1.22

Does the following
1. Create a go module (go.mod) in a directory package_gcsfuse,
   to bypass the change in go get behaviour introduced in 1.17
   and enforced in go 1.22.
2. Fix some paths and commands etc. accordingly in the dockerfile.

* Fix package_gcsfuse/dockerfile for go 1.22

Does the following
1. Create a go module (go.mod) in a directory package_gcsfuse,
   to bypass the change in go get behaviour introduced in 1.17
   and enforced in go 1.22.
2. Fix some paths and commands etc. accordingly in the dockerfile.

* Switch containerize*/Dockerfile to use git clone

* Switch package*/Dockerfile to use git clone

* Replace /go with ${GOPATH}

* Minimize run of git clone

Fetch only the last commit state in docker files
during git clone to reduce its runtime.
This reduces the runtime of git clone dramatically.

* Upgrade from go 1.22.0 to 1.22.1
Tulsishah pushed a commit that referenced this pull request Mar 15, 2024
* Upgrade to golang 1.22 (without dockerfile fix)

Reapply "Upgrade to golang 1.22 (#1753)" (#1766)

This reverts commit a63a46f and fixes
merge conflicts with golang 1.21.7 upgrade which went in earlier.

* Fix containerize_gcsfuse/dockerfile for go 1.22

Does the following
1. Create a go module (go.mod) in a directory package_gcsfuse,
   to bypass the change in go get behaviour introduced in 1.17
   and enforced in go 1.22.
2. Fix some paths and commands etc. accordingly in the dockerfile.

* Fix package_gcsfuse/dockerfile for go 1.22

Does the following
1. Create a go module (go.mod) in a directory package_gcsfuse,
   to bypass the change in go get behaviour introduced in 1.17
   and enforced in go 1.22.
2. Fix some paths and commands etc. accordingly in the dockerfile.

* Switch containerize*/Dockerfile to use git clone

* Switch package*/Dockerfile to use git clone

* Replace /go with ${GOPATH}

* Minimize run of git clone

Fetch only the last commit state in docker files
during git clone to reduce its runtime.
This reduces the runtime of git clone dramatically.

* Upgrade from go 1.22.0 to 1.22.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
execute-perf-test Execute performance test in PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants