Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate the tests race conditions #1369

Open
1 task
rach-id opened this issue Feb 10, 2023 · 10 comments
Open
1 task

Investigate the tests race conditions #1369

rach-id opened this issue Feb 10, 2023 · 10 comments
Labels
bug Something isn't working testing items that are strictly related to adding or extending test coverage WS: Maintenance 🔧 includes bugs, refactors, flakes, and tech debt etc

Comments

@rach-id
Copy link
Member

rach-id commented Feb 10, 2023

Description

Currently, when running the race tests, we're also adding the -short flag. This means that multiple tests get skipped and not checked for races:

@VERSION=$(VERSION) go test -mod=readonly -race -short ./...

To see the races happening, run the following:

$ go test -mod=readonly -race  ./... 

Acceptance Criteria

  • Investigate the issue
@rach-id rach-id added the testing items that are strictly related to adding or extending test coverage label Feb 10, 2023
@evan-forbes
Copy link
Member

one of the race conditions appears to be caused by the changes introduced in #1300. Now we're reading the header in the CheckTxState in Baseapp during ProcessProposal, which is somehow tripping up the race detector since that same state can be written to by a different routine, although that different routine doesn't appear to doing so until we commit the block.

@rach-id
Copy link
Member Author

rach-id commented Feb 10, 2023

We could add a mutex to the context to fix this, no?. But another race sometimes happens also, related to IAVL (would need to run the tests multiple times to get it)

@evan-forbes
Copy link
Member

we should see what the cosmos-sdk does to prevent this in v0.47.0-rc2

@Wondertan
Copy link
Member

Posting here a recent race we observed in our CI.

WARNING: DATA RACE
Read at 0x00c00a4fbc50 by goroutine 5384:
  github.com/cosmos/cosmos-sdk/store/rootmulti.(*Store).LastCommitID()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/store/rootmulti/store.go:405 +0x3e
  github.com/cosmos/cosmos-sdk/store/rootmulti.(*Store).LatestVersion()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/store/rootmulti/store.go:400 +0x2e
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).createQueryContext()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/baseapp/abci.go:635 +0x16d
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).RegisterGRPCServer.func1()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/baseapp/grpcserver.go:50 +0x1c9
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25 +0x8e
  github.com/grpc-ecosystem/go-grpc-middleware/recovery.UnaryServerInterceptor.func1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/recovery/interceptors.go:33 +0x139
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25 +0x8e
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:34 +0x126
  github.com/cosmos/cosmos-sdk/x/auth/types._Query_Account_Handler()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/x/auth/types/query.pb.go:1178 +0x1dd
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).RegisterGRPCServer.func2()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/baseapp/grpcserver.go:82 +0x13b
  google.golang.org/grpc.(*Server).processUnaryRPC()
      /home/runner/go/pkg/mod/google.golang.org/grpc@v1.52.0/server.go:1336 +0x15da
  google.golang.org/grpc.(*Server).handleStream()
      /home/runner/go/pkg/mod/google.golang.org/grpc@v1.52.0/server.go:1704 +0xff8
  google.golang.org/grpc.(*Server).serveStreams.func1.2()
      /home/runner/go/pkg/mod/google.golang.org/grpc@v1.52.0/server.go:965 +0xec

Previous write at 0x00c00a4fbc50 by goroutine 5037:
  github.com/cosmos/cosmos-sdk/store/rootmulti.(*Store).Commit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/store/rootmulti/store.go:431 +0x1a7
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).Commit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.8.0-sdk-v0.46.7/baseapp/abci.go:332 +0x203
  github.com/celestiaorg/celestia-app/app.(*App).Commit()
      <autogenerated>:1 +0x44
  github.com/tendermint/tendermint/abci/client.(*localClient).CommitSync()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/abci/client/local_client.go:290 +0x11a
  github.com/tendermint/tendermint/proxy.(*appConnConsensus).CommitSync()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/proxy/app_conn.go:96 +0x42
  github.com/tendermint/tendermint/state.(*BlockExecutor).Commit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/state/execution.go:298 +0x366
  github.com/tendermint/tendermint/state.(*BlockExecutor).ApplyBlock()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/state/execution.go:250 +0xa90
  github.com/tendermint/tendermint/consensus.(*State).finalizeCommit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:1668 +0x12cc
  github.com/tendermint/tendermint/consensus.(*State).tryFinalizeCommit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:1576 +0x495
  github.com/tendermint/tendermint/consensus.(*State).enterCommit.func1()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:1511 +0x13d
  runtime.deferreturn()
      /opt/hostedtoolcache/go/1.19.5/x64/src/runtime/panic.go:476 +0x32
  github.com/tendermint/tendermint/consensus.(*State).addVote()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:2171 +0x2b64
  github.com/tendermint/tendermint/consensus.(*State).tryAddVote()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:1963 +0x77
  github.com/tendermint/tendermint/consensus.(*State).handleMsg()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:853 +0x1bc
  github.com/tendermint/tendermint/consensus.(*State).receiveRoutine()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:780 +0x6f1
  github.com/tendermint/tendermint/consensus.(*State).OnStart.func1()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.14.0-tm-v0.34.23/consensus/state.go:379 +0x3b

@evan-forbes evan-forbes added this to the Mainnet milestone Apr 12, 2023
@evan-forbes evan-forbes added the bug Something isn't working label Apr 12, 2023
@MSevey
Copy link
Member

MSevey commented May 23, 2023

Capturing recent occurrence

--> Running tests in race mode
VERSION=0.15.0-rc0-52-g5aba51b go test -mod=readonly -race ./test/util/testnode
==================
WARNING: DATA RACE
Write at 0x00c001424b10 by goroutine 189:
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).BeginBlock()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.13.0-sdk-v0.46.11/baseapp/abci.go:177 +0xa6b
  github.com/celestiaorg/celestia-app/app.(*App).BeginBlock()
      <autogenerated>:1 +0x97
  github.com/tendermint/tendermint/abci/client.(*localClient).BeginBlockSync()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/abci/client/local_client.go:306 +0x174
  github.com/tendermint/tendermint/proxy.(*appConnConsensus).BeginBlockSync()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/proxy/app_conn.go:84 +0xb7
  github.com/tendermint/tendermint/state.execBlockOnProxyApp()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/state/execution.go:377 +0x59c
  github.com/tendermint/tendermint/state.(*BlockExecutor).ApplyBlock()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/state/execution.go:210 +0x22d
  github.com/tendermint/tendermint/consensus.(*State).finalizeCommit()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:1681 +0x12cc
  github.com/tendermint/tendermint/consensus.(*State).tryFinalizeCommit()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:1589 +0x495
  github.com/tendermint/tendermint/consensus.(*State).enterCommit.func1()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:1524 +0x113
  runtime.deferreturn()
      /usr/local/go/src/runtime/panic.go:476 +0x32
  github.com/tendermint/tendermint/consensus.(*State).addVote()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:2192 +0x2b64
  github.com/tendermint/tendermint/consensus.(*State).tryAddVote()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:1984 +0x77
  github.com/tendermint/tendermint/consensus.(*State).handleMsg()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:867 +0x1bc
  github.com/tendermint/tendermint/consensus.(*State).receiveRoutine()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:794 +0x6f1
  github.com/tendermint/tendermint/consensus.(*State).OnStart.func1()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.21.0-tm-v0.34.27/consensus/state.go:388 +0x3b

Previous read at 0x00c001424b10 by goroutine 6890:
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).createQueryContext()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.13.0-sdk-v0.46.11/baseapp/abci.go:672 +0x519
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).RegisterGRPCServer.func1()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.13.0-sdk-v0.46.11/baseapp/grpcserver.go:50 +0x1c9
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1()
      /Users/matt/Code/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25 +0x8e
  github.com/grpc-ecosystem/go-grpc-middleware/recovery.UnaryServerInterceptor.func1()
      /Users/matt/Code/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/recovery/interceptors.go:33 +0x139
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1()
      /Users/matt/Code/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25 +0x8e
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1()
      /Users/matt/Code/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:34 +0x126
  github.com/cosmos/cosmos-sdk/x/auth/types._Query_Account_Handler()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.13.0-sdk-v0.46.11/x/auth/types/query.pb.go:1178 +0x1dd
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).RegisterGRPCServer.func2()
      /Users/matt/Code/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.13.0-sdk-v0.46.11/baseapp/grpcserver.go:82 +0x13b
  google.golang.org/grpc.(*Server).processUnaryRPC()
      /Users/matt/Code/go/pkg/mod/google.golang.org/grpc@v1.52.0/server.go:1336 +0x15da
  google.golang.org/grpc.(*Server).handleStream()
      /Users/matt/Code/go/pkg/mod/google.golang.org/grpc@v1.52.0/server.go:1704 +0xff8
  google.golang.org/grpc.(*Server).serveStreams.func1.2()
      /Users/matt/Code/go/pkg/mod/google.golang.org/grpc@v1.52.0/server.go:965 +0xec

@rach-id
Copy link
Member Author

rach-id commented May 23, 2023

@MSevey Can you please link where this happened?

@MSevey
Copy link
Member

MSevey commented May 24, 2023

@MSevey Can you please link where this happened?

this issue came up when in my 1:1 with Evan. I just rand the test/utils/testnode package with the race detector. I was just interested in learning more about it, but sounds like this has been a persistent issue.

Full stack trace https://gist.github.com/MSevey/e9a5db50e5407ee6c8810471659b0daa

@evan-forbes
Copy link
Member

evan-forbes commented Jun 15, 2023

we should try again since this should at least help celestiaorg/cosmos-sdk#326 since it eliminates the reading of the header in the checkTx state during prepare and process proposal

@Wondertan
Copy link
Member

One more. Maybe related to above, maybe not:

==================
WARNING: DATA RACE
Write at 0x00c0081ebf28 by goroutine 2986:
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).setCheckState()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.15.0-sdk-v0.46.13/baseapp/baseapp.go:437 +0x2af
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).Commit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.15.0-sdk-v0.46.13/baseapp/abci.go:353 +0x544
  github.com/celestiaorg/celestia-app/app.(*App).Commit()
      <autogenerated>:1 +0x44
  github.com/tendermint/tendermint/abci/client.(*localClient).CommitSync()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/abci/client/local_client.go:290 +0x11a
  github.com/tendermint/tendermint/proxy.(*appConnConsensus).CommitSync()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/proxy/app_conn.go:96 +0x42
  github.com/tendermint/tendermint/state.(*BlockExecutor).Commit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/state/execution.go:298 +0x366
  github.com/tendermint/tendermint/state.(*BlockExecutor).ApplyBlock()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/state/execution.go:250 +0xa90
  github.com/tendermint/tendermint/consensus.(*State).finalizeCommit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:1681 +0x12cc
  github.com/tendermint/tendermint/consensus.(*State).tryFinalizeCommit()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:1589 +0x495
  github.com/tendermint/tendermint/consensus.(*State).enterCommit.func1()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:1524 +0x113
  runtime.deferreturn()
      /opt/hostedtoolcache/go/1.20.5/x64/src/runtime/panic.go:476 +0x32
  github.com/tendermint/tendermint/consensus.(*State).addVote()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:2191 +0x2b64
  github.com/tendermint/tendermint/consensus.(*State).tryAddVote()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:1983 +0x77
  github.com/tendermint/tendermint/consensus.(*State).handleMsg()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:867 +0x65c
  github.com/tendermint/tendermint/consensus.(*State).receiveRoutine()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:794 +0x6cb
  github.com/tendermint/tendermint/consensus.(*State).OnStart.func1()
      /home/runner/go/pkg/mod/github.com/celestiaorg/celestia-core@v1.22.0-tm-v0.34.28/consensus/state.go:388 +0x3b

Previous read at 0x00c0081ebf28 by goroutine 5232:
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).createQueryContext()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.15.0-sdk-v0.46.13/baseapp/abci.go:673 +0x4f2
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).RegisterGRPCServer.func1()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.15.0-sdk-v0.46.13/baseapp/grpcserver.go:50 +0x1c9
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25 +0x8e
  github.com/grpc-ecosystem/go-grpc-middleware/recovery.UnaryServerInterceptor.func1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/recovery/interceptors.go:33 +0x139
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25 +0x8e
  github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1()
      /home/runner/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:34 +0x126
  github.com/cosmos/cosmos-sdk/x/auth/types._Query_Account_Handler()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.15.0-sdk-v0.46.13/x/auth/types/query.pb.go:1178 +0x1dd
  github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).RegisterGRPCServer.func2()
      /home/runner/go/pkg/mod/github.com/celestiaorg/cosmos-sdk@v1.15.0-sdk-v0.46.13/baseapp/grpcserver.go:82 +0x13b
  google.golang.org/grpc.(*Server).processUnaryRPC()
      /home/runner/go/pkg/mod/google.golang.org/grpc@v1.55.0/server.go:1337 +0x17be
  google.golang.org/grpc.(*Server).handleStream()
      /home/runner/go/pkg/mod/google.golang.org/grpc@v1.55.0/server.go:1714 +0xff8
  google.golang.org/grpc.(*Server).serveStreams.func1.1()
      /home/runner/go/pkg/mod/google.golang.org/grpc@v1.55.0/server.go:959 +0xec

evan-forbes added a commit that referenced this issue Jul 25, 2023
…2163)

## Overview

the testnode is still hitting the race detector #1369, so we aren't
running those integration tests with the race detector

## Checklist

- [x] New and updated code has appropriate documentation
- [x] New and updated code has new and/or updated testing
- [x] Required CI checks are passing
- [x] Visual proof for any user facing features like CLI or
documentation updates
- [ ] Linked issues closed with keywords
evan-forbes added a commit that referenced this issue Jul 26, 2023
…2163)

## Overview

the testnode is still hitting the race detector #1369, so we aren't
running those integration tests with the race detector

## Checklist

- [x] New and updated code has appropriate documentation
- [x] New and updated code has new and/or updated testing
- [x] Required CI checks are passing
- [x] Visual proof for any user facing features like CLI or
documentation updates
- [ ] Linked issues closed with keywords
evan-forbes added a commit that referenced this issue Aug 2, 2023
…2163)

## Overview

the testnode is still hitting the race detector #1369, so we aren't
running those integration tests with the race detector

## Checklist

- [x] New and updated code has appropriate documentation
- [x] New and updated code has new and/or updated testing
- [x] Required CI checks are passing
- [x] Visual proof for any user facing features like CLI or
documentation updates
- [ ] Linked issues closed with keywords
@evan-forbes evan-forbes removed this from the Mainnet milestone Aug 7, 2023
@evan-forbes evan-forbes added WS: Maintenance 🔧 includes bugs, refactors, flakes, and tech debt etc needs:triage labels May 17, 2024
@evan-forbes
Copy link
Member

evan-forbes commented Jun 10, 2024

blocked by first switching to v0.50.0 of the sdk since that would likely fix this issue #3535

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working testing items that are strictly related to adding or extending test coverage WS: Maintenance 🔧 includes bugs, refactors, flakes, and tech debt etc
Projects
None yet
Development

No branches or pull requests

4 participants