roachtest: cdc/cloud-sink-gcs/rangefeed=true failed #37307

cockroach-teamcity · 2019-05-04T06:50:47Z

SHA: https://github.com/cockroachdb/cockroach/commits/856ba9108f112f85d406bbe88d2208651859336e

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1274175&tab=buildLog

The test failed on branch=master, cloud=gce:
	cdc.go:874,cdc.go:225,cdc.go:579,test.go:1251: max latency was more than allowed: 1m19.556466324s vs 1m0s

The text was updated successfully, but these errors were encountered:

danhhz · 2019-05-07T21:42:16Z

It got backed up between 06:43-06:44, but I don't see anything interesting in the logs during that time. It would probably be instructive to pull on this thread, but for the short term I may just make the test less strict.

There's a small chance that this is related to #36879, but that one involves chaos so it's a small chance.

cockroach-teamcity · 2019-05-21T06:24:38Z

SHA: https://github.com/cockroachdb/cockroach/commits/9671342fead0509bec0913bae4ae1f244660788e

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1298500&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	cluster.go:1474,cdc.go:732,cdc.go:128,cdc.go:581,test.go:1251: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1298500-cdc-cloud-sink-gcs-rangefeed-true:4 -- ./workload fixtures import tpcc --warehouses=50 --checks=false {pgurl:3} returned:
		stderr:
		
		stdout:
		cockroach/pkg/ccl/storageccl/export_storage.go:230
		github.com/cockroachdb/cockroach/pkg/ccl/importccl.readInputFiles
			/go/src/github.com/cockroachdb/cockroach/pkg/ccl/importccl/read_import_proc.go:75
		github.com/cockroachdb/cockroach/pkg/ccl/importccl.(*csvInputReader).readFiles
			/go/src/github.com/cockroachdb/cockroach/pkg/ccl/importccl/read_import_csv.go:80
		github.com/cockroachdb/cockroach/pkg/ccl/importccl.(*readImportDataProcessor).doRun.func1
			/go/src/github.com/cockroachdb/cockroach/pkg/ccl/importccl/read_import_proc.go:488
		github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1
			/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:170
		github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
			/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		runtime.goexit
			/usr/local/go/src/runtime/asm_amd64.s:1333
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_34.74.0.6_2019-05-21T06:17:25Z: exit status 1
		: exit status 1

cockroach-teamcity · 2019-05-22T06:15:30Z

SHA: https://github.com/cockroachdb/cockroach/commits/1810a4eaa07b412b2d0899d25bb16a28a2746d48

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1300948&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	cluster.go:1510,cdc.go:732,cdc.go:128,cdc.go:581,test.go:1251: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1300948-cdc-cloud-sink-gcs-rangefeed-true:4 -- ./workload fixtures import tpcc --warehouses=50 --checks=false {pgurl:1} returned:
		stderr:
		
		stdout:
		I190522 06:12:56.937720 1 ccl/workloadccl/cliccl/fixtures.go:331  starting import of 9 tables
		Error: importing fixture: importing table customer: pq: expected tpcc version "2.1.0" but got "2.0.1"
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_35.229.118.16_2019-05-22T06:12:56Z: exit status 1
		: exit status 1

danhhz · 2019-05-22T14:14:10Z

These failures are more fallout from the PR that upgraded the tpcc workload from version 2.0.1 to 2.1.0. There's an internal check to verify that the version on each node is the same as the one being requested (so we don't generated incompatible data) and release-19.1 has 2.0.1 while the workload binary in roachtest is built from master and now is requesting 2.1.0. I think the simplest fix is to change fixtures import to be run from cockroach workload instead of bare workload

cockroach-teamcity · 2019-06-26T06:49:37Z

SHA: https://github.com/cockroachdb/cockroach/commits/5f358ed804af05f8c4b404efc4d8a282d8e0916c

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1360435&tab=buildLog

The test failed on branch=master, cloud=gce:
	cdc.go:873,cdc.go:220,cdc.go:576,test.go:1249: max latency was more than allowed: 1m12.437707985s vs 1m0s

cockroach-teamcity · 2019-07-05T08:11:25Z

SHA: https://github.com/cockroachdb/cockroach/commits/a2f104c467ee1553a875b45f1e16f8cfb3e3195d

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1374703&tab=buildLog

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20190705-1374703/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:879,cdc.go:226,cdc.go:582,test_runner.go:681: max latency was more than allowed: 1m19.537129246s vs 1m0s

cockroach-teamcity · 2019-10-12T05:59:28Z

SHA: https://github.com/cockroachdb/cockroach/commits/fad7d8c705cdef3c274a8a3bbcb9d08d7386e1ed

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1535757&tab=artifacts#/cdc/cloud-sink-gcs/rangefeed=true

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191012-1535757/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:880,cdc.go:226,cdc.go:583,test_runner.go:689: max latency was more than allowed: 1m10.942143586s vs 1m0s

cockroach-teamcity · 2019-10-28T17:29:32Z

SHA: https://github.com/cockroachdb/cockroach/commits/10cc0bbe7ee37af42782f7cf904efa15acef223f

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1560587&tab=artifacts#/cdc/cloud-sink-gcs/rangefeed=true

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191027-1560587/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cluster.go:1783,cdc.go:736,cdc.go:129,cdc.go:583,test_runner.go:697: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1560587-1572213535-20-n4cpu16:4 -- ./cockroach workload fixtures import tpcc --warehouses=50 --checks=false {pgurl:1} returned:
		stderr:
		
		stdout:
		I191027 22:17:28.896027 1 ccl/workloadccl/fixture.go:316  starting import of 9 tables
		I191027 22:17:30.612781 10 ccl/workloadccl/fixture.go:427  imported 50 KiB in district table (500 rows, 0 index entries, took 1.715343439s, 0.03 MiB/s)
		I191027 22:17:30.738889 9 ccl/workloadccl/fixture.go:427  imported 2.6 KiB in warehouse table (50 rows, 0 index entries, took 1.841497941s, 0.00 MiB/s)
		I191027 22:17:33.564206 15 ccl/workloadccl/fixture.go:427  imported 7.8 MiB in item table (100000 rows, 0 index entries, took 4.666620543s, 1.67 MiB/s)
		I191027 22:17:38.196393 14 ccl/workloadccl/fixture.go:427  imported 5.6 MiB in new_order table (450000 rows, 0 index entries, took 9.298767662s, 0.60 MiB/s)
		Error: importing fixture: importing table history: dial tcp 10.128.0.59:26257: connect: connection refused
		Error:  exit status 1
		: exit status 1

cockroach-teamcity · 2019-12-26T07:58:16Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on master@2ddb82b2a8fff0c4e42169cf4e610d33a0fbd2d3:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191226-1663134/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cluster.go:1786,cdc.go:791,cdc.go:136,cluster.go:2145,errgroup.go:57: error with attached stack trace:
		    main.execCmd
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:399
		    main.(*cluster).RunL
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:1820
		    main.(*cluster).Run
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:1784
		    main.(*tpccWorkload).run
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:791
		    main.cdcBasicTest.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:136
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2145
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: %s returned:
		    stderr:
		    %s
		    stdout:
		    %s
		    -- arg 1: <string>
		    -- arg 2: <string>
		    -- arg 3: <string>
		  - /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1663134-1577345728-20-n4cpu16:4 -- ./workload run tpcc --warehouses=50 --duration=30m --tolerate-errors {pgurl:1-3}  returned:
		    stderr:
		    
		    stdout:
		          0.0 newOrder
		       35.0s      123            0.0            0.9      0.0      0.0      0.0      0.0 orderStatus
		       35.0s      123            0.0            9.2      0.0      0.0      0.0      0.0 payment
		       35.0s      123            0.0            0.9      0.0      0.0      0.0      0.0 stockLevel
		    E191226 07:57:58.069546 1 workload/cli/run.go:444  error in payment: dial tcp 10.128.0.27:26257: connect: connection refused
		       36.0s      134            0.0            0.8      0.0      0.0      0.0      0.0 delivery
		       36.0s      134            3.0            0.1  18253.6  18253.6  18253.6  18253.6 newOrder
		       36.0s      134            0.0            0.9      0.0      0.0      0.0      0.0 orderStatus
		       36.0s      134            0.0            8.9      0.0      0.0      0.0      0.0 payment
		       36.0s      134            0.0            0.8      0.0      0.0      0.0      0.0 stockLevel
		    E191226 07:57:59.070233 1 workload/cli/run.go:444  error in stockLevel: dial tcp 10.128.0.27:26257: connect: connection refused:
		  - context canceled

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-08T08:56:08Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on master@873c377178a140d0e997741646b6c6e4318f7e87:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200108-1678603/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 3m48.431986041s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-09T05:55:27Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on provisional_202001090312_v20.1.0-alpha.20200113@617cb39e3ced263cb4c253aa2e3edd172368f7cf:

The test failed on branch=provisional_202001090312_v20.1.0-alpha.20200113, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200109-1680508/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 1m43.804286935s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-09T08:08:56Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on release-19.1@3d6bb038f3afcf805fb48dddcffa342195d3d7e0:

The test failed on branch=release-19.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200109-1680663/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 1m32.327601146s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-09T08:41:16Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on release-19.2@94eeef00ebd472e3ab052a6de07b428059351b8d:

The test failed on branch=release-19.2, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200109-1680681/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 2m59.701611569s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-10T08:54:12Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on master@413fd1e46c2936029458db495efa242acb1b7d52:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200110-1683243/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 3m35.329055426s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-11T08:27:49Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on release-19.2@07057cf68ec19eb0777f611fedaaefde72fe673a:

The test failed on branch=release-19.2, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200111-1684749/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 1m51.600855512s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-11T08:49:31Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on master@9a89b2e038d2fc67e9e155742e3e18316bf08d11:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200111-1684731/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 2m18.164132349s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-01-13T08:40:50Z

(roachtest).cdc/cloud-sink-gcs/rangefeed=true failed on master@07ebd0230cea54110f249420fd215adc1d2d5ecf:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200113-1685619/cdc/cloud-sink-gcs/rangefeed=true/run_1
	cdc.go:922,cdc.go:226,cdc.go:627,test_runner.go:716: max latency was more than allowed: 6m2.539965773s vs 1m0s

Repro

Artifacts: /cdc/cloud-sink-gcs/rangefeed=true

make stressrace TESTS=cdc/cloud-sink-gcs/rangefeed=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

danhhz · 2020-01-13T16:50:59Z

These changefeed roachtests all seem to have started failing around the same time. Definitely something to look into here.

danhhz · 2020-01-13T23:25:08Z

I suspect these failures are fallout from the roachprod change that accidentally started running everything in roachtest as geo-distributed.

nvanbenschoten · 2020-03-21T21:45:57Z

This hasn't failed for more than two months. Closing.

cockroach-teamcity added this to the 19.2 milestone May 4, 2019

cockroach-teamcity assigned danhhz May 4, 2019

cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. labels May 4, 2019

danhhz added the A-cdc Change Data Capture label May 7, 2019

tbg added the branch-master Failures and bugs on the master branch. label Jan 22, 2020

nvanbenschoten closed this as completed Mar 21, 2020

jayshrivastava mentioned this issue Feb 21, 2023

roachtest/cdc: increase cloud storage assume role acceptable latency #97394

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

roachtest: cdc/cloud-sink-gcs/rangefeed=true failed #37307

roachtest: cdc/cloud-sink-gcs/rangefeed=true failed #37307

cockroach-teamcity commented May 4, 2019

danhhz commented May 7, 2019

cockroach-teamcity commented May 21, 2019

cockroach-teamcity commented May 22, 2019

danhhz commented May 22, 2019

cockroach-teamcity commented Jun 26, 2019

cockroach-teamcity commented Jul 5, 2019

cockroach-teamcity commented Oct 12, 2019

cockroach-teamcity commented Oct 28, 2019

cockroach-teamcity commented Dec 26, 2019

cockroach-teamcity commented Jan 8, 2020

cockroach-teamcity commented Jan 9, 2020

cockroach-teamcity commented Jan 9, 2020

cockroach-teamcity commented Jan 9, 2020

cockroach-teamcity commented Jan 10, 2020

cockroach-teamcity commented Jan 11, 2020

cockroach-teamcity commented Jan 11, 2020

cockroach-teamcity commented Jan 13, 2020

danhhz commented Jan 13, 2020

danhhz commented Jan 13, 2020

nvanbenschoten commented Mar 21, 2020

roachtest: cdc/cloud-sink-gcs/rangefeed=true failed #37307

roachtest: cdc/cloud-sink-gcs/rangefeed=true failed #37307

Comments

cockroach-teamcity commented May 4, 2019

danhhz commented May 7, 2019

cockroach-teamcity commented May 21, 2019

cockroach-teamcity commented May 22, 2019

danhhz commented May 22, 2019

cockroach-teamcity commented Jun 26, 2019

cockroach-teamcity commented Jul 5, 2019

cockroach-teamcity commented Oct 12, 2019

cockroach-teamcity commented Oct 28, 2019

cockroach-teamcity commented Dec 26, 2019

cockroach-teamcity commented Jan 8, 2020

cockroach-teamcity commented Jan 9, 2020

cockroach-teamcity commented Jan 9, 2020

cockroach-teamcity commented Jan 9, 2020

cockroach-teamcity commented Jan 10, 2020

cockroach-teamcity commented Jan 11, 2020

cockroach-teamcity commented Jan 11, 2020

cockroach-teamcity commented Jan 13, 2020

danhhz commented Jan 13, 2020

danhhz commented Jan 13, 2020

nvanbenschoten commented Mar 21, 2020