Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Polkadot staging node fails to start #3596

Closed
EclesioMeloJunior opened this issue Nov 20, 2023 · 5 comments
Closed

Polkadot staging node fails to start #3596

EclesioMeloJunior opened this issue Nov 20, 2023 · 5 comments

Comments

@EclesioMeloJunior
Copy link
Member

Issue summary

The Polkadot staging node fails with, this error is similar to the one that happens when trying to start a Westend node from 9m snapshot, a good point of start is checking the staging resources

2023-11-20T04:00:27Z WARN     failed to advertise in the DHT: failed to find any peer in table	pkg=network
--
2023-11-20T04:00:57Z WARN     failed to advertise in the DHT: failed to find any peer in table	pkg=network
2023-11-20T04:01:27Z WARN     failed to advertise in the DHT: failed to find any peer in table	pkg=network
2023-11-20T04:01:57Z WARN     failed to advertise in the DHT: failed to find any peer in table	pkg=network
unexpected fault address 0x7f3a4a93d2ae
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0x7f3a4a93d2ae pc=0x474eb8]
goroutine 1 [running]:
runtime.throw({0x18d1412?, 0x0?})
runtime/panic.go:1077 +0x5c fp=0xc000c7c2c8 sp=0xc000c7c298 pc=0x43dc1c
runtime.sigpanic()
runtime/signal_unix.go:875 +0x285 fp=0xc000c7c328 sp=0xc000c7c2c8 pc=0x454d05
runtime.memmove()
runtime/memmove_amd64.s:218 +0x1d8 fp=0xc000c7c330 sp=0xc000c7c328 pc=0x474eb8
github.com/ChainSafe/gossamer/internal/database.(*PebbleDB).Get(0xc000c7c3d8?, {0xc0053a0930?, 0x2?, 0x0?})
github.com/ChainSafe/gossamer/internal/database/pebble.go:68 +0xbc fp=0xc000c7c3a8 sp=0xc000c7c330 pc=0xbe269c
github.com/ChainSafe/gossamer/internal/database.(*table).Get(0xc000a020f0, {0xc0054f57a0?, 0xc000a020f0?, 0xc00522da80?})
github.com/ChainSafe/gossamer/internal/database/table.go:30 +0x90 fp=0xc000c7c418 sp=0xc000c7c3a8 pc=0xbe3170
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc00522d580)
github.com/ChainSafe/gossamer/lib/trie/database.go:81 +0x119 fp=0xc000c7c5f8 sp=0xc000c7c418 pc=0xbec299
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc0051cad80)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7c7d8 sp=0xc000c7c5f8 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc004f2e100)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7c9b8 sp=0xc000c7c7d8 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc004bfd180)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7cb98 sp=0xc000c7c9b8 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc000cb7d00)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7cd78 sp=0xc000c7cb98 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc000a75a00)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7cf58 sp=0xc000c7cd78 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc000a75000)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7d138 sp=0xc000c7cf58 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).loadNode(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, 0xc0000e0100)
github.com/ChainSafe/gossamer/lib/trie/database.go:95 +0x258 fp=0xc000c7d318 sp=0xc000c7d138 pc=0xbec3d8
github.com/ChainSafe/gossamer/lib/trie.(*Trie).Load(0xc00047e080, {0x7f3a66024540, 0xc000a020f0}, {0xa1, 0xd7, 0x6d, 0x7, 0x72, 0x70, 0xde, ...})
github.com/ChainSafe/gossamer/lib/trie/database.go:54 +0x2b9 fp=0xc000c7d3d0 sp=0xc000c7d318 pc=0xbec139
github.com/ChainSafe/gossamer/dot/state.(*StorageState).LoadFromDB(0xc0000e0000, {0xa1, 0xd7, 0x6d, 0x7, 0x72, 0x70, 0xde, 0x5b, 0xb8, ...})
github.com/ChainSafe/gossamer/dot/state/storage.go:123 +0x125 fp=0xc000c7d460 sp=0xc000c7d3d0 pc=0xd77765
github.com/ChainSafe/gossamer/dot/state.(*Service).Start(0xc0000dc370)
github.com/ChainSafe/gossamer/dot/state/service.go:139 +0x4b3 fp=0xc000c7d630 sp=0xc000c7d460 pc=0xd742b3
github.com/ChainSafe/gossamer/dot.startStateService({0xc00043a310?}, 0x3?)
github.com/ChainSafe/gossamer/dot/services.go:89 +0x4f fp=0xc000c7d698 sp=0xc000c7d630 pc=0x13adb8f
github.com/ChainSafe/gossamer/dot.newNode(0xc0000ec680, 0xc0001d5a70, {0x1db1ac0, 0x3004400}, {0x1d9fbd8?, 0xc000aa33b0})
github.com/ChainSafe/gossamer/dot/node.go:305 +0x5c9 fp=0xc000c7d9b8 sp=0xc000c7d698 pc=0x13ab549
github.com/ChainSafe/gossamer/dot.NewNode(0xc0003c2de0?, 0xf?)
github.com/ChainSafe/gossamer/dot/node.go:242 +0x129 fp=0xc000c7da48 sp=0xc000c7d9b8 pc=0x13aac09
github.com/ChainSafe/gossamer/cmd/gossamer/commands.execRoot(0x0?)
github.com/ChainSafe/gossamer/cmd/gossamer/commands/root.go:616 +0x4f5 fp=0xc000c7dbe8 sp=0xc000c7da48 pc=0x1430b35
github.com/ChainSafe/gossamer/cmd/gossamer/commands.NewRootCommand.func1(0xc0000de700?, {0x18ce8ac?, 0x4?, 0x18ce874?})
github.com/ChainSafe/gossamer/cmd/gossamer/commands/root.go:81 +0x13 fp=0xc000c7dc00 sp=0xc000c7dbe8 pc=0x1433cb3
github.com/spf13/cobra.(*Command).execute(0xc00045ef00, {0xc0001be010, 0x6, 0x6})
github.com/spf13/cobra@v1.8.0/command.go:983 +0xabc fp=0xc000c7dda0 sp=0xc000c7dc00 pc=0x87233c
github.com/spf13/cobra.(*Command).ExecuteC(0xc00045ef00)
github.com/spf13/cobra@v1.8.0/command.go:1115 +0x3ff fp=0xc000c7de78 sp=0xc000c7dda0 pc=0x872bff
github.com/spf13/cobra.(*Command).Execute(...)
github.com/spf13/cobra@v1.8.0/command.go:1039
main.main()
github.com/ChainSafe/gossamer/cmd/gossamer/main.go:31 +0x1df fp=0xc000c7df40 sp=0xc000c7de78 pc=0x143479f
runtime.main()
runtime/proc.go:267 +0x2bb fp=0xc000c7dfe0 sp=0xc000c7df40 pc=0x44069b
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000c7dfe8 sp=0xc000c7dfe0 pc=0x473ee1
goroutine 2 [force gc (idle), 5 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000066fa8 sp=0xc000066f88 pc=0x440b0e
runtime.goparkunlock(...)
runtime/proc.go:404
runtime.forcegchelper()
runtime/proc.go:322 +0xb3 fp=0xc000066fe0 sp=0xc000066fa8 pc=0x440973
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x473ee1
created by runtime.init.6 in goroutine 1
runtime/proc.go:310 +0x1a
goroutine 3 [GC sweep wait]:
runtime.gopark(0x2fd2101?, 0x0?, 0x0?, 0x0?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000067778 sp=0xc000067758 pc=0x440b0e
runtime.goparkunlock(...)
runtime/proc.go:404
runtime.bgsweep(0x0?)
runtime/mgcsweep.go:321 +0xdf fp=0xc0000677c8 sp=0xc000067778 pc=0x42a9ff
runtime.gcenable.func1()
runtime/mgc.go:200 +0x25 fp=0xc0000677e0 sp=0xc0000677c8 pc=0x41fac5
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x473ee1
created by runtime.gcenable in goroutine 1
runtime/mgc.go:200 +0x66
goroutine 4 [GC scavenge wait]:
runtime.gopark(0x2fd3840?, 0x2616812?, 0x0?, 0x0?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000067f70 sp=0xc000067f50 pc=0x440b0e
runtime.goparkunlock(...)
runtime/proc.go:404
runtime.(*scavengerState).park(0x2fd3840)
runtime/mgcscavenge.go:425 +0x49 fp=0xc000067fa0 sp=0xc000067f70 pc=0x428269
runtime.bgscavenge(0x0?)
runtime/mgcscavenge.go:658 +0x59 fp=0xc000067fc8 sp=0xc000067fa0 pc=0x428819
runtime.gcenable.func2()
runtime/mgc.go:201 +0x25 fp=0xc000067fe0 sp=0xc000067fc8 pc=0x41fa65
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x473ee1
created by runtime.gcenable in goroutine 1
runtime/mgc.go:201 +0xa5
goroutine 18 [finalizer wait]:
runtime.gopark(0x0?, 0x1b9f828?, 0x0?, 0x0?, 0x1000000010?)
runtime/proc.go:398 +0xce fp=0xc000066628 sp=0xc000066608 pc=0x440b0e
runtime.runfinq()
runtime/mfinal.go:193 +0x107 fp=0xc0000667e0 sp=0xc000066628 pc=0x41eb47
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x473ee1
created by runtime.createfing in goroutine 1
runtime/mfinal.go:163 +0x3d
goroutine 19 [select, 5 minutes]:
runtime.gopark(0xc000062790?, 0x2?, 0x0?, 0x0?, 0xc00006272c?)
runtime/proc.go:398 +0xce fp=0xc000112db0 sp=0xc000112d90 pc=0x440b0e
runtime.selectgo(0xc000112f90, 0xc000062728, 0x0?, 0x0, 0x0?, 0x1)
runtime/select.go:327 +0x725 fp=0xc000112ed0 sp=0xc000112db0 pc=0x451025
github.com/ipfs/go-log/writer.(*MirrorWriter).logRoutine(0xc000192270)
github.com/ipfs/go-log@v1.0.5/writer/writer.go:71 +0x10e fp=0xc000112fc8 sp=0xc000112ed0 pc=0xf3474e
github.com/ipfs/go-log/writer.NewMirrorWriter.func1()
github.com/ipfs/go-log@v1.0.5/writer/writer.go:36 +0x25 fp=0xc000112fe0 sp=0xc000112fc8 pc=0xf34585
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000112fe8 sp=0xc000112fe0 pc=0x473ee1
created by github.com/ipfs/go-log/writer.NewMirrorWriter in goroutine 1
github.com/ipfs/go-log@v1.0.5/writer/writer.go:36 +0xbf
goroutine 20 [chan receive]:
runtime.gopark(0xc000116120?, 0xc000056500?, 0x8?, 0xa0?, 0x3b85eb4f94f246?)
runtime/proc.go:398 +0xce fp=0xc000062ee0 sp=0xc000062ec0 pc=0x440b0e
runtime.chanrecv(0xc0001160c0, 0xc000062fa0, 0x1)
runtime/chan.go:583 +0x3cd fp=0xc000062f58 sp=0xc000062ee0 pc=0x40bfad
runtime.chanrecv2(0x2fd3980?, 0x0?)
runtime/chan.go:447 +0x12 fp=0xc000062f80 sp=0xc000062f58 pc=0x40bbd2
github.com/golang/glog.(*loggingT).flushDaemon(0x0?)
github.com/golang/glog@v1.0.0/glog.go:882 +0x66 fp=0xc000062fc8 sp=0xc000062f80 pc=0xe3c7c6
github.com/golang/glog.init.0.func1()
github.com/golang/glog@v1.0.0/glog.go:410 +0x25 fp=0xc000062fe0 sp=0xc000062fc8 pc=0xe3aa45
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000062fe8 sp=0xc000062fe0 pc=0x473ee1
created by github.com/golang/glog.init.0 in goroutine 1
github.com/golang/glog@v1.0.0/glog.go:410 +0x1ae
goroutine 21 [select]:
runtime.gopark(0xc000063788?, 0x3?, 0xd0?, 0xcd?, 0xc000063772?)
runtime/proc.go:398 +0xce fp=0xc000063618 sp=0xc0000635f8 pc=0x440b0e
runtime.selectgo(0xc000063788, 0xc00006376c, 0xc000211d80?, 0x0, 0x0?, 0x1)
runtime/select.go:327 +0x725 fp=0xc000063738 sp=0xc000063618 pc=0x451025
go.opencensus.io/stats/view.(*worker).start(0xc000211d80)
go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f fp=0xc0000637c8 sp=0xc000063738 pc=0xf6b75f
go.opencensus.io/stats/view.init.0.func1()
go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x25 fp=0xc0000637e0 sp=0xc0000637c8 pc=0xf6aa85
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000637e8 sp=0xc0000637e0 pc=0x473ee1
created by go.opencensus.io/stats/view.init.0 in goroutine 1
go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d
goroutine 22 [GC worker (idle)]:
runtime.gopark(0x3b862bb5aaba48?, 0xc000048020?, 0x1a?, 0x14?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000063f50 sp=0xc000063f30 pc=0x440b0e
runtime.gcBgMarkWorker()
runtime/mgc.go:1293 +0xe5 fp=0xc000063fe0 sp=0xc000063f50 pc=0x421645
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x473ee1
created by runtime.gcBgMarkStartWorkers in goroutine 1
runtime/mgc.go:1217 +0x1c
goroutine 5 [GC worker (idle)]:
runtime.gopark(0x3b862bb5a55dc1?, 0x3?, 0xac?, 0x92?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000068750 sp=0xc000068730 pc=0x440b0e
runtime.gcBgMarkWorker()
runtime/mgc.go:1293 +0xe5 fp=0xc0000687e0 sp=0xc000068750 pc=0x421645
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x473ee1
created by runtime.gcBgMarkStartWorkers in goroutine 1
runtime/mgc.go:1217 +0x1c
goroutine 23 [GC worker (idle)]:
runtime.gopark(0x3b862bb5aaa985?, 0x3?, 0xbe?, 0x67?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000064750 sp=0xc000064730 pc=0x440b0e
runtime.gcBgMarkWorker()
runtime/mgc.go:1293 +0xe5 fp=0xc0000647e0 sp=0xc000064750 pc=0x421645
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000647e8 sp=0xc0000647e0 pc=0x473ee1
created by runtime.gcBgMarkStartWorkers in goroutine 1
runtime/mgc.go:1217 +0x1c
goroutine 34 [GC worker (idle)]:
runtime.gopark(0x3b862bb598fa26?, 0x3?, 0x84?, 0x78?, 0x0?)
runtime/proc.go:398 +0xce fp=0xc000062750 sp=0xc000062730 pc=0x440b0e
runtime.gcBgMarkWorker()
runtime/mgc.go:1293 +0xe5 fp=0xc0000627e0 sp=0xc000062750 pc=0x421645
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x473ee1
created by runtime.gcBgMarkStartWorkers in goroutine 1
runtime/mgc.go:1217 +0x1c
goroutine 31 [chan receive, 5 minutes]:
runtime.gopark(0x9a2d34?, 0xc000622bd0?, 0x0?, 0xd0?, 0x1006bb?)
runtime/proc.go:398 +0xce fp=0xc000076d48 sp=0xc000076d28 pc=0x440b0e
runtime.chanrecv(0xc0001165a0, 0xc000076e58, 0x1)
runtime/chan.go:583 +0x3cd fp=0xc000076dc0 sp=0xc000076d48 pc=0x40bfad
runtime.chanrecv2(0xc0004341e0?, 0x5?)
runtime/chan.go:447 +0x12 fp=0xc000076de8 sp=0xc000076dc0 pc=0x40bbd2
github.com/cockroachdb/pebble.(*cleanupManager).mainLoop(0xc0004341e0)
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/cleaner.go:155 +0xdb fp=0xc000076f08 sp=0xc000076de8 pc=0xb3951b
github.com/cockroachdb/pebble.openCleanupManager.func1.1({0x1d9fcf0, 0xc000570120})
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/cleaner.go:86 +0x17 fp=0xc000076f20 sp=0xc000076f08 pc=0xb39057
runtime/pprof.Do({0x1d9fa88?, 0x3004400?}, {{0xc000377d80?, 0xc0000b57d0?, 0xacb66f?}}, 0xc0000b57c0)
runtime/pprof/runtime.go:51 +0x9d fp=0xc000076f90 sp=0xc000076f20 pc=0xa032dd
github.com/cockroachdb/pebble.openCleanupManager.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/cleaner.go:85 +0x56 fp=0xc000076fe0 sp=0xc000076f90 pc=0xb39016
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000076fe8 sp=0xc000076fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble.openCleanupManager in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/cleaner.go:84 +0x298
goroutine 78 [sync.Cond.Wait, 5 minutes]:
runtime.gopark(0xc000024100?, 0x100?, 0x0?, 0x1?, 0x15ad2c0?)
runtime/proc.go:398 +0xce fp=0xc000069d20 sp=0xc000069d00 pc=0x440b0e
runtime.goparkunlock(...)
runtime/proc.go:404
sync.runtime_notifyListWait(0xc0007a00a0, 0x0)
runtime/sema.go:527 +0x159 fp=0xc000069d70 sp=0xc000069d20 pc=0x470059
sync.(*Cond).Wait(0x0?)
sync/cond.go:70 +0x85 fp=0xc000069db0 sp=0xc000069d70 pc=0x47d425
github.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/record/log_writer.go:204
github.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc0007a0000, {0x1689de0, 0x3004400})
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/record/log_writer.go:436 +0x67c fp=0xc000069ef8 sp=0xc000069db0 pc=0xad777c
github.com/cockroachdb/pebble/record.(*LogWriter).flushLoop-fm({0x1d9fcf0?, 0xc0000d0360?})
<autogenerated>:1 +0x33 fp=0xc000069f20 sp=0xc000069ef8 pc=0xadab33
runtime/pprof.Do({0x1d9fa88?, 0x3004400?}, {{0xc000377ca0?, 0xbc9480?, 0xc0000dc000?}}, 0xc000069fc0)
runtime/pprof/runtime.go:51 +0x9d fp=0xc000069f90 sp=0xc000069f20 pc=0xa032dd
github.com/cockroachdb/pebble/record.NewLogWriter.func2()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/record/log_writer.go:355 +0x56 fp=0xc000069fe0 sp=0xc000069f90 pc=0xad70d6
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/record/log_writer.go:354 +0x416
goroutine 82 [select]:
runtime.gopark(0xc000621f80?, 0x2?, 0x9?, 0x18?, 0xc000621f34?)
runtime/proc.go:398 +0xce fp=0xc000621d80 sp=0xc000621d60 pc=0x440b0e
runtime.selectgo(0xc000621f80, 0xc000621f30, 0xc000271e00?, 0x0, 0xc000382180?, 0x1)
runtime/select.go:327 +0x725 fp=0xc000621ea0 sp=0xc000621d80 pc=0x451025
github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/vfs/disk_health.go:566 +0xfb fp=0xc000621fe0 sp=0xc000621ea0 pc=0x999a1b
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc000621fe8 sp=0xc000621fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/vfs/disk_health.go:555 +0x6e
goroutine 77 [select]:
runtime.gopark(0xc0000b0fa8?, 0x2?, 0xe5?, 0x2a?, 0xc0000b0f74?)
runtime/proc.go:398 +0xce fp=0xc0000b0df0 sp=0xc0000b0dd0 pc=0x440b0e
runtime.selectgo(0xc0000b0fa8, 0xc0000b0f70, 0x0?, 0x0, 0x0?, 0x1)
runtime/select.go:327 +0x725 fp=0xc0000b0f10 sp=0xc0000b0df0 pc=0x451025
github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/vfs/disk_health.go:171 +0xcb fp=0xc0000b0fe0 sp=0xc0000b0f10 pc=0x9980ab
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b0fe8 sp=0xc0000b0fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/vfs/disk_health.go:166 +0x58
goroutine 76 [select]:
runtime.gopark(0xc0000b1fa8?, 0x2?, 0xe5?, 0x2a?, 0xc0000b1f74?)
runtime/proc.go:398 +0xce fp=0xc0000b1df0 sp=0xc0000b1dd0 pc=0x440b0e
runtime.selectgo(0xc0000b1fa8, 0xc0000b1f70, 0x0?, 0x0, 0x0?, 0x1)
runtime/select.go:327 +0x725 fp=0xc0000b1f10 sp=0xc0000b1df0 pc=0x451025
github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/vfs/disk_health.go:171 +0xcb fp=0xc0000b1fe0 sp=0xc0000b1f10 pc=0x9980ab
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b1fe8 sp=0xc0000b1fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/vfs/disk_health.go:166 +0x58
goroutine 75 [chan receive]:
runtime.gopark(0x9a4897?, 0xc0008edbc0?, 0x68?, 0x26?, 0xaf3d90?)
runtime/proc.go:398 +0xce fp=0xc0000b2610 sp=0xc0000b25f0 pc=0x440b0e
runtime.chanrecv(0xc000093140, 0xc0000b26d0, 0x1)
runtime/chan.go:583 +0x3cd fp=0xc0000b2688 sp=0xc0000b2610 pc=0x40bfad
runtime.chanrecv2(0xc000d1c5a0?, 0xc0000dc2c0?)
runtime/chan.go:447 +0x12 fp=0xc0000b26b0 sp=0xc0000b2688 pc=0x40bbd2
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x1d9fcf0, 0xc000570420})
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:370 +0x94 fp=0xc0000b2708 sp=0xc0000b26b0 pc=0xbc9514
runtime/pprof.Do({0x1d9fa88?, 0x3004400?}, {{0xc000377dc0?, 0x0?, 0xc0000b27d0?}}, 0xc0000b27a8)
runtime/pprof/runtime.go:51 +0x9d fp=0xc0000b2778 sp=0xc0000b2708 pc=0xa032dd
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:368 +0x52 fp=0xc0000b27c8 sp=0xc0000b2778 pc=0xbc9452
github.com/cockroachdb/pebble.(*tableCacheShard).init.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0x25 fp=0xc0000b27e0 sp=0xc0000b27c8 pc=0xbc93c5
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b27e8 sp=0xc0000b27e0 pc=0x473ee1
created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0xe5
goroutine 72 [chan receive]:
runtime.gopark(0x9a4897?, 0xc0008ed4a0?, 0x68?, 0x2e?, 0xaf3d90?)
runtime/proc.go:398 +0xce fp=0xc0000b2e10 sp=0xc0000b2df0 pc=0x440b0e
runtime.chanrecv(0xc000092f00, 0xc0000b2ed0, 0x1)
runtime/chan.go:583 +0x3cd fp=0xc0000b2e88 sp=0xc0000b2e10 pc=0x40bfad
runtime.chanrecv2(0xc000a5a810?, 0xc0000dc000?)
runtime/chan.go:447 +0x12 fp=0xc0000b2eb0 sp=0xc0000b2e88 pc=0x40bbd2
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x1d9fcf0, 0xc000570270})
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:370 +0x94 fp=0xc0000b2f08 sp=0xc0000b2eb0 pc=0xbc9514
runtime/pprof.Do({0x1d9fa88?, 0x3004400?}, {{0xc000377dc0?, 0x0?, 0xc0000b2fd0?}}, 0xc0000b2fa8)
runtime/pprof/runtime.go:51 +0x9d fp=0xc0000b2f78 sp=0xc0000b2f08 pc=0xa032dd
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0000b2f98?)
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:368 +0x52 fp=0xc0000b2fc8 sp=0xc0000b2f78 pc=0xbc9452
github.com/cockroachdb/pebble.(*tableCacheShard).init.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0x25 fp=0xc0000b2fe0 sp=0xc0000b2fc8 pc=0xbc93c5
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b2fe8 sp=0xc0000b2fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0xe5
goroutine 73 [chan receive]:
runtime.gopark(0x9a4897?, 0xc0007e74a0?, 0x68?, 0xee?, 0xaf3d90?)
runtime/proc.go:398 +0xce fp=0xc00061ee10 sp=0xc00061edf0 pc=0x440b0e
runtime.chanrecv(0xc000092fc0, 0xc00061eed0, 0x1)
runtime/chan.go:583 +0x3cd fp=0xc00061ee88 sp=0xc00061ee10 pc=0x40bfad
runtime.chanrecv2(0xc00467d800?, 0xc0000dc160?)
runtime/chan.go:447 +0x12 fp=0xc00061eeb0 sp=0xc00061ee88 pc=0x40bbd2
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x1d9fcf0, 0xc0005701b0})
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:370 +0x94 fp=0xc00061ef08 sp=0xc00061eeb0 pc=0xbc9514
runtime/pprof.Do({0x1d9fa88?, 0x3004400?}, {{0xc000377dc0?, 0x0?, 0xc00061efd0?}}, 0xc00061efa8)
runtime/pprof/runtime.go:51 +0x9d fp=0xc00061ef78 sp=0xc00061ef08 pc=0xa032dd
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc00061ef98?)
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:368 +0x52 fp=0xc00061efc8 sp=0xc00061ef78 pc=0xbc9452
github.com/cockroachdb/pebble.(*tableCacheShard).init.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0x25 fp=0xc00061efe0 sp=0xc00061efc8 pc=0xbc93c5
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc00061efe8 sp=0xc00061efe0 pc=0x473ee1
created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0xe5
goroutine 74 [chan receive]:
runtime.gopark(0x9a4897?, 0xc000a69980?, 0x68?, 0x3e?, 0xaf3d90?)
runtime/proc.go:398 +0xce fp=0xc0000b3e10 sp=0xc0000b3df0 pc=0x440b0e
runtime.chanrecv(0xc000093080, 0xc0000b3ed0, 0x1)
runtime/chan.go:583 +0x3cd fp=0xc0000b3e88 sp=0xc0000b3e10 pc=0x40bfad
runtime.chanrecv2(0xc004e02480?, 0xc0000dc210?)
runtime/chan.go:447 +0x12 fp=0xc0000b3eb0 sp=0xc0000b3e88 pc=0x40bbd2
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x1d9fcf0, 0xc000570300})
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:370 +0x94 fp=0xc0000b3f08 sp=0xc0000b3eb0 pc=0xbc9514
runtime/pprof.Do({0x1d9fa88?, 0x3004400?}, {{0xc000377dc0?, 0x0?, 0x0?}}, 0xc0000b3fa8)
runtime/pprof/runtime.go:51 +0x9d fp=0xc0000b3f78 sp=0xc0000b3f08 pc=0xa032dd
github.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:368 +0x52 fp=0xc0000b3fc8 sp=0xc0000b3f78 pc=0xbc9452
github.com/cockroachdb/pebble.(*tableCacheShard).init.func1()
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0x25 fp=0xc0000b3fe0 sp=0xc0000b3fc8 pc=0xbc93c5
runtime.goexit()
runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b3fe8 sp=0xc0000b3fe0 pc=0x473ee1
created by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 1
github.com/cockroachdb/pebble@v0.0.0-20230928194634-aa077af62593/table_cache.go:360 +0xe5

Other information and links

@ramiroJCB
Copy link
Contributor

@EclesioMeloJunior hey could you provide to me the 9million snapshop?
also while running the polkadot chain, I ran into

2024-02-22T15:30:33-05:00 WARN     failed to advertise in the DHT: failed to find any peer in table     pkg=network
2024-02-22T15:30:04-05:00 WARN     failed to open connection for peer 12D3KooWEdsXX9657ppNqqrRuaCHFvuNemasgU5msLDwSJ6WqsKc: failed to dial: failed to dial 12D3KooWEdsXX9657ppNqqrRuaCHFvuNemasgU5msLDwSJ6WqsKc: no good addresses   pkg=network
2024-02-22T15:30:09-05:00 WARN     failed to open connection for peer 12D3KooWAtx477KzC8LwqLjWWUG6WF4Gqp2eNXmeqAG98ehAMWYH: failed to dial: context deadline exceeded        pkg=network
2024-02-22T15:30:09-05:00 WARN     failed to open connection for peer 12D3KooWAGCCPZbr9UWGXPtBosTZo91Hb5M3hU8v6xbKgnC5LVao: failed to dial: failed to dial 12D3KooWAGCCPZbr9UWGXPtBosTZo91Hb5M3hU8v6xbKgnC5LVao: no good addresses   pkg=network
2024-02-22T15:30:09-05:00 WARN     failed to open connection for peer 12D3KooWJ4eyPowiVcPU46pXuE2cDsiAmuBKXnFcFPapm4xKFdMJ: failed to dial: failed to dial 12D3KooWJ4eyPowiVcPU46pXuE2cDsiAmuBKXnFcFPapm4xKFdMJ: no good addresses   pkg=network
2024-02-22T15:30:09-05:00 WARN     failed to open connection for peer 12D3KooWNMUcqwSj38oEq1zHeGnWKmMvrCFnpMftw7JzjAtRj2rU: failed to dial: failed to dial 12D3KooWNMUcqwSj38oEq1zHeGnWKmMvrCFnpMftw7JzjAtRj2rU: no good addresses   pkg=network
2024-02-22T15:30:09-05:00 WARN     failed to open connection for peer 12D3KooWDs6LnpmWDWgZyGtcLVr3E75CoBxzg1YZUPL5Bb1zz6fM: failed to dial: failed to dial 12D3KooWDs6LnpmWDWgZyGtcLVr3E75CoBxzg1YZUPL5Bb1zz6fM: no good addresses   pkg=network
2024-02-22T15:34:03-05:00 WARN     failed to advertise in the DHT: failed to find any peer in table     pkg=network
2024-02-22T15:34:33-05:00 WARN     failed to advertise in the DHT: failed to find any peer in table     pkg=network
2024-02-22T15:35:03-05:00 WARN     failed to advertise in the DHT: failed to find any peer in table     pkg=network

so my guess is that the booting nodes are not correct, you have them?

@EclesioMeloJunior
Copy link
Member Author

EclesioMeloJunior commented Feb 26, 2024

@ramiroJCB I just remembered that we don't have any snapshots for polkadot net because we didn't generate them since we are facing this problem. We only have snapshots for westend network.

Regards the bootnodes, you can update the chain/polkadot/chain-spec-raw.json at the bootNodes array to the following ones:

"/dns/polkadot-connect-0.parity.io/tcp/443/wss/p2p/12D3KooWEPmjoRpDSUuiTjvyNDd8fejZ9eNWH5bE965nyBMDrB4o",
    "/dns/polkadot-connect-1.parity.io/tcp/443/wss/p2p/12D3KooWLvcA24g6sT9YTaQyinwowMbLF5z7iMLoxZpEiV9pSmNf",
    "/dns/polkadot-connect-2.parity.io/tcp/443/wss/p2p/12D3KooWDhp18HYzJuVX2jLhtjQgAhT1XWGqah42StoUJpkLvh2o",
    "/dns/polkadot-connect-3.parity.io/tcp/443/wss/p2p/12D3KooWEsPEadSjLAPyxckqVJkp54aVdPuX3DD6a1FTL2y5cB9x",
    "/dns/polkadot-connect-4.parity.io/tcp/443/wss/p2p/12D3KooWFfG1SQvcPoUK2N41cx7r52KYXKpRtZxfLZk8xtVzpp4d",
    "/dns/polkadot-connect-5.parity.io/tcp/443/wss/p2p/12D3KooWDmQPkBvQGg9wjBdFThtWj3QCDVQyHJ1apfWrHvjwbYS8",
    "/dns/polkadot-connect-6.parity.io/tcp/443/wss/p2p/12D3KooWBKtPpCnVTTzD7fPpCdFsrsYZ5K8fwmsLabb1JBuCycYs",
    "/dns/polkadot-connect-7.parity.io/tcp/443/wss/p2p/12D3KooWP3BsFY6UaiLjEJ3YbDp6q6SMQgAHB15qKj41DUZQLMqD",
    "/dns/p2p.0.polkadot.network/tcp/30333/p2p/12D3KooWHsvEicXjWWraktbZ4MQBizuyADQtuEGr3NbDvtm5rFA5",
    "/dns/p2p.1.polkadot.network/tcp/30333/p2p/12D3KooWQz2q2UWVCiy9cFX1hHYEmhSKQB2hjEZCccScHLGUPjcc",
    "/dns/p2p.2.polkadot.network/tcp/30333/p2p/12D3KooWNHxjYbDLLbDNZ2tq1kXgif5MSiLTUWJKcDdedKu4KaG8",
    "/dns/p2p.3.polkadot.network/tcp/30333/p2p/12D3KooWGJQysxrQcSvUWWNw88RkqYvJhH3ZcDpWJ8zrXKhLP5Vr",
    "/dns/p2p.4.polkadot.network/tcp/30333/p2p/12D3KooWKer8bYqpYjwurVABu13mkELpX2X7mSpEicpjShLeg7D6",
    "/dns/p2p.5.polkadot.network/tcp/30333/p2p/12D3KooWSRjL9LcEQd5u2fQTbyLxTEHq1tUFgQ6amXSp8Eu7TfKP",
    "/dns/cc1-0.parity.tech/tcp/30333/p2p/12D3KooWSz8r2WyCdsfWHgPyvD8GKQdJ1UAiRmrcrs8sQB3fe2KU",
    "/dns/cc1-1.parity.tech/tcp/30333/p2p/12D3KooWFN2mhgpkJsDBuNuE5427AcDrsib8EoqGMZmkxWwx3Md4",
    "/dns/polkadot-boot.dwellir.com/tcp/30334/ws/p2p/12D3KooWKvdDyRKqUfSAaUCbYiLwKY8uK3wDWpCuy2FiDLbkPTDJ",
    "/dns/polkadot-boot.dwellir.com/tcp/443/wss/p2p/12D3KooWKvdDyRKqUfSAaUCbYiLwKY8uK3wDWpCuy2FiDLbkPTDJ",
    "/dns/boot.stake.plus/tcp/30333/p2p/12D3KooWKT4ZHNxXH4icMjdrv7EwWBkfbz5duxE5sdJKKeWFYi5n",
    "/dns/boot.stake.plus/tcp/30334/wss/p2p/12D3KooWKT4ZHNxXH4icMjdrv7EwWBkfbz5duxE5sdJKKeWFYi5n",
    "/dns/boot-node.helikon.io/tcp/7070/p2p/12D3KooWS9ZcvRxyzrSf6p63QfTCWs12nLoNKhGux865crgxVA4H",
    "/dns/boot-node.helikon.io/tcp/7072/wss/p2p/12D3KooWS9ZcvRxyzrSf6p63QfTCWs12nLoNKhGux865crgxVA4H",
    "/dns/polkadot.bootnode.amforc.com/tcp/30333/p2p/12D3KooWAsuCEVCzUVUrtib8W82Yne3jgVGhQZN3hizko5FTnDg3",
    "/dns/polkadot.bootnode.amforc.com/tcp/30334/wss/p2p/12D3KooWAsuCEVCzUVUrtib8W82Yne3jgVGhQZN3hizko5FTnDg3",
    "/dns/polkadot-bootnode.polkadotters.com/tcp/30333/p2p/12D3KooWPAVUgBaBk6n8SztLrMk8ESByncbAfRKUdxY1nygb9zG3",
    "/dns/polkadot-bootnode.polkadotters.com/tcp/30334/wss/p2p/12D3KooWPAVUgBaBk6n8SztLrMk8ESByncbAfRKUdxY1nygb9zG3",
    "/dns/boot-cr.gatotech.network/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w",
    "/dns/boot-cr.gatotech.network/tcp/35100/wss/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w",
    "/dns/boot-polkadot.metaspan.io/tcp/13012/p2p/12D3KooWRjHFApinuqSBjoaDjQHvxwubQSpEVy5hrgC9Smvh92WF",
    "/dns/boot-polkadot.metaspan.io/tcp/13015/ws/p2p/12D3KooWRjHFApinuqSBjoaDjQHvxwubQSpEVy5hrgC9Smvh92WF",
    "/dns/boot-polkadot.metaspan.io/tcp/13016/wss/p2p/12D3KooWRjHFApinuqSBjoaDjQHvxwubQSpEVy5hrgC9Smvh92WF",
    "/dns/polkadot-bootnode.turboflakes.io/tcp/30300/p2p/12D3KooWHJBMZgt7ymAdTRtadPcGXpJw79vBGe8z53r9JMkZW7Ha",
    "/dns/polkadot-bootnode.turboflakes.io/tcp/30400/wss/p2p/12D3KooWHJBMZgt7ymAdTRtadPcGXpJw79vBGe8z53r9JMkZW7Ha",
    "/dns/polkadot-boot-ng.dwellir.com/tcp/443/wss/p2p/12D3KooWFFqjBKoSdQniRpw1Y8W6kkV7takWv1DU2ZMkaA81PYVq",
    "/dns/polkadot-boot-ng.dwellir.com/tcp/30336/p2p/12D3KooWFFqjBKoSdQniRpw1Y8W6kkV7takWv1DU2ZMkaA81PYVq",
    "/dns/polkadot-bootnode.radiumblock.com/tcp/30335/wss/p2p/12D3KooWNwWNRrPrTk4qMah1YszudMjxNw2qag7Kunhw3Ghs9ea5",
    "/dns/polkadot-bootnode.radiumblock.com/tcp/30333/p2p/12D3KooWNwWNRrPrTk4qMah1YszudMjxNw2qag7Kunhw3Ghs9ea5",
    "/dns/dot-bootnode.stakeworld.io/tcp/30310/p2p/12D3KooWAb5MyC1UJiEQJk4Hg4B2Vi3AJdqSUhTGYUqSnEqCFMFg",
    "/dns/dot-bootnode.stakeworld.io/tcp/30311/ws/p2p/12D3KooWAb5MyC1UJiEQJk4Hg4B2Vi3AJdqSUhTGYUqSnEqCFMFg",
    "/dns/dot-bootnode.stakeworld.io/tcp/30312/wss/p2p/12D3KooWAb5MyC1UJiEQJk4Hg4B2Vi3AJdqSUhTGYUqSnEqCFMFg"

ref: https://raw.githubusercontent.com/paritytech/polkadot/master/node/service/chain-specs/polkadot.json

I would suggest that you can make PR with such change

@dimartiro
Copy link
Contributor

dimartiro commented Apr 2, 2024

@EclesioMeloJunior could be this error related with #3709 ? If that's the case I think @jimjbrettj already solved it in #3736

@EclesioMeloJunior
Copy link
Member Author

Oh, okay, then I believe we can close this issue tho @dimartiro

@EclesioMeloJunior
Copy link
Member Author

Closed due #3736

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants