Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stuck Node #2365

Closed
Wondertan opened this issue Jun 13, 2023 · 4 comments
Closed

Stuck Node #2365

Wondertan opened this issue Jun 13, 2023 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@Wondertan
Copy link
Member

I got personal FN stuck. From the DASer's state, it's somehow got all the jobs overfilled with recent ones, which are not in the error state.
This reminds me of #2314, but I am running 0.10.4 on BSR, which includes this fix

{
  "jsonrpc": "2.0",
  "result": {
    "head_of_sampled_chain": 721774,
    "head_of_catchup": 721786,
    "network_head_height": 721923,
    "workers": [
      {
        "job_type": "recent",
        "current": 721785,
        "from": 721785,
        "to": 721785
      },
      {
        "job_type": "recent",
        "current": 721781,
        "from": 721781,
        "to": 721781
      },
      {
        "job_type": "recent",
        "current": 721775,
        "from": 721775,
        "to": 721775
      },
      {
        "job_type": "recent",
        "current": 721777,
        "from": 721777,
        "to": 721777
      },
      {
        "job_type": "recent",
        "current": 721779,
        "from": 721779,
        "to": 721779
      },
      {
        "job_type": "recent",
        "current": 721780,
        "from": 721780,
        "to": 721780
      },
      {
        "job_type": "recent",
        "current": 721782,
        "from": 721782,
        "to": 721782
      },
      {
        "job_type": "recent",
        "current": 721784,
        "from": 721784,
        "to": 721784
      },
      {
        "job_type": "recent",
        "current": 721776,
        "from": 721776,
        "to": 721776
      },
      {
        "job_type": "recent",
        "current": 721778,
        "from": 721778,
        "to": 721778
      },
      {
        "job_type": "recent",
        "current": 721783,
        "from": 721783,
        "to": 721783
      },
      {
        "job_type": "recent",
        "current": 721786,
        "from": 721786,
        "to": 721786
      }
    ],
    "concurrency": 12,
    "catch_up_done": false,
    "is_running": true
  },
  "id": 1
}
``
@Wondertan Wondertan added the bug Something isn't working label Jun 13, 2023
@Wondertan
Copy link
Member Author

I am not restarting the node yet, so if any further info is needed i can quickly share.

Also, this happened several times to me, but I only just realized that seeing only new head logs is wrong and there should sampled header as well

@renaynay
Copy link
Member

is this dup of #2351

@Wondertan
Copy link
Member Author

Wondertan commented Jun 15, 2023

Don't think so, symptoms in DAS state are completely different. It may be the same issue, but with current info we have, they are diff.

@Wondertan
Copy link
Member Author

Havent seen for a while

@Wondertan Wondertan closed this as not planned Won't fix, can't repro, duplicate, stale Feb 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants