Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error: Negative jobs completed for zinnia #583

Closed
sentry-io bot opened this issue Aug 27, 2024 · 1 comment · Fixed by CheckerNetwork/zinnia#593
Closed

Error: Negative jobs completed for zinnia #583

sentry-io bot opened this issue Aug 27, 2024 · 1 comment · Fixed by CheckerNetwork/zinnia#593
Labels
bug Something isn't working

Comments

@sentry-io
Copy link

sentry-io bot commented Aug 27, 2024

Sentry Issue: STATION-CORE-C9G

Error: Negative jobs completed for zinnia
  File "/usr/local/lib/node_modules/@filecoin-station/core/lib/metrics.js", line 55, in Metrics.submit
    new Error(`Negative jobs completed for ${moduleName}`)
  File "/usr/local/lib/node_modules/@filecoin-station/core/commands/station.js", line 132, in onMetrics
    onMetrics: m => metrics.submit('zinnia', m)
  File "/usr/local/lib/node_modules/@filecoin-station/core/lib/zinnia.js", line 387, in handleEvents
    onMetrics({ totalJobsCompleted })
  File "/usr/local/lib/node_modules/@filecoin-station/core/lib/zinnia.js", line 282, in Socket.?
    handleEvents({
  File "node:events", line 531, in Socket.emit
...
(5 additional frame(s) were not displayed)
@sentry-io sentry-io bot added the bug Something isn't working label Aug 27, 2024
@bajtos
Copy link
Member

bajtos commented Aug 27, 2024

From the console log:

[2024-08-27T07:29:47Z INFO  module:spark/main] Measurement submitted (id: 7318579854)
thread 'main' panicked at daemon/station_reporter.rs:151:14:
called `Result::unwrap()` on an `Err` value: Cannot write state to /app/state/modules/zinnia/state.json

Caused by:
    No space left on device (os error 28) at path "/app/state/modules/zinnia/.atomicwriteGGettF"
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
fatal runtime error: failed to initiate panic, error 5

We suspect Zinnia reports 0 job count when it cannot find or update the state file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant