Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove temp files #449

Merged
merged 6 commits into from
Nov 19, 2020
Merged

Remove temp files #449

merged 6 commits into from
Nov 19, 2020

Conversation

hannahhoward
Copy link
Collaborator

Do not generate temporary files for pieces in normal workflow

@hannahhoward
Copy link
Collaborator Author

I believe the test failure on ClientDealAccepted is real, most likely due to some reduced resumability for the code in the HandoffDeal function. I suspect that the problem has to do deleting the blockstore twice. (the blockstore now needs to hang around through on deal handed off? Not sure)

@dirkmc
Copy link
Contributor

dirkmc commented Nov 18, 2020

@hannahhoward I moved deletion of the deal store to CleanupDeal() (where the piece path and metadata path are cleaned up) and this fixed the test failures in TestRestartClient/ClientEventDealAccepted.
I believe it makes sense for deal store deletion to happen there because the client may want to retrieve the data before it's been sealed, right?

I'm wondering if we should also clean up temporary files / datastore storage if there's any failure during the deal?

Edit: We do already clean up temp files / datastore storage if there's a failure

@hannahhoward hannahhoward marked this pull request as ready for review November 19, 2020 03:28
@codecov-io
Copy link

codecov-io commented Nov 19, 2020

Codecov Report

Merging #449 (47cd348) into master (8203454) will increase coverage by 0.04%.
The diff coverage is 80.89%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #449      +/-   ##
==========================================
+ Coverage   65.16%   65.20%   +0.04%     
==========================================
  Files          47       47              
  Lines        3140     3229      +89     
==========================================
+ Hits         2046     2105      +59     
- Misses        861      880      +19     
- Partials      233      244      +11     
Impacted Files Coverage Δ
storagemarket/impl/provider_environments.go 2.13% <0.00%> (-0.04%) ⬇️
pieceio/pieceio.go 68.30% <83.34%> (-0.45%) ⬇️
...oragemarket/impl/providerstates/provider_states.go 83.53% <85.37%> (-0.35%) ⬇️
storagemarket/impl/provider.go 27.93% <100.00%> (ø)
storagemarket/impl/providerstates/provider_fsm.go 71.82% <100.00%> (-2.94%) ⬇️
storagemarket/impl/providerutils/providerutils.go 95.13% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8203454...47cd348. Read the comment docs.

Update go-car to a version that is closer to master, with selective car changes in master itself
Copy link
Contributor

@dirkmc dirkmc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@dirkmc dirkmc merged commit 134f19a into master Nov 19, 2020
@dirkmc dirkmc deleted the feat/no-temp-files branch November 19, 2020 08:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants