Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reverse names for S3 sort #2

Merged
merged 2 commits into from
Feb 9, 2024
Merged

Conversation

rrmckinley
Copy link
Contributor

Use base 36 filenames, reverse names for S3 sort

Fyi, this does not seek to fix likely pagination problems with delete

@LoneRifle LoneRifle linked an issue Feb 3, 2023 that may be closed by this pull request
Copy link
Owner

@LoneRifle LoneRifle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one question to answer

src/s3vfs.ts Outdated Show resolved Hide resolved
@LoneRifle LoneRifle force-pushed the base36-filenames branch 2 times, most recently from e639b2d to f7ed1ca Compare February 3, 2023 02:00
Copy link
Owner

@LoneRifle LoneRifle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unit tests are broken due to Babel transforming the BigInt exponentiation operator to Math.pow, which is incompatible with most BigInt implementations in Node. Consider either avoiding BigInts altogether, or somehow reworking babel.config.cjs so that it knows to avoid the use of the offending Babel plugin.

@rrmckinley
Copy link
Contributor Author

unit tests are broken due to Babel transforming the BigInt exponentiation operator to Math.pow

Thanks, I'll run the tests and work through that

@rrmckinley
Copy link
Contributor Author

I removed base 36 usage to focus only on correct behavior for the filename reversal. I have not yet run tests. I see that it uses docker and I'll test that when I have time to configure that setup. I'll let you know when I'm able to run tests.

@rrmckinley rrmckinley changed the title Use base 36 filenames, reverse names for S3 sort Reverse names for S3 sort Feb 14, 2023
Copy link
Owner

@LoneRifle LoneRifle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm - I'll merge this at a later point

@LoneRifle LoneRifle merged commit db1cd1e into LoneRifle:main Feb 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

SQLITE_CORRUPT After 100,000 Inserts
2 participants