Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch size #18

Open
akircher opened this issue Aug 24, 2018 · 0 comments
Open

Batch size #18

akircher opened this issue Aug 24, 2018 · 0 comments

Comments

@akircher
Copy link

First thank you for the incredible tool. I wouldn't have switched from MYSQL to CouchDB without it.

I think there is an issue with batch size and clearing out the queue. I had many tasks that were working, but one task that called util.save(doc) but the docs would no update and no error was thrown. After checking all the logs (nothing), I poked around the source code.

I finally fixed this issue using the flag -b 1. I think the number of documents with changes never reached the batch size and so were never saved. Ideally couchtato would save everything in the queue periodically or at least at the end of the job. Alternatively, you could log a useful error on the cli that says that some documents were not saved and that you should rerun that task with a smaller batch size.

Thanks for your consideration
Adam

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant