-
-
Notifications
You must be signed in to change notification settings - Fork 163
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve Search performance by introducing per-tag index hashes #555
Comments
title sorting is optimized thanks to the title sorted set, other namespaces less so.
Some notes on the search rewrite that's currently landing (wow, it's been more than a year...):
The new system makes heavy use of Redis sets and sorted sets, which are all lodged in a separate, third database. |
Additional comment: Search now requires the index tables to be built (does so on app start, and then updates them as tags/titles/etc are modified), so large instances might take a few mins to get a usable search again after updating. I haven't added a visual warning for this, but it'd certainly be a possibility. |
I don't think search can get faster than it currently is if we keep looking at every file each time.
The most simple solution imo is to build index tables for each namespace: The structure for this already exists in the stats minion job, it's mostly a matter of extending it so that Search can rely on those stat tables as well.
In case the stat tables aren't built (first searches), we'll probably have to fallback on the existing look-in-every-redis-key algorithm.
The text was updated successfully, but these errors were encountered: