Update documents by filter

[MrAtiebatie]

It would be great to be able to update multiple documents based on a filter. Especially when you're using distinctAttribute it would be nice to update all documents with product_id = 2. Now I have to save all the document primary keys separately and update them individually.

[irevoire]

Hello @MrAtiebatie,

What kind of operation would you like to do on your documents?
Could you share some kind of API?

[flevi29]

I'm also noticing that a simple boolean value switch of 74000 documents is taking quite a lot of time and resources. I'm sure the situation described above doesn't help, but this is possibly another topic.

[irevoire]

Huum, ok, interesting.

So, you only need to update all the values to a single value.
You never need to update the values based on a function or something?
Like, don’t you want to increment the popularity of your documents by one, or update the price of something based on an HTTP call?

I’m just trying to think of how general our solution should be 🤔

I'm also noticing that a simple boolean value switch of 74000 documents is taking quite a lot of time and resources.

We worked on this a lot this sprint and hope it’ll be fixed for the next release 🤞
It should at least improve a lot.

[flevi29]

I, for one, only need to update all documents matching a filter, and update them all with the same value. Much like how typesense update by query works, if I understand it correctly. I am sure someone out there might want more advanced features, but this seems the simplest case scenario.

[MrAtiebatie]

I have more than 200k documents so it's not a very nice solution. I don't understand how this feature is implemented for deletion but not for updating. Would love to have this :-)

[flevi29]

It's a lot simpler I assume when it comes to deletion. Not being able to do this by query is one thing I am willing to let go, but there's a far bigger performance issue, that Meilisearch is aware of and they're working on it: (go and upvote it) meilisearch/meilisearch#4071

Currently my server is stalling, and Meilisearch is timing out, with 30 minutes of time out. None of my procedures complete successfully because of this. What was meant to be a very efficient way of keeping track of what to delete became a major bottle neck once I switched to Meilisearch.