Index of indexes

[tacman]

Congrats on the release of version 16!

Now that embeders and other AI tools are available, it's becoming even more important to have a better search tool for the indexes. That search tool, of course, should be a special index in meili that is kept in sync as much as possible with the actual indexes.

For example, I was trying to find a list of what indexes where I have embedders. I don't think the API currently supports that kind of query. But rather than request it get added to the API, I'd like to simply query a special, readonly index (maybe __ or _indexes) that is a json blob of

• Everything in settings
• document counts
• pending tasks

Of course, I'd like the facets to be everything that makes sense from the meili index. (In fact, I'd like a few more, like the ability to add custom tags, like locale, project, type).

I'm struggling to manage the sheer number of indexes I have in meilisearch. Most of them are rarely used, so I haven't really had issues with memory, but number is about to get even bigger because I've found it too complicated to maintain a multi-lingual single index and so now need numberOfLanguages x numberOfCollections indexes.

Meilisearch can return 1000 small documents in a flash, even 10,000. But getting information like "give me a list of all collections where "locale" is a facet" is very time-consuming through the API. The Feature Request makes accessing this information faster and easier for the developer.

One idea is to embed a ->addDocuments() to whereever the code is for the callback (WEBHOOK), as I believe it may be the same data.

Thanks for your consideration.