Marvin's use of content via Loaders

[thebwt]

Hey folks 👋

First off this library is outstanding.

I'm trying to wrap my head around some of the advanced usage in loaders at the moment. I've managed to write a loader that loads raw .txt files into the chromadb. But I'm unsure of how or if Marvin is even using it. The loaded data doesn't seem to expose itself as a plugin or anything. I see we made a bunch of calls to ada, and ostensibly stored that in our local chromadb. But... now what?

Turning on debug mode and running queries along what the loaded data is about doesn't seem to give much clarity.

I don't wanna assume it just magically consults the chromadb does magic.

[zzstoatzz]

hi @thebwt - apologies that I'm just seeing this.

If this is still helpful, the way you can have a Bot fetch information in chroma is via the chroma_search plugin, which is just using our marvin.infra.chroma.Chroma client wrapper to KNN query the default chroma collection and stuffing it in the Bot's list[Message] for that Thread

so yeah I'd say the best way to experiment is to pare down the plugins on a Bot and ask specific questions about what you know to be embedded into chroma and watch the DEBUG logs and make sure the Bot is fetching those documents