A script to create a database of posts compatible with the mstdn-ebooks or pleroma-ebooks -based markov bots, that supports instances using secure/authorised fetch.
Rather than using ActivityPub outboxes and pretending to be an instance, which authorised fetch breaks, this script relies on the bot's instance's API to fetch copies of posts.
Disadvantages:
- Currently requires the bot's instance to support the Mastodon API (This still covers Mastodon & forks, Akkoma, Pleroma, Iceshrimp, Sharkey, Firefish, and probably more)
- Can only fetch posts that have already reached the bot's instance
Written as instances with authorised fetch enabled seem to be more and more common (good!), and also to look at some of the differnces between Node.js and Bun