Next.js app that finds deleted tweets that have been archived by the wayback machine
Getting Started · Stack · ToDo · FAQ
- Install Node.js and npm
git clone https://github.com/kulgg/tweetfisher.git
cd tweetfisher
npm install
Before running: Copy .env.example to .env.local
npm run dev
- Framework: Next.js
- Styling: Tailwind CSS
- State management: jotai
- UI Components:: shadcn
- Add export functionality
- Parse quote tweets
- Adaptive throttling
Initially, I wanted to perform all requests on the client-side to avoid throttling problems and allow for easy hosting for users. However, I soon realized that this was not possible. Both archive.org and twitter.com do not set the required CORS headers, making it impossible to access response contents from the frontend code, even when using the 'no-cors' mode for requests. Furthermore, the HTTP HEAD requests to twitter.com that check for deleted tweets must imitate search engine headers to function properly, but this cannot be done in frontend requests as the browser adds additional headers.
As a solution, all requests have been wrapped by Next.js API routes. Unfortunately, this makes it difficult to host this app for widespread use due to throttling constraints.