Use Snapchat on any device with SMS!!

This project utilizes GPT-4V to generate function calls for reading and writing Snapchat messages via Selenium and the Snapchat web interface.

Setup

1. Install the required dependencies by running pip install -r requirements.txt.
2. Set up a Twilio phone number and configure it to send incoming SMS messages to the server. (set numbers 'message comes in' webhook to your ngrok url + /sms)
3. Set up the necessary environment variables by creating a .env file and adding your OpenAI API, Twilio, and ngrok credentials.
4. Change path in browser_actions.py to the path of your chrome profile that has the Snapchat account logged in.
5. Install Stylebot extension and edit web.snapchat.com to include styles from stylebot.css

Usage

1. Start the Flask server by running python main.py. Expose the server to the internet using a service like ngrok.
2. Send SMS messages to the server to trigger the GPT-4V assistant.
3. The assistant will analyze the user query and image analysis of their device to determine the next step.
4. The assistant will generate function calls based on the analysis and respond with the recommended action.

Code Structure

• main.py: Contains the Flask server implementation and the main logic for processing SMS messages and interacting with the GPT-4V assistant.
• browser_actions.py: Provides functions for interacting with the Snapchat web interface using Selenium.
• overlay.py: Handles overlaying chat positions on screenshots.
• decision_prompt.txt: Contains instructions for the assistant on how to choose the correct function to call based on user descriptions.
• vision_prompt.txt: Provides guidance for the assistant on how to summarize chat messages and extract useful information.
• stylebot.css: Contains custom CSS styles for the Snapchat web interface to improve readability for the assistant.

Security

• OpenAI will have access to screenshots of your Snapchat messages but will not train on them as they are sent through the API.
• The assistant has the ability to read and send messages on your behalf, so be careful with how you prompt it and in which situations you use it. It's possible for the script to send chats to the wrong contact, or to send chats without your permission or knowledge. Use at your own risk!