This is a mental health game application built with MERN stack and using Machine learning models - BART and Stable Diffusion-Xl. The application allows users to play games using pictures, and based on the response times for each question, therapists can gain insights into the patient's mental state.
- Play mental health games using pictures. Similar to Pictionary.
- Pictures for pictionary game are generated using Stable Diffusion-XL on the go.
- Therapist are allowed to add new questions, and their respected scores.
- Track response times for each question.
- Therapists can gain insights into the patient's mental state based on response times.
- Therapist will be provided with the summary and visualization of all the parameters from the Pictionary Game
- We have classified the patients status it based on the parameters and behavioural patterns as stated by WHO.
-
Node.js
-
React
-
Express.js
-
MongoDB (optional, for storing user data and game results)
-
Machine Learning Model - BART, Stable Diffusion-XL.
-
BART is a transformer encoder-encoder (seq2seq) model with a bidirectional (BERT-like) encoder and an autoregressive (GPT-like) decoder. BART is pre-trained by (1) corrupting text with an arbitrary noising function, and (2) learning a model to reconstruct the original text. BART is particularly effective when fine-tuned for text generation (e.g. summarization, translation) but also works well for comprehension tasks (e.g. text classification, question answering). This particular checkpoint has been fine-tuned on CNN Daily Mail, a large collection of text-summary pairs.
BART -> https://huggingface.co/facebook/bart-large-cnn
-
Clone the repository:
git clone https://github.com/your-username/TherapEase.ai.git
-
Navigate to the project directory:
cd TherapEase.ai
-
Install dependencies for the server:
npm install
-
Navigate to the client directory:
cd frontend
-
Install dependencies for the client:
npm install
-
Start the server:
cd backend node index.js
-
Start the client:
cd frontend npm start
-
Open your browser and navigate to
http://localhost:3000
to access the application. -
Play mental health game, the rest is taken care by our backend and summary is viewed in doctors/therapist view window.