Skip to content

An Angular Web Application leveraging ChatGPT and Google's API to create a voice-controlled virtual assistant

Notifications You must be signed in to change notification settings

Russolves/Personal-Assistant-AI-Friday

Repository files navigation

Friday: Accessibility-focused Application Empowering Inclusive Interactions

Friday is a full-stack Angular web application designed with a primary focus on empowering individuals with disabilities. Drawing inspiration from the iconic AI assistant in the Marvel Cinematic Universe, the platform offers a solution that transcends language barriers. By integrating Google Cloud Services and ChatGPT's API, Friday delivers a user journey marked by inclusive, AI-driven voice interactions.

One of Friday's standout features is its multilingual capability, accommodating both Mandarin and English speakers. Users have the flexibility to activate the virtual assistant using trigger words and phrases in either language, making it a universally accessible tool.

In addition to its multilingual prowess, Friday introduces a detailed level of personalization. Users can fine-tune their virtual assistant's responses by adjusting parameters such as voice pitch, speed, voice type, and even language. This level of customization ensures that the assistant's interactions align with users' preferences and needs.

Key Features

1. Voice-Controlled Accessibility

Friday's core innovation lies in its voice-controlled accessibility, enabling individuals with physical impairments to interact with the application. Through the integration of Google Cloud Services and ChatGPT's API, users can navigate and communicate within the application using natural language and voice commands.

2. Robust Server-Side Architecture

At the heart of Friday is a robust server-side architecture, powered by Node.js and Express.js. My engineered server-side APIs optimize data flow, response times, and overall backend efficiency. This ensures that users experience a seamless and responsive interaction with the application, irrespective of their abilities.

3. Inclusivity as the Driving Force

Friday is not just another web application; it's a commitment to inclusivity. As a graduate Biomedical Engineering student, my mission is to break down technological barriers for physically impaired individuals, expanding user engagement and promoting accessibility. By championing accessibility, Friday empowers a broader audience to harness the power of AI-driven voice interactions.

How It Works

Voice Commands: Users can activate Friday's voice interaction feature by simply speaking a trigger word or phrase, this works in both English and Mandarin, initiating the application's listening mode.

Natural Language Processing: Friday leverages ChatGPT's powerful natural language processing capabilities to understand and interpret voice commands and queries.

Speech-to-Text & Text-to-Speech: With the integration of Google Cloud Services, Friday converts voice inputs into text and provides text-based responses as speech, making it a two-way communication channel.

Customization: Users will be able to customize their own virtual assistant in both Chinese and English. Down to the virtual assistant's pitch, speed and type of voice. Users also have the opportunity to input personal details about themselves, allowing for more tailored responses and increasing customization capacity for the virtual assistant.

Intuitive Navigation: Users can use voice commands to navigate through the application, browse content, submit queries, and interact with various features seamlessly.

Enhanced Accessibility: Friday's architecture ensures that individuals with disabilities can enjoy an accessible and inclusive online experience. The platform's voice-driven approach eliminates the need for manual inputs, making it particularly suitable for those with limited mobility.

Efficient Backend: Behind the scenes, the Node.js and Express.js backend processes and routes voice inputs and queries efficiently, delivering rapid responses to enhance the user experience.

About

An Angular Web Application leveraging ChatGPT and Google's API to create a voice-controlled virtual assistant

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published