Skip to content

[2024 Google Solution Challenge Global Top 100] COM-MA 어린이 코다를 위한 AI 카메라 기반 수화 학습 교육 서비스

Notifications You must be signed in to change notification settings

COM-MA/COM-MA-SERVER

Repository files navigation

' COM-MA '
AI Camera-Based Sign Language Education Platform for CODA

2nd submission [https://www.youtube.com/watch?v=WfFZMll-lgc]
1st submission [https://youtu.be/9KRVqarybjo] Slide 16_9 - 4

📍Table of Contents


💟 Backend Member

TEAM 👨‍👦‍👦 Name 👩‍💻 Major 🖥 Contact mail 📧
Green Hayeon Song Computer Science hysong4u@gmail.com

💟 Background

In South Korea, a significant portion of the 400,000 registered deaf individuals are married, and the majority of their children, known as CODAs (Children of Deaf Adults), are hearing.

Challenges faced by CODAs
CODAs face challenges such as identity confusion in navigating a mixed cultural and linguistic environment, and they often bear the burden of facilitating communication between the deaf and hearing communities.


The Need for CODA to Learn Sign Language
Recognizing the importance of effective communication, there is a need for CODAs to learn sign language actively. Learning sign language fosters communication with their deaf parents, reducing difficulties and preventing emotional isolation. Adequate interaction with parents during early childhood is crucial for the linguistic and emotional development of CODAs.


💟 Project Overview

'Connect the Silent World and the World of Sounds'

COM-MA is an "AI camera-based sign language learning education platform" that helps deaf parents teach sign language directly to their children, CODAs (Children of Deaf Adults).

The COM-MA Lens recognizes sign language and quickly converts it into learning materials for deaf parents. It offers these parents the opportunity to engage in sign language education with their children in everyday life.


💟 UN SDG GOALS


image

✨ 1. Quality education ([4] among Sustainable Development Goals)

We are focusing on quality education among the UN's sustainable development goals. This goal is to provide comprehensive and fair educational opportunities for all individuals and to expand opportunities for lifelong learning.

To respond to the educational challenges faced by Coda, we want to provide a better educational environment for Coda. Our solution supports personalized learning in consideration of linguistic and cultural diversity, and provides the opportunity to open up a better future through continuous lifelong learning.


image

✨ 2. Reduced inequalities ([10] among Sustainable Development Goals)

The goal of Reduced inequalities is to reduce inequality at home and abroad and allow everyone to enjoy equal opportunities.

Our solutions contribute to overcoming the linguistic and cultural gaps that Koda is experiencing, and provide Coda with <b?opportunities to address social inequality. Through this, we want to support Coda's future to brighten up, and help address social inequality.

💟 Key Features

System Architecture

📸 COM-MA Lens

AI-based camera recognizes sign language and provides images, text, and voice.


🔎 Word search function

When a user searches for a desired word, words listed in the 'Korean Sign Language Dictionary' are imported, the meaning of the word, sign language actions, and image information are provided, and a personalized word card can be created.


🏷️ Word Cards

Cards for learning sign language, text, and voice for each word.


💡 Quizzes

Create quizzes directly from saved word cards for educational use.


🟣 Daily Mission Stickers

Motivate users with one-day mission stickers such as word registration, quiz participation, and fairy tale viewing.


😎 Today’s mood sharing function

It provides a function that allows parents and children to express each other's emotions with emoticons. This can strengthen the emotional connection between parents and children.


📚 Storybooks

Easily watch and educate with subtitles or sign language provided in storybooks.


스크린샷 2024-05-06 오전 4 39 54 스크린샷 2024-05-06 오전 4 35 52 스크린샷 2024-05-06 오전 4 36 29

💟 How to Run

# 1. Clone the project
git clone https://github.com/COM-MA/COM-MA-SERVER.git

# 2. Create the configuration file
vim COM-MA-SERVER/src/main/resources/application.yml

# 3. Build (execute at the project's root)
./gradlew build -x test

# 4. Navigate to build/libs directory
cd COM-MA-SERVER/build/libs/

# 5. Run the JAR file
java -jar comma-0.0.1-SNAPSHOT.jar

💟 Tech Stack

🖥 Backend Server

Role Type
Framework Spring Boot
Language Java
Build Tool Gradle
Database & Database Service MySQL Amazon RDS
Cloud Server & Cloud Storage Amazon S3 Amazon EC2
Google API Oauth 2.0 API Youtube DATA API V3
Web Server Nginx

💟 System Architecture

📂 Folder Structure

📂 src
┣ 📂 java.com.example.comma
┃  ┣ 📂 domain
┃  ┃  ┣ 📂 sample
┃  ┃  ┃  ┣ 📂 controller
┃  ┃  ┃  ┣ 📂 entity
┃  ┃  ┃  ┣ 📂 dto
┃  ┃  ┃  ┃  ┣ 📂 request
┃  ┃  ┃  ┃  ┣ 📂 response
┃  ┃  ┃  ┣ 📂 service
┃  ┃  ┃  ┣ 📂 domain
┃  ┃  ┃  ┣ 📂 repository
┃  ┣ 📂 global
┃  ┃  ┣ 📂 common
┃  ┃  ┣ 📂 config
┃  ┃  ┃  ┣ 📂 auth
┃  ┃  ┣ 📂 error
┃  ┃  ┃  ┣ 📂 dto
┃  ┃  ┃  ┣ 📂 exception
┃  ┃  ┃  ┣ 📂 handler
┣ 📂 resources
┃  ┣ application.yml
┣ CommaApplication.class


⚙️ Architecture Structure

KakaoTalk_Photo_2024-05-06-03-47-15


📋 ERD

스크린샷 2024-02-21 오후 11 38 05

💟 Commit Convention

  • ➕ [ADD] : Additional code or library, creation of new files excluding FEAT
  • ✅ [MOD] : Code modification, internal file modification
  • ✨ [FEAT] : Implementation of a new feature
  • 🎗️ [UI] : UI work
  • 🔀 [MERGE] : When merging different branches
  • 🔨 [FIX] : Bug fixes and error resolution
  • 🗑️ [DEL] : Removal of unnecessary code or files
  • 📝 [DOCS] : Revision of README, WIKI, or other documentation
  • ✏️ [CORRECT] : Small corrections such as grammar errors, type changes, or name changes
  • 📦 [CHORE] : Changes in package structure, movement of files or code within the project
  • ⏪️ [RENAME] : File renaming
  • ♻️ [REFACTOR] : Major code refactoring
  • 🛠 [SETTING] : Other configuration changes

About

[2024 Google Solution Challenge Global Top 100] COM-MA 어린이 코다를 위한 AI 카메라 기반 수화 학습 교육 서비스

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published