YouTube Data Harvesting and Warehousing

Overview

This project is designed to harvest data from YouTube using the YouTube Data API, display it using Streamlit, and store it in a SQL database. It fetches information about channels, videos, and comments and provides a user-friendly interface to interact with the data.

Demo Video: https://www.youtube.com/watch?v=ey68F18bmFU

Features

• Fetch data from YouTube using the YouTube Data API v3.
• Display fetched data in a Streamlit application.
• Store fetched data in a SQL database.
• Options to extract, transform, and load (ETL) data.
• Retrieve details about channels, videos, and comments.
• View and analyze video statistics, comments, and engagement metrics.

Technologies Used

• Python
• Streamlit
• YouTube Data API v3
• SQL

Installation

1. Clone this repository to your local machine.
2. Install the required dependencies by running pip install -r requirements.txt.
3. Set up API keys for YouTube Data API (if you haven't already) and configure them in the project.
4. Set up a SQL database and configure the connection details in the project.

Usage

1. Run the Streamlit application using streamlit run app.py.
2. Use the interface to fetch and display YouTube data.
3. Optionally, choose to store the fetched data in the SQL database.

Please find attached ppt file for detailed explanation.