cmpt732-yelp-analysis

CMPT732 Yelp Analysis Project

Installation

The scripts need to run on our gateway to access Spark/Cassandra cluster
Step 1: Create Cassandra tables: make create_schema -f Makefile.production
Step 2: Copy data from AWS S3 to Hadoop HDFS: make prepare_data -f Makefile.production
Step 3: Load Yelp data from Hadoop HDFS to Cassandra tables: make load_data -f Makefile.production
Step 4: Do all analysis: make run_analyze -f Makefile.production
Step 5: Store results to Postgres DB: make store_data -f Makefile.production

Name		Name	Last commit message	Last commit date
Latest commit History 17 Commits
cql		cql
model		model
presentation		presentation
report		report
script		script
Makefile		Makefile
Makefile.production		Makefile.production
README.md		README.md
RUNNING.md		RUNNING.md
TestBusinessCategories.csv		TestBusinessCategories.csv
comment_analysis.cql		comment_analysis.cql
comment_analysis.py		comment_analysis.py
docker-compose.yml		docker-compose.yml
hi.txt		hi.txt
regression.py		regression.py
requirements.txt		requirements.txt
yelp-analysis.txt		yelp-analysis.txt