Skip to content
This repository has been archived by the owner on Mar 2, 2020. It is now read-only.

irmowan/Weibo-Emotions

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

61 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Weibo-Emotions

GitHub website: Weibo-Emotions

This is a course project of Big Data Analysis.

Tools & Environment

Spark, Python

Files

  • /data sample data of the project
  • /preprocess preprocess of data
  • /applications some applications
  • /utilities some utilities, including collect data from HDFS
  • /result result text files and charts

Slides

Slides are now available on Google Drive, Link

Report

The details of the project could be found in report, which is written by LaTeX. Here is the pdf version of report: Report.

Sample Results

  • Charts

Emotion - Time

Emotion distribution of men

  • Polar Dictionary
word   weight(1 - most positive, 0 - most negative)

开心   0.880197
新婚   0.876024
堵车   0.322985
骗     0.396330
MLGB   0.335030
小宝宝 0.727744

More could be found in the folder of result, and in report.

Author

irmowan

Orthocenter

xuyong

About

Using Spark to analyse weibo emotions

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published