Text clustering in spark with scala using LDA Model on a TF-IDF matrix
-
Updated
Jan 17, 2022 - Scala
Text clustering in spark with scala using LDA Model on a TF-IDF matrix
😅 A topic model of reddit.com/r/EmojiPasta trained with Spark and an LDA model (NSFW) - Trigger Warning: The r/emojipasta subreddit posts controversial content and anything I have crawled is to provide visibility of a topic modeling some of this controversial content. Unfortunately there is also discriminatory speech which must be called out!
Add a description, image, and links to the lda-model topic page so that developers can more easily learn about it.
To associate your repository with the lda-model topic, visit your repo's landing page and select "manage topics."