Skip to content

😅 A topic model of reddit.com/r/EmojiPasta trained with Spark and an LDA model (NSFW) - Trigger Warning: The r/emojipasta subreddit posts controversial content and anything I have crawled is to provide visibility of a topic modeling some of this controversial content. Unfortunately there is also discriminatory speech which must be called out!

License

Notifications You must be signed in to change notification settings

joyoyoyoyoyo/emojipasta-topic-modeling

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

EmojiClusterAnalysis

Version = 0.2

LDA Results

Number of Iterations = 100 Finished training LDA model.

LDA Results with 50 topics and 20 max terms

Topic 1

Term Weight
got 0.0119146
just 0.0113571
so 0.0111730
ass 0.0107972
know 0.0085145
i'm 0.0083978
don't 0.0083047
dick 0.0075852
😐 0.0073786
if 0.0060738
feel 0.0059399
nigga 0.0056480
makes 0.0054674
put 0.0044628
😢 0.0043467
ya 0.0042782
i've 0.0042587
how 0.0042444
real 0.0040592
help 0.0036697
-------- --------

Topic 2

Term Weight
u 0.0290322
ur 0.0125547
get 0.0093582
fucking 0.0065129
if 0.0047408
0.0045736
day 0.0042242
dat 0.0036287
god 0.0029269
da 0.0027028
year 0.0026377
new 0.0025306
💦 0.0024396
🍆 0.0024159
😏 0.0023106
hoes 0.0022674
🙌 0.0021954
n 0.0021165
damn 0.0020945
night 0.0020718
-------- --------

Topic 3

Term Weight
you're 0.0090687
get 0.0086120
what 0.0067470
it's 0.0067151
e 0.0066337
send 0.0060299
am 0.0056422
i'm 0.0049375
gonna 0.0040527
now 0.0036641
oh 0.0035337
n 0.0034838
happy 0.0034773
ready 0.0033329
every 0.0031795
god 0.0031565
know 0.0030386
stayin' 0.0029662
time 0.0029636
skinner👨 0.0029620
-------- --------

Topic 4

Term Weight
so 0.0338434
right 0.0328482
💯 0.0263228
thats 0.0234001
shit 0.0219140
👀 0.0214349
what 0.0189644
im 0.0173595
do 0.0165343
(chorus 0.0134667
👌 0.0122096
talking 0.0119049
ʳᶦᵍʰᵗ 0.0111562
ᵗʰᵉʳᵉ) 0.0111558
👌👌 0.0096478
ƽaү 0.0089133
if 0.0086296
good 0.0081911
get 0.0076807
0.0073437
-------- --------

Topic 5

Term Weight
get 0.0289886
back 0.0283487
if 0.0169905
complete 0.0091011
send 0.0089200
never 0.0084154
little 0.0082442
5 0.0053155
again 0.0048929
daddy 0.0048115
just 0.0048018
only 0.0045669
give 0.0045149
you're 0.0044937
fucking 0.0042064
make 0.0041871
more 0.0041161
am 0.0039758
you’re 0.0039356
good 0.0038518
-------- --------

LDA Results with 10 topics and 20 max terms

Topic 1

Term Weight
little 0.0208177
fucking 0.0137161
am 0.0129836
just 0.0108079
more 0.0092564
2 0.0081748
again 0.0078695
class="emojiinput 0.0073129
now 0.0071332
only 0.0070128
you’re 0.0069078
here 0.0064923
call 0.0062174
want 0.0059603
u 0.0058648
fuck 0.0056452
if 0.0055312
random 0.0052172
im 0.0051749
💀 0.0049485
-------- --------

Topic 2

Term Weight
so 0.0551584
right 0.0504195
💯 0.0425053
thats 0.0395492
shit 0.0342292
👀 0.0332878
what 0.0282756
do 0.0262445
im 0.0256718
(chorus 0.0216532
👌 0.0189597
talking 0.0185685
ᵗʰᵉʳᵉ) 0.0173624
ʳᶦᵍʰᵗ 0.0171085
👌👌 0.0144799
ƽaү 0.0139567
0.0129085
self 0.0125743
🎃 0.0104517
right✔there 0.0098314
-------- --------

Topic 3

Term Weight
yhu 0.0097553
fucking 0.0092506
want 0.0082679
i'm 0.0058171
real 0.0052429
🇨🇦 0.0050944
u 0.0050130
😘 0.0047022
very 0.0044634
get 0.0043656
damn 0.0043033
show 0.0042890
even 0.0042505
so 0.0040314
always 0.0039322
only 0.0037907
n 0.0037702
man 0.0036653
don't 0.0036372
gay 0.0035244
-------- --------

Topic 4

Term Weight
daddy 0.0158644
make 0.0146265
get 0.0073315
oh 0.0065730
help 0.0065464
skinner👨 0.0059703
🔨 0.0053413
send 0.0053402
build 0.0053078
chalmers👴 0.0047845
🙋 0.0044183
that's 0.0040988
friends 0.0040749
trump 0.0038819
cause 0.0036240
0.0034571
can't 0.0034349
somebody 0.0033975
happy 0.0033872
me😭😱 0.0032914
-------- --------

Topic 5

Term Weight
new 0.0112146
💦 0.0109027
🎉 0.0106032
now 0.0094651
😜 0.0075126
party 0.0073145
💖 0.0071628
hey 0.0052082
coming 0.0050964
🔥 0.0050923
get 0.0050638
🐸 0.0045986
💃 0.0045675
if 0.0044236
year 0.0039720
& 0.0037891
crazy 0.0037767
frog 0.0037767
gonna 0.0034961
👋 0.0034529
-------- --------

Topic 6

Term Weight
ass 0.0187165
don't 0.0169978
know 0.0169173
😐 0.0147632
just 0.0147319
dick 0.0140362
nigga 0.0096155
0.0092512
😢 0.0087001
put 0.0080525
ya 0.0077522
so 0.0077079
got 0.0072995
ain't 0.0071479
dat 0.0064966
how 0.0058373
girl 0.0056331
i'm 0.0056162
bitch 0.0055314
think 0.0053806
-------- --------

Topic 7

Term Weight
right 0.0215140
so 0.0209536
get 0.0166747
💯 0.0142631
if 0.0138160
what 0.0132399
shit 0.0119816
thats 0.0115992
good 0.0113031
👀 0.0107913
👏 0.0104414
do 0.0104325
u 0.0100339
im 0.0097956
gobble 0.0097587
back 0.0092131
(chorus 0.0079107
big 0.0078312
talking 0.0075157
ʳᶦᵍʰᵗ 0.0072895
-------- --------

Topic 8

Term Weight
u 0.0461436
ur 0.0209897
if 0.0174021
get 0.0154334
god 0.0072521
day 0.0070807
send 0.0047192
good 0.0043402
🇺🇸 0.0038912
go 0.0034715
🙌 0.0032628
& 0.0032218
know 0.0030973
ass 0.0029386
hoe 0.0029289
years 0.0028475
pussy 0.0028116
share 0.0026048
fuck 0.0026004
so 0.0025800
-------- --------

Topic 9

Term Weight
back 0.0441955
get 0.0385801
you're 0.0177772
if 0.0172913
complete 0.0153253
send 0.0142010
never 0.0131679
e 0.0100532
what 0.0099729
5 0.0090448
other 0.0067696
i've 0.0065336
give 0.0063635
got 0.0062691
ten 0.0062084
10 0.0060488
3 0.0052739
0 0.0051480
cum 0.0048874
😎 0.0047510
-------- --------

Topic 10

Term Weight
it's 0.0251530
🕛 0.0191897
get 0.0163309
feel 0.0104037
i'm 0.0100773
makes 0.0096297
if 0.0084466
high 0.0075146
noon 0.0062013
☝️ 0.0053340
asked 0.0049213
🔟 0.0047855
send 0.0046314
love 0.0046075
daddy 0.0046037
🌧 0.0045773
something 0.0045118
you'll 0.0044571
0.0044370
just 0.0042648
-------- --------

LDA Results with 50 topics and 20 max terms

Finished training LDA model. Summary:

50 topics:

Topic 1

Term Weight
right 0.0586913
so 0.0575726
💯 0.0470662
thats 0.0443357
shit 0.0393493
👀 0.0392532
what 0.0280907
im 0.0274382
do 0.0273360
(chorus 0.0253404
👌 0.0224123
talking 0.0216943
ᵗʰᵉʳᵉ) 0.0201653
ʳᶦᵍʰᵗ 0.0198931
👌👌 0.0168035
ƽaү 0.0166050
0.0150155
self 0.0146729
🎃 0.0118480
right✔there 0.0115280
-------- --------

Topic 2

Term Weight
0.0019296
🏢 0.0011661
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010684
keep 0.0009966
😂 0.0009106
emoji 0.0009012
world 0.0008929
least 0.0008390
🌚 0.0008323
🎃👇👻👻👻👻 0.0008289
help 0.0008221
people 0.0008179
done 0.0008130
going 0.0008072
cursed 0.0007930
🈴 0.0007813
= 0.0007424
🎃🎃🎃👻👻👻 0.0007132
🎃👌👉👉👻👻 0.0007132
i'm 0.0007089
-------- --------

Topic 3

Term Weight
little 0.0393867
want 0.0297826
boy 0.0225579
baby 0.0204317
i'm 0.0139455
tampon 0.0103583
eat 0.0079192
hard 0.0076202
goo-goo 0.0073803
hit 0.0072691
food 0.0060533
💓shake💓it 0.0058534
don't 0.0054995
9/11 0.0053792
look 0.0050142
think 0.0049731
only 0.0047505
keep 0.0047474
might 0.0044696
hoo-hoo 0.0044028
-------- --------

Topic 4

Term Weight
0.0022248
🏢 0.0011649
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010674
keep 0.0009956
🈴 0.0009366
😂 0.0009097
emoji 0.0009002
world 0.0008918
least 0.0008381
🌚 0.0008315
🈵 0.0008299
🎃👇👻👻👻👻 0.0008282
help 0.0008213
people 0.0008171
done 0.0008122
going 0.0008064
cursed 0.0007923
= 0.0007418
🎃🎃🎃👻👻👻 0.0007126
🎃👌👉👉👻👻 0.0007126
-------- --------

Topic 5

Term Weight
0.0018231
🏢 0.0011663
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010686
keep 0.0009968
😂 0.0009109
emoji 0.0009014
world 0.0008931
least 0.0008392
🌚 0.0008325
🎃👇👻👻👻👻 0.0008291
help 0.0008222
people 0.0008181
done 0.0008132
going 0.0008074
cursed 0.0007931
🈴 0.0007660
= 0.0007426
🎃🎃🎃👻👻👻 0.0007133
🎃👌👉👉👻👻 0.0007133
i'm 0.0007090
-------- --------

Topic 6

Term Weight
0.0018231
🏢 0.0011663
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010686
keep 0.0009968
😂 0.0009109
emoji 0.0009014
world 0.0008931
least 0.0008392
🌚 0.0008325
🎃👇👻👻👻👻 0.0008291
help 0.0008223
people 0.0008181
done 0.0008132
going 0.0008074
cursed 0.0007931
🈴 0.0007640
= 0.0007426
🎃🎃🎃👻👻👻 0.0007133
🎃👌👉👉👻👻 0.0007133
i'm 0.0007090
-------- --------

Topic 7

Term Weight
😐 0.0218572
got 0.0208124
know 0.0169297
ass 0.0153889
dick 0.0144380
just 0.0140327
so 0.0129853
😢 0.0129213
don't 0.0128141
i've 0.0105538
nigga 0.0102815
ain't 0.0096684
do 0.0080615
how 0.0078043
😐😐 0.0075206
shit 0.0070052
put 0.0067844
😎 0.0066094
think 0.0060251
girl 0.0059196
-------- --------

Topic 8

Term Weight
0.0019162
🏢 0.0011661
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010684
keep 0.0009966
😂 0.0009107
emoji 0.0009012
world 0.0008929
least 0.0008390
🌚 0.0008323
🎃👇👻👻👻👻 0.0008290
help 0.0008221
people 0.0008179
done 0.0008130
going 0.0008072
cursed 0.0007930
🈴 0.0007779
= 0.0007424
🎃🎃🎃👻👻👻 0.0007132
🎃👌👉👉👻👻 0.0007132
i'm 0.0007089
-------- --------

Topic 9

Term Weight
0.0024008
🏢 0.0011648
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010674
keep 0.0009955
😂 0.0009097
emoji 0.0009002
world 0.0008918
🈴 0.0008800
least 0.0008381
🌚 0.0008315
🎃👇👻👻👻👻 0.0008282
help 0.0008212
people 0.0008171
done 0.0008121
going 0.0008063
cursed 0.0007922
🈵 0.0007767
= 0.0007417
🎃🎃🎃👻👻👻 0.0007125
🎃👌👉👉👻👻 0.0007125
-------- --------

Topic 10

Term Weight
0.0021493
🏢 0.0011652
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010676
keep 0.0009958
😂 0.0009099
🈴 0.0009047
emoji 0.0009005
world 0.0008921
least 0.0008383
🌚 0.0008317
🎃👇👻👻👻👻 0.0008284
help 0.0008215
people 0.0008173
done 0.0008123
going 0.0008066
🈵 0.0007999
cursed 0.0007924
= 0.0007419
🎃🎃🎃👻👻👻 0.0007127
🎃👌👉👉👻👻 0.0007127
-------- --------

Topic 11

Term Weight
0.0017741
🏢 0.0011665
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010688
keep 0.0009970
😂 0.0009110
emoji 0.0009015
world 0.0008933
least 0.0008394
🌚 0.0008326
🎃👇👻👻👻👻 0.0008292
help 0.0008224
people 0.0008182
done 0.0008133
going 0.0008075
cursed 0.0007933
🈴 0.0007455
= 0.0007427
🎃🎃🎃👻👻👻 0.0007134
🎃👌👉👉👻👻 0.0007134
i'm 0.0007091
-------- --------

Topic 12

Term Weight
man 0.0481965
lol 0.0134546
0.0088301
0.0088301
0.0088301
0.0088301
0.0088301
wasnt 0.0088301
only 0.0078813
pa👨 0.0065732
just 0.0063744
once 0.0062091
😉 0.0055345
fell 0.0053323
nah 0.0052545
haha 0.0047374
💯💯💯💯💯💯 0.0045172
omg 0.0044002
kept 0.0043367
serious👫 0.0043319
-------- --------

Topic 13

Term Weight
get 0.0884925
back 0.0498597
if 0.0424296
send 0.0265891
you're 0.0171796
ur 0.0146860
u 0.0127831
time 0.0112333
hoe 0.0104118
means 0.0094172
dick 0.0093342
10 0.0091406
know 0.0083390
🔟 0.0078783
stayin' 0.0068168
good 0.0066443
alive✔ 0.0063543
5 0.0062126
big 0.0061244
doot 0.0060927
-------- --------

Topic 14

Term Weight
oh 0.0379361
skinner👨 0.0320367
chalmers👴 0.0249931
that's 0.0180967
ich 0.0125176
er 0.0124056
just 0.0117224
no❌ 0.0112040
steamed💨 0.0111805
yes👍 0.0108745
really 0.0091543
hamburgers🍔 0.0088582
odd 0.0088347
parents 0.0087829
well 0.0083120
time 0.0075106
ya 0.0071656
yeah 0.0069777
call📞 0.0065560
hams🐷 0.0064347
-------- --------

Topic 15

Term Weight
fucking 0.0346640
every 0.0199077
meme 0.0113485
day 0.0100998
god 0.0091442
reddit 0.0077139
made 0.0075129
don't 0.0070433
do 0.0065909
post 0.0065527
stupid 0.0064467
memes 0.0062115
- 0.0061305
now 0.0060814
want 0.0057808
people 0.0055910
only 0.0055902
even 0.0052597
give 0.0050202
expanse 0.0048043
-------- --------

Topic 16

Term Weight
0.0019634
🏢 0.0011657
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010681
keep 0.0009963
😂 0.0009104
emoji 0.0009009
world 0.0008926
🈴 0.0008499
least 0.0008388
🌚 0.0008321
🎃👇👻👻👻👻 0.0008287
help 0.0008218
people 0.0008177
done 0.0008127
going 0.0008070
cursed 0.0007928
🈵 0.0007485
= 0.0007422
🎃🎃🎃👻👻👻 0.0007130
🎃👌👉👉👻👻 0.0007130
-------- --------

Topic 17

Term Weight
clit 0.0181284
santa 0.0171791
jingle 0.0164553
dick 0.0142909
big 0.0127319
night 0.0121110
fun 0.0120737
merry 0.0112737
what 0.0107181
bells 0.0101256
🔔 0.0099913
black 0.0084816
ho 0.0079050
oh 0.0078005
come🌚🌞🌚 0.0077866
slutty 0.0074168
go 0.0068427
open 0.0066100
cum 0.0065690
christmas 0.0059564
-------- --------

Topic 18

Term Weight
0.0023868
🏢 0.0011648
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010673
keep 0.0009955
😂 0.0009097
emoji 0.0009002
world 0.0008918
🈴 0.0008899
least 0.0008381
🌚 0.0008315
🎃👇👻👻👻👻 0.0008282
help 0.0008212
people 0.0008171
done 0.0008121
going 0.0008063
cursed 0.0007922
🈵 0.0007860
= 0.0007417
🎃🎃🎃👻👻👻 0.0007125
🎃👌👉👉👻👻 0.0007125
-------- --------

Topic 19

Term Weight
it's 0.0631158
🕛 0.0604426
high 0.0232754
noon 0.0195293
god 0.0179824
i'm 0.0073814
& 0.0070901
that's 0.0064325
according 0.0060106
go 0.0056144
i👉😏👈 0.0053455
so 0.0048422
let 0.0042626
kinds 0.0041758
stick 0.0040767
holy 0.0039251
pee 0.0039219
😈 0.0038597
/// 0.0038082
satan 0.0036085
-------- --------

Topic 20

Term Weight
get 0.0400356
if 0.0175274
send 0.0169477
back 0.0139544
friends 0.0128145
you'll 0.0097544
2⃣0⃣ 0.0063194
🔟 0.0057396
swagdick 0.0055270
ur 0.0053812
good 0.0053383
put 0.0048859
bad 0.0048457
year 0.0047481
just 0.0047431
remember 0.0046988
⬜⬜◼📜📜📜◼ 0.0046754
got 0.0046227
red 0.0045933
cock 0.0045419
-------- --------

Topic 21

Term Weight
e 0.0380961
what 0.0280628
l 0.0154649
t 0.0151063
d 0.0146503
s 0.0127511
i'm 0.0125543
gonna 0.0124266
am 0.0123491
m 0.0120835
n 0.0112978
👴 0.0112451
r 0.0100834
👶 0.0099551
you're 0.0097250
f 0.0095110
u 0.0087408
most 0.0087020
i'll 0.0084902
literally 0.0083457
-------- --------

Topic 22

Term Weight
im 0.0134907
little 0.0134740
2 0.0132173
more 0.0127501
random 0.0107138
here 0.0103028
u 0.0101980
just 0.0080704
good 0.0079526
lasaga🍝 0.0075706
👀 0.0075569
want 0.0074561
(im 0.0068277
now 0.0068057
again 0.0066140
💯 0.0064604
jon 0.0064600
meet 0.0063319
👌 0.0061367
ppl 0.0060036
-------- --------

Topic 23

Term Weight
take 0.0325690
friend 0.0160916
pal 0.0121675
if 0.0120448
gotta 0.0097108
slice 0.0093155
come 0.0089321
don't 0.0087718
diddly 0.0080769
❓❗❓❗do 0.0080769
buddy 0.0080769
ya 0.0078934
just 0.0074273
want 0.0065010
mean 0.0065004
more 0.0058370
friendly 0.0048793
hey 0.0046334
neck 0.0042791
🏠home🏠 0.0040193
-------- --------

Topic 24

Term Weight
u 0.1202963
ur 0.0209787
yo 0.0152624
ass 0.0135619
dat 0.0090294
so 0.0080016
don't 0.0074713
fuck 0.0067931
cuz 0.0064078
nigga 0.0063277
got 0.0061959
day 0.0056279
see 0.0053689
till 0.0048532
know 0.0048400
bitch 0.0046739
get 0.0043211
die 0.0042747
aint 0.0041900
bro 0.0041238
-------- --------

Topic 25

Term Weight
0.1340491
0.0139931
0.0110896
🙏 0.0037961
💩💩and 0.0029501
holy 0.0025442
old 0.0024554
pope 0.0023389
spectre👻👻👻 0.0023389
spectre👻👻 0.0023389
spectre 0.0023389
haunting👻 0.0023389
guizot💩💩💩 0.0023389
europe💪 0.0023389
👻of 0.0023389
exorcise 0.0023389
🙏to 0.0023389
💪💪powers 0.0023389
entered 0.0023389
alliance 0.0023389
-------- --------

Topic 26

Term Weight
🍝 0.0576204
pasta 0.0211143
myself 0.0053114
that's 0.0027396
🍝👀🍝👀🍝👀🍝👀 0.0027007
ho0oooooooooooooooooooooo 0.0027007
mmmmmmm 0.0027007
right🍴there 0.0027007
🍴if 0.0027007
i'm 0.0022994
good 0.0018312
0.0012625
emoji 0.0010395
🏢 0.0010031
⬜⬜🎅🏽📜📜📜🎅🏽 0.0009290
) 0.0008924
keep 0.0008587
😂 0.0007846
done 0.0007582
world 0.0007470
-------- --------

Topic 27

Term Weight
get 0.0228889
💦 0.0184502
🎉 0.0180326
now 0.0143175
new 0.0139455
party 0.0124767
💖 0.0120829
😜 0.0113403
if 0.0104516
hey 0.0101252
🔥 0.0085351
coming 0.0081232
so 0.0075863
💃 0.0075860
🐸 0.0070619
day 0.0069091
crazy 0.0065088
frog 0.0065088
🍆 0.0061210
year 0.0060951
-------- --------

Topic 28

Term Weight
0.0023486
🏢 0.0011650
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010675
keep 0.0009957
😂 0.0009098
emoji 0.0009003
world 0.0008919
🈴 0.0008596
least 0.0008382
🌚 0.0008316
🎃👇👻👻👻👻 0.0008283
help 0.0008214
people 0.0008172
done 0.0008122
going 0.0008064
cursed 0.0007923
🈵 0.0007575
= 0.0007418
🎃🎃🎃👻👻👻 0.0007126
🎃👌👉👉👻👻 0.0007126
-------- --------

Topic 29

Term Weight
so 0.0207332
even 0.0102267
maybe 0.0093795
once 0.0085371
💦cum💦 0.0082490
get 0.0071806
catch 0.0064937
how 0.0056713
you're 0.0054935
now 0.0054918
become 0.0054167
let 0.0050778
next 0.0048816
need 0.0048362
here 0.0048177
just 0.0047836
something 0.0046516
i'm 0.0046504
take 0.0046067
find 0.0045327
-------- --------

Topic 30

Term Weight
🇺🇸 0.0308313
last 0.0156019
year 0.0130085
🔚 0.0122782
gon 0.0104668
being 0.0071541
2003 0.0069631
0.0065645
cause 0.0062167
🔜 0.0059277
💣 0.0054491
😁 0.0051761
getting 0.0051686
money 0.0049770
💬 0.0048319
0.0046959
means 0.0046909
gave 0.0045946
🌃 0.0045106
👍 0.0044756
-------- --------

Topic 31

Term Weight
͡° 0.0269821
͜ʖ 0.0269821
͡°) 0.0177375
( 0.0165718
👯 0.0124584
kinky 0.0119230
👉👌 0.0109742
͡°)💪( 0.0088605
myself 0.0058531
☺️ 0.0035902
mmmmmm 0.0028210
💪( 0.0027534
☺️☺️ 0.0027534
😍☺️💪👅 0.0027534
💪 0.0026678
нo0оଠoooooоଠଠooooᵒᵒᵒᵒᵒᵒᵒᵒᵒ 0.0026454
text 0.0019239
if 0.0013758
emojis 0.0013162
0.0010850
-------- --------

Topic 32

Term Weight
0.0021803
🏢 0.0011654
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010679
keep 0.0009961
😂 0.0009102
emoji 0.0009007
world 0.0008923
least 0.0008385
🌚 0.0008319
🎃👇👻👻👻👻 0.0008285
🈴 0.0008235
help 0.0008217
people 0.0008175
done 0.0008125
going 0.0008068
cursed 0.0007926
= 0.0007421
🈵 0.0007239
🎃🎃🎃👻👻👻 0.0007129
🎃👌👉👉👻👻 0.0007129
-------- --------

Topic 33

Term Weight
0.0018199
🏢 0.0011664
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010687
keep 0.0009969
😂 0.0009109
emoji 0.0009014
world 0.0008932
least 0.0008392
🌚 0.0008325
🎃👇👻👻👻👻 0.0008291
help 0.0008223
people 0.0008181
done 0.0008132
going 0.0008074
cursed 0.0007932
🈴 0.0007597
= 0.0007426
🎃🎃🎃👻👻👻 0.0007133
🎃👌👉👉👻👻 0.0007133
i'm 0.0007091
-------- --------

Topic 34

Term Weight
💞💕💖spoopy💖💕💞‭ 0.0323414
✨🌟spoopy🌟✨‭ 0.0093836
▄▀▄▀spoopy▄▀▄▀‭ 0.0061107
�������������������💞💕💖spoopy💖💕💞‭ 0.0028549
��������������������💞💕💖spoopy💖💕💞‭ 0.0028549
spoo‭ 0.0028549
�💞💕💖spoopy💖💕💞‭ 0.0028549
spoopy🍅‭ 0.0028549
💞💕💖troll 0.0028549
▄▀▄▀spooopy▄▀▄▀ 0.0028549
khitty‭ 0.0028549
(💞💕💖spoopy💖💕💞)‭ 0.0028549
✨🌟spoopy🌟✨🗾‭ 0.0028549
。゚+。spoopy ゚+。゚+‭ 0.0028549
(✿◠‿◠)spoopy(◡‿◡✿)‭ 0.0028549
spoopy🍔‭ 0.0028549
bot💖💕💞‭ 0.0028549
�💞💕💖spoopy💖💕💞�‭ 0.0028549
💞💕💖¡spoopy¡💖💕💞‭ 0.0028549
☆。*spoopy。☆‭ 0.0028549
-------- --------

Topic 35

Term Weight
🇨🇦 0.0711766
🍁 0.0259230
🌲 0.0141664
0.0140936
canadian 0.0090182
i'm 0.0042631
universal 0.0028229
candian 0.0028229
sorry) 0.0028229
нo0оଠoooooоଠଠooooᵒᵒᵒᵒᵒᵒᵒᵒᵒ 0.0028173
healthcare 0.0027620
0.0011240
🏢 0.0009319
if 0.0009078
⬜⬜🎅🏽📜📜📜🎅🏽 0.0008673
mmmmmᎷм 0.0008400
keep 0.0007947
😂 0.0007271
emoji 0.0007214
world 0.0006860
-------- --------

Topic 36

Term Weight
da 0.0263422
ass 0.0184289
lil 0.0115522
n 0.0092463
dat 0.0091916
shyt 0.0085765
dicc 0.0080194
wit 0.0069491
nut 0.0067849
nigga 0.0065920
fuck 0.0060487
yall 0.0056761
ha 0.0056707
👏thwack👏 0.0056068
while 0.0049576
ya 0.0045669
4 0.0043750
dis 0.0043577
bout 0.0042840
fucc 0.0041197
-------- --------

Topic 37

Term Weight
☝️ 0.0269682
🌧 0.0226087
0.0224442
rains 0.0215765
justice 0.0215765
daniel 0.0095292
bernie 0.0091618
1️⃣ 0.0091228
always 0.0091017
thing 0.0088495
🙌 0.0083498
white 0.0083202
🔑 0.0079986
damn 0.0078942
i'll 0.0076318
vans 0.0071403
know 0.0069310
😂😂😂 0.0064661
she's 0.0059726
place 0.0059036
-------- --------

Topic 38

Term Weight
daddy 0.0350436
makes 0.0220297
feel 0.0205903
make 0.0198854
if 0.0147691
so 0.0137985
i'm 0.0124083
🔨 0.0097933
asked 0.0096752
build 0.0093226
something 0.0085565
trump 0.0083672
got 0.0082124
give 0.0073371
just 0.0064313
🙋 0.0062502
also 0.0061578
everything 0.0059729
it’s 0.0058969
💦cummies💦 0.0058170
-------- --------

Topic 39

Term Weight
am 0.0241836
fucking 0.0195898
class="emojiinput 0.0180763
little 0.0144542
just 0.0137777
💀 0.0099887
i’m 0.0088715
very 0.0087790
only 0.0083474
fuck 0.0076811
now 0.0076790
you’re 0.0075932
think 0.0070955
sign 0.0066909
so 0.0063615
<span 0.0060190
call 0.0058810
being 0.0054284
trained 0.0051435
if 0.0050267
-------- --------

Topic 40

Term Weight
0.0021145
🏢 0.0011655
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010680
keep 0.0009962
😂 0.0009102
emoji 0.0009007
world 0.0008924
least 0.0008386
🌚 0.0008319
🎃👇👻👻👻👻 0.0008286
🈴 0.0008259
help 0.0008217
people 0.0008176
done 0.0008126
going 0.0008068
cursed 0.0007927
= 0.0007421
🈵 0.0007261
🎃🎃🎃👻👻👻 0.0007129
🎃👌👉👉👻👻 0.0007129
-------- --------

Topic 41

Term Weight
together 0.0171172
life 0.0102751
see 0.0096414
you👨 0.0087702
too 0.0074713
just 0.0073821
friend 0.0067296
gon 0.0065320
do 0.0064727
bring 0.0064327
might 0.0058410
going 0.0044281
suck 0.0040595
hit 0.0039752
drop 0.0038569
now 0.0038541
sucking 0.0038116
let 0.0037524
friend👴 0.0035085
realizes 0.0035085
-------- --------

Topic 42

Term Weight
0.0024197
🏢 0.0011645
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010671
keep 0.0009952
🈴 0.0009580
😂 0.0009094
emoji 0.0008999
world 0.0008915
🈵 0.0008501
least 0.0008378
🌚 0.0008312
🎃👇👻👻👻👻 0.0008279
help 0.0008210
people 0.0008168
done 0.0008119
going 0.0008061
cursed 0.0007920
= 0.0007415
🎃🎃🎃👻👻👻 0.0007124
🎃👌👉👉👻👻 0.0007124
-------- --------

Topic 43

Term Weight
0.0022670
🏢 0.0011653
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010678
keep 0.0009960
😂 0.0009101
emoji 0.0009006
world 0.0008922
least 0.0008385
🌚 0.0008318
🎃👇👻👻👻👻 0.0008285
help 0.0008216
people 0.0008174
🈴 0.0008130
done 0.0008125
going 0.0008067
cursed 0.0007925
= 0.0007420
🈵 0.0007142
🎃🎃🎃👻👻👻 0.0007128
🎃👌👉👉👻👻 0.0007128
-------- --------

Topic 44

Term Weight
right 0.0247808
so 0.0210711
💯 0.0160132
get 0.0142665
thats 0.0137366
👏 0.0136869
shit 0.0135026
what 0.0130736
gobble 0.0128821
if 0.0119614
👀 0.0117507
do 0.0110924
im 0.0109303
(chorus 0.0094323
good 0.0093748
talking 0.0091196
ʳᶦᵍʰᵗ 0.0088838
u 0.0087129
ᵗʰᵉʳᵉ) 0.0085912
back 0.0081008
-------- --------

Topic 45

Term Weight
back 0.0659049
complete 0.0645326
never 0.0512221
get 0.0253887
you're 0.0246854
give 0.0232844
other 0.0224469
3 0.0219555
send 0.0204051
ten 0.0200838
5 0.0186777
0 0.0175563
99% 0.0167745
🚫error🚫 0.0164984
💯true💯 0.0164779
35% 0.0160649
60% 0.0160156
███████████] 0.0155997
████]]]]]]]]]]]]]]]]]]]]]]]]]]] 0.0154559
███████]]]]]]]]]]]]]]]] 0.0154543
-------- --------

Topic 46

Term Weight
0.0018087
🏢 0.0011664
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010687
keep 0.0009969
😂 0.0009109
emoji 0.0009014
world 0.0008932
least 0.0008392
🌚 0.0008325
🎃👇👻👻👻👻 0.0008291
help 0.0008223
people 0.0008181
done 0.0008132
going 0.0008074
cursed 0.0007932
🈴 0.0007613
= 0.0007426
🎃🎃🎃👻👻👻 0.0007133
🎃👌👉👉👻👻 0.0007133
i'm 0.0007091
-------- --------

Topic 47

Term Weight
0.0021955
🏢 0.0011654
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010678
keep 0.0009960
😂 0.0009101
emoji 0.0009006
world 0.0008923
least 0.0008385
🌚 0.0008318
🈴 0.0008292
🎃👇👻👻👻👻 0.0008285
help 0.0008216
people 0.0008175
done 0.0008125
going 0.0008067
cursed 0.0007926
= 0.0007420
🈵 0.0007292
🎃🎃🎃👻👻👻 0.0007128
🎃👌👉👉👻👻 0.0007128
-------- --------

Topic 48

Term Weight
yhu 0.0238995
i'm 0.0130516
n 0.0119192
real 0.0117080
😍 0.0103462
being 0.0097925
😘 0.0097283
love 0.0094255
💯 0.0089383
please 0.0081454
💪 0.0079663
if 0.0079446
go 0.0077110
💑 0.0076081
need 0.0070795
💏 0.0068458
want 0.0067374
show 0.0066221
i'll 0.0057587
only 0.0057578
-------- --------

Topic 49

Term Weight
0.0022245
🏢 0.0011653
⬜⬜🎅🏽📜📜📜🎅🏽 0.0010678
keep 0.0009960
😂 0.0009101
emoji 0.0009006
world 0.0008922
least 0.0008385
🌚 0.0008318
🎃👇👻👻👻👻 0.0008285
🈴 0.0008266
help 0.0008216
people 0.0008174
done 0.0008125
going 0.0008067
cursed 0.0007925
= 0.0007420
🈵 0.0007268
🎃🎃🎃👻👻👻 0.0007128
🎃👌👉👉👻👻 0.0007128
-------- --------

Topic 50

Term Weight
💯💯 0.0296147
ᴛᴏ 0.0220339
ᴍy 0.0164895
ʙᴇ 0.0146390
ᴀɴᴅ 0.0146390
🙊nigga🙊 0.0123677
ᴛʜɪꜱ 0.0109455
ɢɪʀʟꜰʀɪᴇɴᴅ 0.0072406
ɢᴇᴛ 0.0054032
ᴩʀᴏᴩᴏꜱᴀʟ 0.0054032
ʀɪᴅᴇ 0.0054032
ꜱ-ꜱᴏ 0.0054032
ᴅᴏ 0.0054032
ᴄᴏʟʟᴀʀ 0.0054032
ᴄᴜᴛᴇ 0.0054032
/ᴛʜɪɴᴋꜱ 0.0054032
ʟᴏᴏᴋꜱ 0.0054032
ʟᴀᴅy 0.0054032
ɢɪʀʟ 0.0054032
ʜᴀᴠᴇ 0.0054032
-------- --------

Dependencies

Installing Spark

Use sbt or:

# Download spark to an 'Installations' directory
mkdir ~/Installations && cd Installations
wget https://d3kbcqa49mib13.cloudfront.net/spark-2.2.0-bin-hadoop2.7.tgz
# Extract contents to a folder in the current directory.
tar -xf spark-2.2.0-bin-hadoop2.7.tgz
cd spark-2.2.0-bin-hadoop2.7/

Resources

// For more information see the Apache Spark Docs

Resources

About

😅 A topic model of reddit.com/r/EmojiPasta trained with Spark and an LDA model (NSFW) - Trigger Warning: The r/emojipasta subreddit posts controversial content and anything I have crawled is to provide visibility of a topic modeling some of this controversial content. Unfortunately there is also discriminatory speech which must be called out!

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages