Skip to content

Data for the paper - How Cosmopolitan are Emojis

Notifications You must be signed in to change notification settings

fvancesco/acmmm2016

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 

Repository files navigation

How Cosmopolitan Are Emojis?

TL;TR: We study emoji embeddings trained on tweets posted in different countries.

PDF of the paper

Choosing the right emoji to visually complement or condense the meaning of a message has become part of our daily life. Emojis are pictures, which are naturally combined with plain text, thus creating a new form of language. These pictures are the same independently of where we live, but they can be interpreted and used in different ways. In this paper we compare the meaning and the usage of emojis across different languages. Our results suggest that the overall semantics of the subset of the emojis we studied is preserved across all the languages we analysed. However, some emojis are interpreted in a different way from language to language, and this could be related to socio-geographical differences.

alt text

Download Embeddings

The dimension of the skipgram vectors is 300 with window 6 (vocab min count = 10). We trained the embedding using all the tokens, emojis and punctuation included (links are removed and user anonymized with "@user"). The dataset used was of 20M geolocalized tweets posted from October 2015 to February 2017. In each link you find the lowercased and not lowercased version.

Example

Emojis can be tricky to handle, they are composed of one or more unicode character (full list). This is a simple use case with gensim:

from gensim.models.keyedvectors import KeyedVectors
#loading the model can take a minute or so
model = KeyedVectors.load_word2vec_format('model_swm_300-6-10-low.w2v', binary=False)
c = "👍"
nn = model.most_similar(positive=[c.decode('utf-8')])
for e,s in nn:
  print e + "  -  " + str(s) 

Also, have a look at this library if you have troubles with emoji unicode.

Citation

The provided models are freely available under Creative Commons CC BY 3.0, using the reference below for attribution.

@inproceedings{barbieri2016cosmopolitan,
  title={How Cosmopolitan Are Emojis?: Exploring Emojis Usage and Meaning over Different Languages with Distributional Semantics},
  author={Barbieri, Francesco and Kruszewski, German and Ronzano, Francesco and Saggion, Horacio},
  booktitle={Proceedings of the 2016 ACM on Multimedia Conference},
  pages={531--535},
  year={2016},
  organization={ACM}
}

About

Data for the paper - How Cosmopolitan are Emojis

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published