INTRODUCTION ------------ This resource corresponds to a multilingual Lexicon for PreProcessing of Social Media/Social networks/Twitter Texts. The lexicon is composed by four folders that correspond to the four follwoing languages: English, Spanish, Dutch, and Italian. Each folder contains dictionaries of abbreviations, slang words, and contractions commonly used in social media messages. There is a single file for the emoticons dictionary with meanings in English. HOW TO CITE ----------- Until the official paper for this resource is published, you can cite the following paper (where the dictionaries were used for the first time): Posadas-Durán, J.P., Gómez-Adorno, H., Markov, I., Sidorov, G., Batyrshin, I.Z., Gelbukh, A.F., Pichardo-Lagunas, O.: Syntactic n-grams as features for the author pro filing task: Notebook for PAN at CLEF 2015. In: Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum, Toulouse, France, September 8-11, 2015. (2015), http://ceur-ws.org/Vol-1391/136-CR.pdf DESCRIPTION ----------- The compilation of the dictionaries is divided into three steps: 1. We searched on the Internet freely available websites that were used as sources for the extraction of lists of slang words, contractions, and abbreviations. 2. From the selected sources, we manually extracted the lists of slang words, contractions, and abbreviations along with their corresponding meanings in each language (English, Spanish, Italian, and Dutch). We created different files with the same structure for each web source. 3. Once we had all the lists in different files, we proceeded to join all the files of the same nature. We formatted and cleaned each file, we also removed the duplicated entries. Finally, we manually checked the meanings of each entry in the dictionaries. Each dictionary is ordered alphabetically, and each file is consists of two columns separated by a tabulation. The first column corresponds to a slang word, abbreviation or contraction entry, according to the nature of the dictionary. The second column corresponds to the meaning of the entry. The statistics for each dictionary is presented bellow: Type of Dictionary Abbreviations Dutch: 1237 Italian: 107 English: 1346 Spanish: 527 Contractions Dutch: 15 Italian: 56 English: 131 Spanish: 11 Slang words Dutch: 250 Italian: 362 English: 1249 Spanish: 939 Emoticons English: 482 Totals Dutch: 1520 Italian: 525 English: 3208 Spanish: 1959 The links to the web pages that were used in order to extract the lists of slang words, contractions and abbreviations for the English, Spanish, Dutch and Italian languages are presented below. Sources links for each dictionary of the English language Abbreviations : http://public.oed.com/how-to-use-the-oed/abbreviations/ http://www.englishleap.com/other-resources/abbreviations http://www.macmillandictionary.com/us/thesaurus-category/american/written-abbreviations Contractions : https://en.wikipedia.org/wiki/Wikipedia:List_of_English_contractions http://grammar.about.com/od/words/a/Notes-On-Contractions.htm http://grammar.about.com/od/words/a/Notes-On-Contractions.htm Slang words : http://transl8it.com/largest-best-top-text-message-list/ http://www.webopedia.com/quick_ref/textmessageabbreviations.asp https://kennybeal.wordpress.com/text-acronyms/ Sources links for each dictionary of the Spanish language Abbreviations : http://www.wikilengua.org/index.php/Lista_de_abreviaturas_A http://www.reglasdeortografia.com/abreviaturas.htm http://buscon.rae.es/dpd/apendices/apendice2.html Contractions : http://www.gramaticas.net/2011/09/ejemplos-de-contraccion.html Slang words : http://spanish.about.com/od/writtenspanish/a/sms.htm https://www.duolingo.com/comment/8212904 http://www.hispafenelon.net/ESPACIOTRABAJO/VOCABULARIO/SMS.html http://www.doyoucomprende.com/2012/05/spanish-texting-slang/ Sources links for each dictionary of the Dutch language Abbreviations : https://nl.wikipedia.org/wiki/Lijst_van_afkortingen_in_het_Nederlands Contractions : https://en.wiktionary.org/wiki/Category:Dutch_contractions https://www.duolingo.com/comment/5599651 Slang words : http://www.welingelichtekringen.nl/tech/398386/je-tiener-op-het-web-en-de-afkortingen.html http://www.phrasebase.com/archive2/dutch/dutch-internet-slang.html https://nl.wikipedia.org/wiki/Chattaal Sources links for each dictionary of the Italian language Abbreviations : http://homes.chass.utoronto.ca/~ngargano/corsi/corrisp/abbreviazioni.html http://www.paginainizio.com/service/abbreviazioni.htm Contractions : http://www.liquisearch.com/contraction_grammar/italian https://en.wikipedia.org/wiki/Contraction_\%28grammar\%29#Italian Slang words : https://it.wikipedia.org/wiki/Gergo_di_Internet#Il_gergo_comune_di_internet http://unluogocomune.altervista.org/elenco-abbreviazioni-in-uso-nelle-chat/ http://www.wired.com/2013/11/web-semantics-gergo-di-internet/ Finally, the list of links of the pages used to obtain the emoticons is presented bellow. These pages contain the meanings of each emoticon in English. Sources links of the dictionary of emoticons https://en.wikipedia.org/wiki/List_of_emoticons http://pc.net/emoticons/ http://www.netlingo.com/smileys.php