﻿INTRODUCTION
------------
This resource corresponds to a multilingual Social Media Lexicon for Text Pre-Processing.
The lexicon is composed by four folders that correspond to the four follwoing languages: English, Spanish, Dutch, and Italian. 
Each folder contains dictionaries of abbreviations, slang words, and contractions commonly used in social media messages.
There is a single file for the emoticons dictionary with meanings in English.

HOW TO CITE
-----------
Until the official paper for this resource is published, you can cite the following paper (where the dictionaries were used for the first time):

Posadas-Durán, J.P., Gómez-Adorno, H., Markov, I., Sidorov, G., Batyrshin, I.Z.,
Gelbukh, A.F., Pichardo-Lagunas, O.: Syntactic n-grams as features for the author
pro filing task: Notebook for PAN at CLEF 2015. In: Working Notes of CLEF 2015
- Conference and Labs of the Evaluation forum, Toulouse, France, September 8-11, 2015. 
(2015), http://ceur-ws.org/Vol-1391/136-CR.pdf

DESCRIPTION
-----------
The compilation of the dictionaries is divided into three steps:
1. We searched on the Internet freely available websites that were used as sources for the extraction of lists of slang words, contractions, and abbreviations.
2. From the selected sources, we manually extracted the lists of slang words, contractions, and abbreviations along with their corresponding meanings in each 
language (English, Spanish, Italian, and Dutch). We created different files with the same structure for each web source.
3. Once we had all the lists in different files, we proceeded to join all the files of the same nature. We formatted and cleaned each file, we also removed 
the duplicated entries. Finally, we manually checked the meanings of each entry in the dictionaries.

Each dictionary is ordered alphabetically, and each file is consists of two columns separated by a tabulation. The first column corresponds to a slang word, 
abbreviation or contraction entry, according to the nature of the dictionary. The second column corresponds to the meaning of the entry.

The statistics for each dictionary is presented bellow:

Type of Dictionary	
Abbreviations 		
	Dutch: 1237 	
	Italian: 107 		
	English: 1346 		
	Spanish: 527
Contractions 		
	Dutch: 15
	Italian: 56 			
	English: 131
	Spanish: 11
Slang words 		
	Dutch: 250 	
	Italian: 362 		
	English: 1249 		
	Spanish: 939
Emoticons
	English: 482
Totals
	Dutch: 1520
	Italian: 525
	English: 3208
	Spanish: 1959

The links to the web pages that were used in order to extract the lists of slang words, contractions and abbreviations for the 
English, Spanish, Dutch and Italian languages are presented below. 

Sources links for each dictionary of the English language
Abbreviations :
http://public.oed.com/how-to-use-the-oed/abbreviations/
http://www.englishleap.com/other-resources/abbreviations
http://www.macmillandictionary.com/us/thesaurus-category/american/written-abbreviations
Contractions :
https://en.wikipedia.org/wiki/Wikipedia:List_of_English_contractions
http://grammar.about.com/od/words/a/Notes-On-Contractions.htm
http://grammar.about.com/od/words/a/Notes-On-Contractions.htm
Slang words :
http://transl8it.com/largest-best-top-text-message-list/
http://www.webopedia.com/quick_ref/textmessageabbreviations.asp
https://kennybeal.wordpress.com/text-acronyms/

Sources links for each dictionary of the Spanish language
Abbreviations :
http://www.wikilengua.org/index.php/Lista_de_abreviaturas_A
http://www.reglasdeortografia.com/abreviaturas.htm
http://buscon.rae.es/dpd/apendices/apendice2.html
Contractions :
http://www.gramaticas.net/2011/09/ejemplos-de-contraccion.html
Slang words :
http://spanish.about.com/od/writtenspanish/a/sms.htm
https://www.duolingo.com/comment/8212904
http://www.hispafenelon.net/ESPACIOTRABAJO/VOCABULARIO/SMS.html
http://www.doyoucomprende.com/2012/05/spanish-texting-slang/

Sources links for each dictionary of the Dutch language
Abbreviations :
https://nl.wikipedia.org/wiki/Lijst_van_afkortingen_in_het_Nederlands
Contractions :
https://en.wiktionary.org/wiki/Category:Dutch_contractions
https://www.duolingo.com/comment/5599651
Slang words :
http://www.welingelichtekringen.nl/tech/398386/je-tiener-op-het-web-en-de-afkortingen.html
http://www.phrasebase.com/archive2/dutch/dutch-internet-slang.html
https://nl.wikipedia.org/wiki/Chattaal

Sources links for each dictionary of the Italian language
Abbreviations :
http://homes.chass.utoronto.ca/~ngargano/corsi/corrisp/abbreviazioni.html
http://www.paginainizio.com/service/abbreviazioni.htm
Contractions :
http://www.liquisearch.com/contraction_grammar/italian
https://en.wikipedia.org/wiki/Contraction_\%28grammar\%29#Italian
Slang words :
https://it.wikipedia.org/wiki/Gergo_di_Internet#Il_gergo_comune_di_internet
http://unluogocomune.altervista.org/elenco-abbreviazioni-in-uso-nelle-chat/
http://www.wired.com/2013/11/web-semantics-gergo-di-internet/


Finally, the list of links of the pages used to obtain the emoticons is presented bellow.
These pages contain the meanings of each emoticon in English.

Sources links of the dictionary of emoticons
https://en.wikipedia.org/wiki/List_of_emoticons
http://pc.net/emoticons/
http://www.netlingo.com/smileys.php
