Social Media Analytics
Social Media Analytics
Social Media Analytics
The presence of social media has made a tremendous changes in the way how people see the world outside. It started to influence people opinion and emotions regarding the happenings around them. This project aims to analyse the user posts and comments in the social media and determine the hidden sentiments in the posts thus by leading to find the degree negativity in each user comment or posts.
The entire architecture of the proposed system can be categorized into two according to the learning mechanisms incorporated in the work. There is a CRF learning module and a SVM learning module, which are arranged in a linear fashion, such that output of the one module is given as the input to the another one. After the pre-processing of the data, there is a word level learning mechanism using CRF which involves semantic tagging. The output from the CRF model is given into the SVM module for sentence level learning. The sentences in dataset are categorized according to the sentiment bearing words in the sentence. First stage is identifying such words and are assigned with well defined semantic tags along with the BIS tags already associated with the words. This newly defined tags gives the information about the context with which that sentence appears. The second stage involves tagging the whole sentence according to the context, positive, negative and neutral.
Sentiment identification step deals with finding the polarity of sentences, which depends up on the sentiment bearing words in the sentence, which are tagged with some semantic tags. Identification and tagging of subjective words are done manually. We are also looking for intensifiers, the words or adverbs which give force or emphasis to the word appears next. In the sentiment classification step the whole sentences are classified into corresponding target classes like positive, negative and neutral. Two machine learning algorithms are incorporated here, CRF and SVM. The methodology consists two levels of learning. It make use of word level semantic labeling followed by the sentence level classification. Word level tagging can be considered as sequence labeling problem and sentence level classification is a text classification problem. CRF is a popular supervised learning algorithm well suited for sequence labeling problems. SVM is efficient for text classification problem. Here we using CRF for word level tagging and SVM for sentence level classification.
The result from SVM will be the classified form of the input sentences. Sentences may belong to one of these categories: Positive, Negative, or Neutral. After that the negative sentences are again subjected to the training for finding the degree negativity in the sentences. These are again classified according to the polarity of negativity in the text such as: mildly, highly, extremely negative and thus by finding the use of negativity in the social media platforms.
Express Interest
The entire architecture of the proposed system can be categorized into two according to the learning mechanisms incorporated in the work. There is a CRF learning module and a SVM learning module, which are arranged in a linear fashion, such that output of the one module is given as the input to the another one. After the pre-processing of the data, there is a word level learning mechanism using CRF which involves semantic tagging. The output from the CRF model is given into the SVM module for sentence level learning. The sentences in dataset are categorized according to the sentiment bearing words in the sentence. First stage is identifying such words and are assigned with well defined semantic tags along with the BIS tags already associated with the words. This newly defined tags gives the information about the context with which that sentence appears. The second stage involves tagging the whole sentence according to the context, positive, negative and neutral.
Sentiment identification step deals with finding the polarity of sentences, which depends up on the sentiment bearing words in the sentence, which are tagged with some semantic tags. Identification and tagging of subjective words are done manually. We are also looking for intensifiers, the words or adverbs which give force or emphasis to the word appears next. In the sentiment classification step the whole sentences are classified into corresponding target classes like positive, negative and neutral. Two machine learning algorithms are incorporated here, CRF and SVM. The methodology consists two levels of learning. It make use of word level semantic labeling followed by the sentence level classification. Word level tagging can be considered as sequence labeling problem and sentence level classification is a text classification problem. CRF is a popular supervised learning algorithm well suited for sequence labeling problems. SVM is efficient for text classification problem. Here we using CRF for word level tagging and SVM for sentence level classification.
The result from SVM will be the classified form of the input sentences. Sentences may belong to one of these categories: Positive, Negative, or Neutral. After that the negative sentences are again subjected to the training for finding the degree negativity in the sentences. These are again classified according to the polarity of negativity in the text such as: mildly, highly, extremely negative and thus by finding the use of negativity in the social media platforms.
Related Projects
Automate & Simplify The Whole Process
Dependency Parser
A Dependency parser is important for applications like sentence structure identification, machine translation, clause boundary identification,question answering system etc. No work has been done so far in the field of dependency parser for Malayalam using machine learning approaches.
Read more
Dwanimam – POS editor
Dhwanimam – Malayalam POS tag checker is a web based application, developed by the team at ICFOSS, which provides an opportunity to edit Parts-of-Speech (POS) tags assigned to Malayalam words.
Read more
Malayalam ChatBot
ICFOSS developed a Malayalam Chat-Bot, which interacts with the system users, like a human conversational partner in MALAYALAM. A chatbot can be used as a conversational agent which gives information to the public.
Read more
Malayalam Filthy Comment Detecor from Facebook
Social media are interactive computer-mediated technologies that facilitate the creation and sharing of information, ideas, career interests and other forms of expression via virtual communities and networks.
Read more
Malayalam Transliteration Tool
Machine Transliteration is the practice of converting a character or word written in one language to another .Machine transliteration can play an important role in natural language application such as information retrieval and machine translation, especially for handling proper nouns and technical terms, cross language applications, data mining and information retrieval system. This tool is to convert a malayalam name entity to corresponding English word.
Read more
Morphological Analyzer
ICFOSS has developed a web based morphological analyser tool for Malayalam. The proposed system uses recursive suffix stripping methods and moreover, the sandhi rules are also taken into consideration during the stemming process.
Read more
DHRITI – Malayalm OCR
The project aims at creating an efficient searching and information extraction system that can process a large set of Malayalam documents and produce the most accurate results based on a user query
Read more
Plagiarism Checker
The widespread use of the Internet has made the plagiarism of documents very easy. So plagiarism detection is one of the main concern in the field of academia and research.
Read more
Malayalam Text Summarisation
There are two main types of how to summarise text in NLP (1) Extraction-based summarisation and (2) Abstraction-based summarisation.
Read more