Multimodal Video Sentiment Analysis Using Audio and Text Data
Journal of Advances in Mathematics and Computer Science · pp. 30–37 · Published 25 Aug 2021
10.9734/jamcs/2021/v36i730381Abstract
Nowadays, video sharing websites are becoming more and more popular, such as YouTube, Tiktok. A good way to analyze a video’s sentiment would greatly improve the user experience and would help with designing better ranking and recommendation systems [1,2]. In this project, we used both acoustic information of a video to predict its sentiment levels. For audio data, we leverage transfer learning technique and use a pre-trained VGGish model as a features extractor to analyze abstract audio embeddings [6]. We then used MOSI dataset [5] to further fine-tune the VGGish model and achieved a test accuracy of 90% for binary classification. For text data, we compared traditional bag-of-word model to LSTM model. We found that LSTM model with word2vec outperformed bag-of-word model and achieved a test accuracy of 84% for binary classification.
Cited by 0
No indexed citations yet.
Related research
- Arabic Text Summarization Using Latent Semantic Analysis — shares topic coverage
- Estimation of Community Views on Criminal Justice a Statistical Document Analysis Approach — shares topic coverage
- Data Mining in Environmental, Social, Governance (ESG) Analysis: An Overview — shares topic coverage
- Review of Literature on Corporate Governance and Firm Performance: A Text Mining Approach — shares topic coverage
- Exploring the Landscape of Web Data Mining: An In-depth Research Analysis — shares topic coverage
Article metrics
Real usage data collected on this platform.
0
Page views
0
PDF downloads
0
Outbound clicks
0
Citations
Views by country
Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".
No views recorded yet.
Traffic sources
Referring site, by host.
No traffic recorded yet.
Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.