Code Monkey home page Code Monkey logo

airbnb-berlin-sentiment-topic-analysis's Introduction

AirBnB-Sentiment Analysis and Topic Modeling

Table of Contents

Overview

Data

The analysis begins with the examination of two primary datasets: Reviews and Neighbourhoods GeoJSON. The Reviews dataset contains 315,479 entries, each representing a guest review. This dataset includes essential information such as listing_id, date, reviewer_id, reviewer_name, comments, and the detected_language of the review.

The Neighbourhoods GeoJSON dataset provides information about Berlin's neighborhoods, including geographical boundaries. It contains 140 entries and features like neighborhood, neighbourhood_group, and geometry.

Results

Data Preprocessing

  • Handling Missing Values: The Reviews dataset exhibits no missing values across its columns, indicating that the dataset is complete and ready for analysis.

  • Selecting English Reviews: The analysis focuses on English reviews, which comprise a substantial portion of the dataset. This selection allows for effective sentiment analysis and topic modeling using natural language processing (NLP) techniques.

  • Data Cleaning: Text preprocessing was applied to the selected English reviews, which involved removing special characters, lemmatization, and other techniques to enhance the quality of the text data for analysis.

Topic Modeling Latent Dirichlet Allocation (LDA) LDA was employed to uncover latent topics within the English reviews. The analysis yielded multiple topic models with varying numbers of topics. Here are the primary topics extracted from the reviews:

With 3 Topics more cohesive topic allocation was possible:

  • Convenience and Location: As in the previous model, this topic emphasizes the convenience and location aspects of the accommodations.
  • Quality Accommodations: This topic continues to focus on the quality of accommodations, including attributes like cleanliness and amenities.
  • Positive Guest Experiences: This topic highlights the positive experiences of guests, showcasing their enjoyment and intent to return.

Sentiment Analysis VADER Sentiment Analysis The VADER (Valence Aware Dictionary and Sentiment Reasoner) sentiment analysis tool was employed to assess the sentiment of the reviews. The sentiment analysis results provided a compound score for each review, which was categorized into three sentiment labels:

  • Positive: Reviews with a compound score greater than or equal to 0.05.
  • Neutral: Reviews with a compound score between -0.05 and 0.05.
  • Negative: Reviews with a compound score less than or equal to -0.05.

The sentiment analysis results revealed the following distribution of sentiment labels:

  • Positive: 303,693 reviews
  • Neutral: 6,421 reviews
  • Negative: 5,365 reviews

Key Findings

  • Topic Insights: The LDA topic modeling unveiled distinct themes within the reviews, emphasizing the significance of convenience, quality accommodations, and positive guest experiences. This information can guide property owners and hosts in understanding guest priorities.

  • Sentiment Analysis: A significant majority of reviews expressed positive sentiments (approximately 96% of reviews). This suggests a generally favorable guest experience across Airbnb listings in Berlin.

In the link below you can find a sentiment-based map of the listings. https://public.tableau.com/views/AirBnbBerlinSentimentMap/Dashboard1?:language=en-US&:display_count=n&:origin=viz_share_link

#Conclusion The analysis of Airbnb reviews in Berlin using topic modeling and sentiment analysis has provided valuable insights into guest experiences and preferences. Property owners and hosts can leverage these findings to enhance their listings and cater to guest needs effectively. The predominance of positive sentiments also underscores the quality of accommodations in Berlin.

The combination of topic modeling and sentiment analysis equips Airbnb hosts and property managers with the tools to gain a deeper understanding of guest feedback, ultimately contributing to improved guest satisfaction and positive online reputations.

#Acknowledgments

The data used in this project can be found here: http://insideairbnb.com/get-the-data

airbnb-berlin-sentiment-topic-analysis's People

Contributors

zibaatak avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.