Code Monkey home page Code Monkey logo

shohil-kishore / twitter-data-toolkit Goto Github PK

View Code? Open in Web Editor NEW
6.0 3.0 4.0 7.63 MB

Easy to use web form built on top of the Twitter v2 API. Allows users to collect and merge all data (including fields and expansions). Jupyter notebook provided to combine data into one CSV or Excel file.

License: GNU General Public License v3.0

JavaScript 49.55% EJS 30.64% Jupyter Notebook 19.81%
twitter-data twitter-api premium-search academic-research gui social-network twitter

twitter-data-toolkit's Introduction

Twitter Data Toolkit

Twitter Data Toolkit is a Node.js project that allows users to collect Tweets using Twitter's new v2 endpoints and aggregate Tweets into four JSON files (Tweets, Extended Tweets, Users and Places) without having to interact with code. Everything's done through a simple web application. Feel free to email me ([email protected]) if you need more information.

Screenshot

Reference

If you use this software, please reference: Kishore, S., Peko, G., & Sundaram, D. (2019). Looking Through the Twitter Glass: Bridging the Data โ€“ Researcher Gap. Paper presented at the Americas Conference on Information Systems (AMCIS) 2019, Cancun, Mexico.

Instructions for Academics (Windows/Linux/macOS)

  1. Apply for access to the Academic Research product track (https://developer.twitter.com/en/solutions/academic-research/products-for-researchers).
  2. On approval, create an app under "Apps" (https://developer.twitter.com/en/docs/projects/overview).
  3. Download and install Node.js (https://nodejs.org/en/download/).
  4. If you have a GitHub account, clone or fork this project. If you don't have a GitHub account, click the green "Clone or download" button on the top-right and download the ZIP file.
  5. From the command line, change directory into "twitter-data-toolkit", type "npm install" to install dependencies, and "npm start" to start the application.
  6. Finally, in a web browser, type in "https://localhost:8080" to access the web application and start collecting data! ๐ŸŽ‰

FAQ

How is this different to other projects?

This project focuses on those with a non-technical background. When you simply want to collect some data to explore an idea, this is a great place to start.

Why should I use the Twitter API?

Twitter recently introduced the Academic Research product track. The API's available through this track are particularly useful in a research context as they allow you to collect full-fidelity data that others can replicate. Note that the Academic Research product track is currently closed. It now costs $100 USD per 10,000-50,000 tweets.

How much does it cost to use the Twitter API?

Nothing. Once a research project is approved, user's can collect up to 10,000,000 Tweets per month. Note that the Academic Research product track is currently closed. It now costs $100 USD per 10,000-50,000 tweets.

twitter-data-toolkit's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

twitter-data-toolkit's Issues

Count Endpoint

Add in seperate page for count endpoint, including some basic visualisations.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.