Code Monkey home page Code Monkey logo

👋 Hi there and welcome 👋

So, here is a collection of repositories written mainly in Python and Ruby, with a fair amount of JavaScript mixed in.

  • 💬 Ask me about: Designing and building APIs, real-time data streaming, event-driven architectures, early-warning systems, and working with weather data.

Some background

I joined Tinybird about a year ago as a developer advocate so you will see Tinybird-related projects. This will include demos for showing the kinds of APIs you can build on that platform. I'm sure the first few will include some sort of weather-related theme.

Update: Here are some Tinybird projects:

For eight years I was on the Twitter developer relations team, and as such, most of these repositories are focused on collecting, analyzing, and displaying Twitter data. These repositories can be broken up into three types:

  • 'Backend' scripts that make API requests, receive the data, and typically store that data somewhere (or if a simple example, just send it off into the ether).

  • Web applications in the form of standalone websites or chatbot applications hosted on Twitter.

    • https://github.com/twitterdev/SnowBotDev - Started as a demo of the Twitter Account Activity API, evolved into a full-featured chatbot application. (Since leaving Twitter, this app is no longer functional due to the TwitterDev account on Heroku being abandoned.)
    • https://github.com/jimmoffitt/SocialFlood - In 2016-2017, I went deep into Twitter data use cases related to flood-warning systems. This and other related content led to receiving two national awards for innovation related to public safety and weather communications.
  • Customer tools for working with Twitter data.

    • JSON to CSV translator - Many, many customers were not equipped to work with Tweet JSON files and wanted to work instead with simple CSV files for spreadsheets or loading into a database (think of a social studies reseacher who wants to do spreadsheet-hosted analysis). With this tool, you can map the JSON attributes of interest to column fields, point to a collection of JSON files, and generate CSV files.
    • Bounding boxes - Many of the most popular Twitter API endpoints enable searching for Tweets of interest by matching on locations shared by users. The Twitter query language supports a 'bounding box' operator that matches on rectangular areas with sides no larger than 25 miles. This tool is used to take a 'study area' of interest, however large, and output a set of valid queries with bounding box definitions.
    • Query migrator - Twitter API search and filtered stream customers build queries to match on Tweets of interest. Customer can have up to 250,000 queries per real-time stream, and can have even more that are used with search endpoints. This tool was first developed in 2016 to help customers migrate enterprise versions (the "Gnip 2.0" migration). Before I left Twitter, this tool was updated to migrate queries and filters to Twitter API v2 (on a Twitter internal repository).

During the 13 years before Gnip/Twitter, I developed flood-warning software, so you may notice that a certain use case drives most of these efforts...

📫 How to reach me:

@snowman's Projects

apis_demo icon apis_demo

A collection of demos: Tweets --> Engagement metrics --> Audience analysis

bounding-boxes icon bounding-boxes

Collection of scripts for building Gnip bounding boxes for a specified study area.

data-stores icon data-stores

A collection of notes on and code snippets for storing Twitter data.

dm-api-client icon dm-api-client

experiments related to building a Twitter Direct Message API demo

dmapp icon dmapp

A prototype for deploying Ruby/Tk Applications as Windows 7 Executables.

floodsocial icon floodsocial

Code for an example Twitter notification system based on subscribers sharing locations of interest. Based on Direct Message and Account Activity APIs. A complement to SocialFlood ;).

get-metrics icon get-metrics

Simple Python script for getting Tweet metrics from Twitter Developer Labs endpoint...

hbc icon hbc

Updated Twitter HBC to stream from PowerTrack 2.0.

json-diff icon json-diff

Generates the differences in two JSON files. Built to work with *numeric* values of keys in common.

json2csv icon json2csv

A Ruby app for converting Tweet JSON to CSV.

maperator icon maperator

Replay twitter events and see how the geographic information flows through the conversation.

pi-adventures icon pi-adventures

Notes and sample code for deploying Twitter stream consumer and notification apps on a Raspberry Pi 3.

pt-dm icon pt-dm

Download manager for Gnip Historical PowerTrack. Written in Ruby for Windows 7, MacOS and Linux.

pt-stream icon pt-stream

Streams PowerTrack data, based largely on [https://github.com/rweald/gnip-stream] which uses EventMachine for HTTP streaming.

pyowm icon pyowm

A Python wrapper around the OpenWeatherMap web API

rbedc_multi_stream icon rbedc_multi_stream

Ruby script for streaming data from multiple Gnip EDC data feeds. Streaming based on https://github.com/rweald/gnip-stream (eventmachine)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.