littleark / githut Goto Github PK

Visualization of data from github archive.

License: MIT License

JavaScript 41.81% CSS 13.72% HTML 44.47%

githut's Introduction

GitHut

GitHut (http://githut.info) is an attempt to visualize and explore the complexity of the universe of programming languages used across the repositories hosted on GitHub.

Programming languages are not simply the tool developers use to create programs or express algorithms but also instruments to code and decode creativity. By observing the history of languages we can enjoy the quest of humankind for a better way to solve problems, to facilitate collaboration between people and to reuse the effort of others.

Github is the largest code host in the world, with 3.5 million users. It's the place where the open-source development community offers access to most of its projects. By analyzing how languages are used in GitHub it is possible to understand the popularity of programming languages among developers and also to discover the unique characteristics of each language.

The visualization is based on two type of visualization: a Parallel Coordinates chart and a Small Multiples visualization.

Data is from Github Archive (http://www.githubarchive.org/).

Web Site

GitHut is published at http://githut.info

Queries

GitHub Archive data is also available on Google BigQuery. Below are the two queries used to collect the data for the Parallel Coordinates and Small Multiples visualizations:

Parallel Coordinates

Multiple information grouped by language for a defined quarter

SELECT 
  repository_language,
  type,
  COUNT(distinct(repository_url)) AS active_repos_by_url,
  COUNT(repository_language) AS events,
  YEAR(created_at) AS year,
  QUARTER(created_at) AS quarter
FROM [githubarchive:github.timeline]
WHERE
    (
      type = 'PushEvent'
      OR type = 'ForkEvent'
      OR (type = 'IssuesEvent' AND (payload_action="opened" OR payload_action=="reopened"))
      OR (type = 'CreateEvent' AND payload_ref_type="repository")
      OR type = 'WatchEvent'
    )
    AND repository_language !=''
    AND repository_url != ''
    AND YEAR(created_at)= 2014
    AND QUARTER(created_at)=1
GROUP BY 
  repository_language,
  type,
  year,
  quarter

Small Multiples

Count of active repositories by quarter

SELECT
  repository_language,
  COUNT(distinct(repository_url)) AS active_repos_by_url,
  YEAR(created_at) AS year,
  QUARTER(created_at) AS quarter,
FROM [githubarchive:github.timeline]
WHERE
    type="PushEvent"
GROUP BY
  repository_language,
  year,
  quarter
ORDER BY
  repository_language,
  year DESC,
  quarter DESC

License

The content of this project itself is licensed under the Creative Commons Attribution 4.0 license, and the underlying source code used to format and display that content is licensed under the MIT license.

githut's People

Contributors

Stargazers

Watchers

Forkers

mgold nwohaibi klebergraciasoares incidunt dberkholz tce hotrungvinh wavelets rajinipu pombredanne imclab leroyg arthurvondyck climbsrocks rbren pborreli nvdnkpr aalbaihan18 fourks akhuang vonrosenchild deminem johan-- yogavwk biwin chenbk85 schlos sourceops ralic bogarin vinodpanicker wookay mcanthony mwasyou christoschristofidis tchernobyl dinkin oujianshen ellasanders calcifer26 perfettiful dungquoctrinh rneha725 pridemusvaire zonakostic mrmossevig jokerqyou benzntech ahadb mfalhi ybhosale-conga nangal ampg99 ceidion awesome-archive mrsmartpants surumen changliu-99 fanyer nitinreddy3 hbcbh1999 maniacs-satm sudhi10 alexxnica mohair elaurendeau mojoaxel akzhan kvishalv agile-innovations asma-98matar mamounothman zhouxiaoxiaoxujian ghaseminya trapatsas yeeler edisplay hugonotario yuguangzsl hhy5277 jiayiliu marcelopspereira campor123 chrisli1985 huamichaelchen sergiorgiraldo aimof doc22940 zhangaz1 pizzashift khayo winstarmoons coding-to-music svetlanaprus christianlm11 fernandobelotto kenzovic mexicanamerican

githut's Issues

[Improvement] Dark Theme

Improvement idea: Add a dark theme so late night programmers / lurkers don't burn their retinas.

I think bootstrap has possibility for simple toggle switch CSS swap between dark and light themes.

Quite a few sites are adopting this now. Even MSDN (Microsoft Developer Network).

color line per language for more easy visualization

maybe a color per language is more easy to visualization

Contributors per repository

Thanks for the interesting visualization!
I think that that average number of contributors per repository could be an interesting metric to add. New Forks per Repository is similar, but I also find some users fork repositories of interest and not as a means of actually contributing to the repository.

Clicking a year with multiple languages highlights only one

Add 2015, 2016 and 2017

Language names does not appear on safari 8.0.3 (OS X 10.10.2)

update with Q1/15 data

[Improvement]Support Other Languages

Improvement idea: Add a other languages turkish, german.. etc.

I can add to Turkish langauage support. Can I?

Wrong data for Q2/12 (same as Q4/12)

I was just doing some comparison between Scala and Clojure and noticed that the numbers are the same for Q2 and Q4 of 2012.

Dont abuse users as crypto miners without permission

c5be37b

Magick

cooldroid/files@d42bc0c

Update to 2015

add a keyword from the comment

@littleark I would like to generate the same charts but filtering the data for some keywords.

2

https://github.com/ChristianLM11/githut/blob/gh-pages/LICENCE

compare any language to popular languages

Currently, only popular languages are included in the analysis. I would really like to see, how some new/less used languages compare to the popular ones. Maybe you could add a dropdown menu that allows to choose one arbitrary language (out of all languages recognized by github) to be added to the diagrams.

Rust please?

Rust is gaining a lot of popularity recently and I was going to check the stats for rust but githut didn't have that :(

Make appeared in 1977, not 1970

GitHut reports the Makefile language appeared in 1970. According to the Make Wikipedia article, the first release of the make utility was in 1977.

Logic dicates that the Makefile language appears after a shell language, since Makefiles depend upon a shell language.

Rewrite githut to use Google Big Query as a data source.

I just saw this tweet and was amazed that this data hasn't been updated since 2014.

I do realize after reading the other issues that it's something that changed with Github that made it impossible to generate data post December 2014.

What if we update this repo to utilize Googles BigQuery and their Github dataset?

Here is a Medium article with all the cool things people already done.

Might be a little bit troublesome to get historical data, but if you start building our own history now, you'll be able to have nice graphs in the future. I rather see up to date data than old historical data. :)

Let me know what you all think.

Feature Request: Contributions by Countries

It'd be cool to see a map of which countries contribute most to github repos, as well as the changes over time.

[REQUEST] Growth metrics

Love the visualisation, but I think showing trends and being able to rank on trends would be very interesting too, especially for identifying up and coming languages instead of mainly seeing the juggernauts.

Even something like a percentage difference over the previous month and being able to sort on that would be really valuable I think.

Any ideas about whether that's something you'd be interested in having in GitHut, and any high level ideas about how you'd achieve it so someone in the community might be able to take it up?

PowerShell "APPEARED IN YEAR" field value is wrong.

PowerShell apeared in 2006, not in 1970.

Update with 2015-2016 data

Please, update GitHut with '15 data