lyashenkogs / analytics4github Goto Github PK

The application is deployed on an EC2 micro instance (1GB Ram).
Currently EC2 serves

• Jenkins
• Docker
• MongoDB
• MongoDB web UI (Mongo express)

To fix:

• disable MongoDB UI
• if this will not help -> disable a MongoDB

To prevent such things:

• Setup Jenkins email notifications on a build fail
• Setup Zabbix based monitoring. Zabbix server and agents installation process should be automated by ansible playbooks.
• Research possibility to switch to AWS container service. Consider a need in a MongoDB, preferably installed on an EC2.
  A screenshot after a build fail due to insuficcient memmory size that shows the application ~200mb and jenkins ~300mb RAM

Currently, the project relies on

• GitHub REST API
• GitHub trending page (parsing via JSoup)
  Need to implement appropriate exceptions and their handling (show a message on UI) for cases of network connectivity issues.

Acception criteria

1. In case of absence of access to Github display the according error message
   
2. In case of absence of access to Github Trending page, display the according error message
   

Currently, tests send requests to real API which has requests limit and seems to have some concurrent requests limit. Need to record real API responses and use them from a mock server.

We cater analytics only for a current month and current week. Add a feature to change analytics period on UI.
MockUps(open via draw.io) :
https://drive.google.com/file/d/0Bx7QUcP3ps_TMDZiUFdocExQVnc/view?usp=sharing
Acceptence creteria

1. Display current month start - end
2. On click display next or previous month
3. Prohibit pick up custom days. Only change month

during a request to the githubAPI, it returns commits not considering time zones but considers them on UI (see the picture below)

A query to get all the January commits https://api.github.com/repos/LyashenkoGS/analytics4github/commits?since=2017-01-01T00:00:00Z&until=2017-01-31T00:00:00Z
also the analytics4github displays wrong commits dates

• Update Gradle to version 3.2.1 include wrapper
• assure that the project works correctly on AWS and Openshift

Go to ns server https://www.cloudflare.com/

Dockerise application according to the tutorial https://spring.io/guides/gs/spring-boot-docker/
Research how to add token

GitHub provides 5 000 requests per hour for authorised users. In your case authorised user is the analytics4github production server.A number of left requests can be acquired from a header of response from GitHub API. See https://developer.github.com/v3/#rate-limiting.

The goal is to display current rate limit on the application start and update after each analyse operation(unique stargazers, commits, etc.)

"mvn test" leads to test failures. The bug is floating and can't be reproduced by running separate tests.

Need to find the root cause and fix.

As a user,
I want to trigger the "analyse" button automatically, at click to change month arrow.

As a user, I want to see the application REST-API
in a swagger-ui, like in the example http://petstore.swagger.io/
the endpoint should be analytics4github.org/rest-api

On the pictures there is the same commits frequency, despite different months

But there are no commits at all during January.

https://api.github.com/repos/terryum/awesome-deep-learning-papers/commits?since=2017-01-01T00:00:00Z&until=2017-01-31T00:00:00Z - January

https://api.github.com/repos/terryum/awesome-deep-learning-papers/commits?since=2016-12-01T00:00:00Z&until=2016-12-31T00:00:00Z - December

Blocked by #17 #16.
When a user opens our application provide him 20 requests in one session. If we don't have tokens to access GitHub Rest API - show an excuse modal window and offer to authorise via GitHub.

Need to track a user session to provide a limited number of request to the GitHub API per session. Recommended implementation is via cookies.

Acceptance criteria:

• Track a user session
• Display user session id in logging

code review link http://134.249.116.246:8081/analytics-github/review/AG-CR-9

Blocked by #17 #16. Provide 400 requests per a new user session. When no request left - don't perform requests for the user.

https://travis-ci.org/LyashenkoGS/analytics4github/builds/187087105 a typical case when a build fails because of multiple timeouts. Need to add MongoDB during testing on TravisCI. Manual for databases setup

• As a user,
  I want to see already analysed new stars for the current month and week during the application home page load.
• As a user,
  I want to trigger the "analyse" button automatically, at click on tabs(stars, commits, unique contributors)

Stars

Unique contributors