Issues I've worked on today:

• Cleaning up dataset (deaths and confirmed csv files).
• Get a new dataset to join all the csv into one.

Complications I got alone the process
The recovered csv file has less data than the others and this doesn't have the data in a sorted way. And this dataset has some data with different latitude and longitude (so I'm going to change it to the correct values).

Solutions:

• I got the differences between datasets and search in the Internet to recover the results. I found a page to fit the countries missing (Data missing)
• To the second part I'm working on it.

This is a REMAINDER to update the documentation.

Issues I've worked on today:

• Working in the dashboard.
• Think about the charts and how to show the data.

Issues I've worked on today:

• Cleaning the dataset with the new data.
• Import it into mongo.
• Working in the api.
• Thinking on import more data (vaccinations).

Complications:

• I've had to remove all the data and cleaning a data that was usefulness.

Solutions:

• I need to remove the unnecessary row and execute again the commands. This was easy. The difficulty was discover it.

Issues I've worked on today:

• Working in the api.
• Test the Dockerfile and deploy into heroku to test the speed of that.
• Search a way to view the response speed of the request to the API.
• Secure some internals endpoints with access key.

Add to the repo a docker-compose file to run the project in the local machine.

Improve the API code to remove some spaguetti code.

Issues I've worked on today:

• Documentation.

Add more datasets to the repository.

Issues I've worked on today:

• Working in the dashboard.
• Working to get the data from the api.
• Add new endpoints on the api.

Issues I've worked on today:

• Import the new recoveries from Canada dataset.
• Generate mongodb with datetime and geospatial index and insert data.
• The dataset has a few data maybe I need to search more updated data.

Complications:

• The dataset recoveries that I found have undiscontinued data after 8th August of 2021.

Solutions:

• The dataset for Canada have the recoveries for all year (maybe I need to search another datasets).

Issues I've worked on today:

• Working on the fixing some api endpoints.
• Start the dashboard code.

Complications:
Pipelines doesn't work as expected.

Solutions:
I need to use more projects to get the correct result.

Issues I've worked on today:

• Working in the api.

Add test coverage and pytest to the API and dashboard(if it's possible)

Issues I've worked on today:

• Finished the dashboard.
• Working on draw heatmaps with seaborn, bar chart by plyplot and maps with pydeck.
• Finished the dockerfile and upload the code into heroku.
• Finally, working on secure the internal and in the report.

Complications:
I've had to search how to create a heatmap with different x and y values.

Solutions:
Easy, google has the answer for almost everything.

Get updated the datasets and the database with the updated datasets.

Add semantic release monorepo to get releases for each component

Issues I've worked on today:

• Working on cleaning the dataset with the new data.

Complications:

• The dataset have new territories.

Solutions:

• Generate a new dataframe with the new territories to import it.

Issues I've worked today:

• Project structured
• Download and look into the dataset.

Solutions

• Generate a new branch develop with the structure of the project.
• Use opendatset library to download the csv. You need an account for kaggle and a api key to download from this library. I create a jupyter notebook that download it.

Add sentry on dashboard and on the api.

Issues I've worked on today:

• Working in the dashboard.
• Working on draw some charts.
• Working on the Internals element to update, delete, create documents on mongodb.

Issues I've worked on today:

• Look into the datasets and think an easy way to get the data into mongodb.
• View the different rows and columns and remove some unneeded data.

Solutions

• Import pandas and put hand dirty with the dataset.
• Think a good structured for getting the information easily from the database.

Issues I've worked on today:

• Working in the api.
• Endpoints of the API.

Complications:
I've had to working with pipelines to join more and aggregate data.

Solutions:
I need to read documentation about the aggregate function in mongodb.