Code Monkey home page Code Monkey logo

demographics-kz's Introduction

Demographics in Kazakhstan by region, age and sex.

Data

Data is in CSV format and synced with upstream source monthly. It is sourced from https://data.egov.kz/datasets/view?index=kazakstan_respublikasy_halkyny1.

Note: Since data.egov.kz requested for a signed key for authorization, we just downloaded and put in directory archive. It is temporary solution

We have processed the source data to make it normalized and derived from it several aggregated datasets:

  • data/regions-age-sex.csv - data by region, age and sex.
  • data/regions-total.csv - aggregated by region.
  • data/regions-by-sex.csv - aggregated by region and sex.

We have also added some metadata such as column descriptions and data packaged it.

Preparation

Python 3.6 .github/workflows/actions.yml

This repository uses dataflows to process and normalize the data.

You first need to install the dependencies:

pip install -r scripts/requirements.txt

Then run the script

python scripts/process.py

License

This dataset is licensed under the Open Data Commons Public Domain and Dedication License.

demographics-kz's People

Contributors

actions-user avatar anuveyatsu avatar dependabot[bot] avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

demographics-kz's Issues

Source data is broken

GitHub actions was broken for ~18 months now. Although, I cannot see the logs anymore I can assume it is because the source data is unavailable:

https://data.egov.kz/datasets/view?index=kazakstan_respublikasy_halkyny1

Downloading data returns 404.

Since the official data source is unstable, we could use some alternative source:

  • wikipedia - provides total population for county from 1950 (which is great) but doesn't provide data by region and sex (only charts without raw data but maybe need to dig deeper to find out the source.
  • https://gender.stat.gov.kz/file/Kazakhstaninfigures.pdf - if we could convert this PDF into CSV tables, it would be awesome

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.