Code Monkey home page Code Monkey logo

brazilian_census_2010's Introduction

Brazilian Census 2010

##This script will help you Download the 2010 Brazilian Census data sets and save them as .csv files.

If you are familiar with SQL and Monetab, you have probably heard about the terrific job that Anthony Damico and Djalma Pessoa have put together to write a code to download and analyze the 2010 Brazilian Census data.

However, if you are looking for a pure R solution AND you want a fast solution, you might find this code useful.

  • The script is written taking advantage of readr capabilities, a new R package that is extremelly fast to read fixed width text files.
  • Once the text files are stored in your computer, it doesn't take long to save the national data sets. It took me respectively 13 minutes and 43 minutes to save the national data sets of households and individuals records. The most time-consuming part is actually saving the files.

step-by-step. This scriptt:

  • Downloads 2010 Brazilian Census microdata from IBGE's website
  • Unizip the microdata of all state files
  • Creates a documentation file to read the fixed width text files
  • Reads and binds text files into single data frame with records of the whole country
  • Saves data sets as .csv files.

Apart from some typos you will find here and there, the code can be much improved. All feedback and colaboration is welcomed !

brazilian_census_2010's People

Contributors

rafapereirabr avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.