Code Monkey home page Code Monkey logo

in-memory-analytics-with-apache-arrow-'s Introduction

In-Memory Analytics with Apache Arrow

In-Memory Analytics with Apache Arrow

This is the code repository for In-Memory Analytics with Apache Arrow, published by Packt.

Perform fast and efficient data analytics on both flat and hierarchical structured data

What is this book about?

Apache Arrow is designed to accelerate analytics and allow the exchange of data across big data systems easily. In-Memory Analytics with Apache Arrow begins with a quick overview of the Apache Arrow format, before moving on to helping you to understand Arrow’s versatility and benefits as you walk through a variety of real-world use cases.

This book covers the following exciting features:

  • Use Apache Arrow libraries to access data files both locally and in the cloud
  • Understand the zero-copy elements of the Apache Arrow format
  • Improve read performance by memory-mapping files with Apache Arrow
  • Produce or consume Apache Arrow data efficiently using a C API
  • Use the Apache Arrow Compute APIs to perform complex operations
  • Create Arrow Flight servers and clients for transferring data quickly
  • Build the Arrow libraries locally and contribute back to the community

If you feel this book is for you, get your copy today!

https://www.packtpub.com/

Instructions and Navigations

All of the code is organized into folders.

The code will look like the following:

...
// add these imports
"fmt"
"github.com/apache/arrow/go/v8/arrow/arrio"
...

Following is what you need for this book: This book is for developers, data analysts, and data scientists looking to explore the capabilities of Apache Arrow from the ground up. This book will also be useful for any engineers who are working on building utilities for data analytics and query engines, or otherwise working with tabular data, regardless of the programming language. Some familiarity with basic concepts of data analysis will help you to get the most out of this book but isn't required. Code examples are provided in the C++, Go, and Python programming languages.

With the following software and hardware list you can run all code files present in the book (Chapter 1-11).

Software and Hardware List

Software required OS required
An internet connected computer
Git Windows, Mac OS X, and Linux (Any)
C++ compiler capable of C++11 or higher Windows, Mac OS X, and Linux (Any)
Python 3.7 and higher Windows, Mac OS X, and Linux (Any)
Conda (optional) Windows, Mac OS X, and Linux (Any)
vcpkg (optional) Windows
MSYS2 (optional) Windows
CMAKE 3.5 or higher Windows, Mac OS X, and Linux (Any)
make or ninja Mac OS X, and Linux (Any)
Docker Windows, Mac OS X, and Linux (Any)
Go 1.16 or higher Windows, Mac OS X, and Linux (Any)

We also provide a PDF file that has color images of the screenshots/diagrams used in this book. Click here to download it.

Related products

Get to Know the Author

Matthew Topol is an Apache Arrow contributor and a Staff Software Engineer at Voltron Data. He joined FactSet Research Systems, Inc. in 2009, working in both infrastructure and application development, led development teams, and architected large-scale distributed systems for processing analytics on financial data. He recently joined Voltron Data to work full time on the Apache Arrow libraries directly. In his spare time, Matt likes to bash his head against a keyboard, develop and run delightfully demented games of fantasy for his victims—er—friends, and share his knowledge with anyone interested enough to listen.

Download a free PDF

If you have already purchased a print or Kindle version of this book, you can get a DRM-free PDF version at no cost.
Simply click on the link to claim your free PDF.

https://packt.link/free-ebook/9781801071031

in-memory-analytics-with-apache-arrow-'s People

Contributors

packt-itservice avatar roshank10 avatar utkarsha-packt avatar zeroshade avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.