Code Monkey home page Code Monkey logo

mbrukman / cloudera-hue Goto Github PK

View Code? Open in Web Editor NEW

This project forked from kryton/hue

0.0 1.0 0.0 148.56 MB

Let’s big data. Hue is a Web interface for analyzing data with Apache Hadoop. It supports a file and job browser, Hive, Pig, Impala, Spark, Oozie editors, Solr Search dashboards, HBase, Sqoop2, and more.

Home Page: http://gethue.com

License: Apache License 2.0

Makefile 0.11% Python 43.69% HTML 30.35% Shell 0.06% JavaScript 3.78% Thrift 0.14% CSS 0.71% PigLatin 0.01% Java 4.34% XSLT 0.52% ApacheConf 0.01% Scala 0.09% C 15.19% Emacs Lisp 0.02% Assembly 0.29% C++ 0.25% Perl 0.23% TeX 0.18% Prolog 0.01% GAP 0.02%

cloudera-hue's Introduction

image

Welcome to the repository for Hue

Hue is an open source Web interface for analyzing data with Apache Hadoop: gethue.com

image

It features:

  • File Browser for accessing HDFS
  • Hive Editor for developing and running Hive queries
  • Search App for querying, exploring, visualizing data and dashboards with Solr
  • Impala App for executing interactive SQL queries
  • Spark Editor and Dashboard
  • Pig Editor for submitting Pig scripts
  • Oozie Editor and Dashboard for submitting and monitoring workflows, coordinators and bundles
  • HBase Browser for visualizing, querying and modifying HBase tables
  • Metastore Browser for accessing Hive metadata and HCatalog
  • Job Browser for accessing MapReduce jobs (MR1/MR2-YARN)
  • Job Designer for creating MapReduce/Streaming/Java jobs
  • A Sqoop 2 Editor and Dashboard
  • A ZooKeeper Browser and Editor
  • A DB Query Editor for MySql, PostGres, Sqlite and Oracle

On top of that, a SDK is available for creating new apps integrated with Hadoop.

More user and developer documentation is available at http://gethue.com.

Getting Started

To build and get the development server running:

$ git clone http://github.com/cloudera/hue.git
$ cd hue
$ make apps
$ build/env/bin/hue runserver

Now Hue should be running on http://localhost:8000 !

The configuration in development mode is desktop/conf/pseudo-distributed.ini.

Note: to start the production server (but lose the automatic reloading after source modification):

$ build/env/bin/supervisor

To run the tests:

Install the mini cluster (only once):
$ ./tools/jenkins/jenkins.sh slow

Run all the tests:
$ build/env/bin/hue test all

Or just some parts of the tests, e.g.:
$ build/env/bin/hue test specific impala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala.test_basic_flow

Development Prerequisites

You'll need these library development packages and tools installed on your system:

Ubuntu:
  • ant
  • gcc
  • g++
  • libkrb5-dev
  • libmysqlclient-dev
  • libssl-dev
  • libsasl2-dev
  • libsasl2-modules-gssapi-mit
  • libsqlite3-dev
  • libtidy-0.99-0 (for unit tests only)
  • libxml2-dev
  • libxslt-dev
  • mvn (from maven package or maven3 tarball)
  • openldap-dev / libldap2-dev
  • python-dev
  • python-setuptools
CentOS/RHEL:
  • ant
  • asciidoc
  • cyrus-sasl-devel
  • cyrus-sasl-gssapi
  • gcc
  • gcc-c++
  • krb5-devel
  • libtidy (for unit tests only)
  • libxml2-devel
  • libxslt-devel
  • mvn (from maven package or maven3 tarball)
  • mysql
  • mysql-devel
  • openldap-devel
  • python-devel
  • sqlite-devel
  • openssl-devel (for version 7+)
MacOS (mac port):
  • liblxml
  • libxml2
  • libxslt
  • mysql5-devel
  • sqlite3

File Layout

The Hue "framework" is in desktop. /core/ contains the Web components and desktop/libs/ the API for talking to Hadoop. The installable apps live in apps/. Please place third-party dependencies in the app's ext-py/ directory.

The typical directory structure for inside an application includes:

src/
for Python/Django code

models.py urls.py views.py forms.py settings.py

conf/

for configuration (.ini) files to be installed

static/

for static HTML/js resources and help doc

templates/

for data to be put through a template engine

locales/

for localizations in multiple languages

For the URLs within your application, you should make your own urls.py which will be automatically rooted at /yourappname/ in the global namespace. See apps/about/src/about/urls.py for an example.

Main Stack

Hue would not be possible without:

Community

License

Apache License, Version 2.0 http://www.apache.org/licenses/LICENSE-2.0

cloudera-hue's People

Contributors

romainr avatar enricoberti avatar generalpiston avatar anutron avatar xizhao avatar erickt avatar toddlipcon avatar vinithra avatar sai-krish avatar newalex avatar cmconner156 avatar okdistribute avatar pauldb avatar andyao1 avatar mr0re1 avatar pslawski avatar subtlegradient avatar gdgt avatar benbishop avatar sdiao avatar suhassatish avatar qwertymaniac avatar lucanat avatar thinker0 avatar shrijeetrf avatar papisz avatar lfrancke avatar l1x avatar ashu210890 avatar abayer avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.