excellentjr / hue Goto Github PK

Hue is an open source Web interface for analyzing data with any Apache Hadoop: gethue.com

It features:

• SQL editors for Hive, Impala, MySQL, Oracle, PostgreSQL, SparkSQL, Solr SQL, Phoenix...
• Dynamic Search dashboards with Solr
• Spark and Hadoop notebooks
• Scheduling of jobs and workflows through an Oozie Editor and Dashboard

More user and developer documentation is available at gethue.com.

To build and get the development server running:

$ git clone https://github.com/cloudera/hue.git
$ cd hue
$ make apps
$ build/env/bin/hue runserver

Now Hue should be running on http://localhost:8000 !

The configuration in development mode is desktop/conf/pseudo-distributed.ini.

Note: to start the production server (but lose the automatic reloading after source modification):

$ build/env/bin/supervisor

To run the tests:

Install the mini cluster (only once):

$ ./tools/jenkins/jenkins.sh slow

Run all the tests:

$ build/env/bin/hue test all

Or just some parts of the tests, e.g.:

$ build/env/bin/hue test specific impala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala.test_basic_flow

Start Hue in a single click with the Docker Guide or the video blog post.

You'll need these library development packages and tools installed on your system:

Ubuntu:

• sudo apt-get install git ant gcc g++ libffi-dev libkrb5-dev libmysqlclient-dev libsasl2-dev libsasl2-modules-gssapi-mit libsqlite3-dev libssl-dev libxml2-dev libxslt-dev make maven libldap2-dev python-dev python-setuptools libgmp3-dev

• Oracle's JDK (read more here)

sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer

• mvn (from maven package or maven3 tarball)
• openldap-dev / libldap2-dev
• libtidy-0.99-0 (for unit tests only)

CentOS/RHEL:

• Oracle's JDK (read more here)
• ant
• asciidoc
• cyrus-sasl-devel
• cyrus-sasl-gssapi
• cyrus-sasl-plain
• gcc
• gcc-c++
• krb5-devel
• libffi-devel
• libtidy (for unit tests only)
• libxml2-devel
• libxslt-devel
• make
• mvn (from apache-maven package or maven3 tarball)
• mysql
• mysql-devel
• openldap-devel
• python-devel
• sqlite-devel
• openssl-devel (for version 7+)
• gmp-devel

MacOS:

• Xcode command line tools
• Oracle's JDK 1.7+
• maven (Homebrew)
• mysql (Homebrew)
• gmp (Homebrew)
• openssl (Homebrew)
• Required for Mac OS X 10.11+ (El Capitan), after brew install openssl, run: export LDFLAGS=-L/usr/local/opt/openssl/lib && export CPPFLAGS=-I/usr/local/opt/openssl/include

All, just in case you want to run the Jasmine tests:

• NodeJS (https://nodejs.org/)
• PhantomJS (npm install -g phantomjs-prebuilt)

The Hue "framework" is in desktop/core/ and contains the Web components. desktop/libs/ is the API for talking to various Hadoop services. The installable apps live in apps/. Please place third-party dependencies in the app's ext-py/ directory.

The typical directory structure for inside an application includes:

  src/
    for Python/Django code
      models.py
      urls.py
      views.py
      forms.py
      settings.py

  conf/
    for configuration (``.ini``) files to be installed

  static/
    for static HTML/js resources and help doc

  templates/
    for data to be put through a template engine

  locales/
    for localizations in multiple languages

For the URLs within your application, you should make your own urls.py which will be automatically rooted at /yourappname/ in the global namespace. See apps/about/src/about/urls.py for an example.

Hue would not be possible without:

• Python 2.6.5 - 2.7
• Django 1.6 (https://docs.djangoproject.com/)
• Knockout.js (http://knockoutjs.com/)
• jQuery (http://jquery.com/)
• Bootstrap (http://getbootstrap.com/)

• User group: http://groups.google.com/a/cloudera.org/group/hue-user
• Jira: https://issues.cloudera.org/browse/HUE
• Reviews: https://review.cloudera.org/dashboard/?view=to-group&group=hue (repo 'hue-rw')

Apache License, Version 2.0 http://www.apache.org/licenses/LICENSE-2.0