Bigdata Helm Charts

Collection of Kubernetes Big Data ecosystem products helm charts

Install helm

Installs client and tiller(server side) helm component.

kubectl create clusterrolebinding add-on-cluster-admin --clusterrole=cluster-admin --serviceaccount=kube-system:default
helm init --tiller-image=art-hq.intranet.qualys.com:5001/k8s.gcr.io/kubernetes-helm/tiller:v2.9.1

Order to bootstrap big data cluster

1. rook-operator - Creates a custom Kubernetes resource with Rook operator.
2. rook-cluster - Installs CEPH on your k8s cluster and creates an object store, external dashboard, toolbox, and external gateway.
3. postgresql - Creates PostgreSQL database for Hive metastore. (need to create /mnt/ for hostpath, will fail to start)
4. alluxio - Creates Alluxio cluster with 1 master and workers.
5. spark - Creates spark: spark master, workers, and proxy.
6. zeppelin - Creates Zeppelin notebook.
7. spark-hadoop - Creates spark with hadoop and hive 1.2.1: master, workers, and proxy.
8. hiveserver - Creates hive server 2 (you need to have postgres metastore and hive user setup).
9. openfaas - Creates OpenFaaS on kubernetes cluster (serverless functions)

Configure s3cmd to work with CEPH directly

Create config file and replace following variables.

Configuration template - s3cmd.cfg.template

kubectl -n rook-ceph exec -it rook-ceph-tools bash
radosgw-admin user create --uid=<username> --display-name=<username>
mv s3cmd.cfg.template s3cmd.cfg
vim s3cmd.cfg                               # substitute variables
s3cmd -c s3cmd.cfg ls

FAQ

How to delete rook-ceph namespace if it is stuck in terminating stage?

Removal of ThirdPartyResources solves the problem.

kubectl patch crd clusters.ceph.rook.io -p '{"metadata":{"finalizers": []}}' --type=merge

How to verify that Rook completely removed?

Run the following commands and check the output.

kubectl get sa --all-namespaces
kubectl get cm --all-namespaces
kubectl get crd
kubectl get ns