Code Monkey home page Code Monkey logo

elastic-search-setup's Introduction

elastic-search-setup

Scripts to install and run an elastic search cluster with kibana

setup

  1. aws cli installed
  2. jq installed

At time of writing there is no single script that will run the whole setup BUT you can run each of the scripts in order at which point you should be able to access you elastic search kibana data on port 5601 from the master node

The scripts rely on a central configuration.json file that holds the data the scripts will use. An example of the script is below

requirements

  1. A VPC on amazon
  2. A subnet under that VPC
  3. An S3 bucket

The configuration file that needs to be updated is described below

{
  "vpc-id": "vpc-xxxxx",                              # The VPC id that you wish the cluster to be deployed to
  "region": "us-east-1",                              # The region of the cluster
  "availability-zone": "us-east-1a",                  # The availability zone 
  "security-group-name":"elastic-search-test",        # The name you want for your security group
  "subnet-id": "subnet-xxxx",                         # The subnet id 
  "base-ami": "ami-xxxx",                             # The Amazon base AMI (Can be found in the console, I use ubuntu)
  "role-name": "elastic-search-role-test",            # The name you want your IAM Role to be
  "key-name": "elastic-dev-test",                     # The name of your PEM key that will be downloaded for accessing the instance
  "s3-bucket-name": "xxxx",                           # The name of your S3 bucket (you will have to have this created)
  "target-image-name": "elasticsearch-image-test",    # The name you want for your image that all instances will be created from
  "data-node-count": 2,                               # The number of data nodes
  "master-node-count": 1,                             # The number of master nodes
  "name": "elasticsearch-test"                        # The name of your cluster
}

To do's

  1. Use directories to tidy up
  2. Check if the volume setup is correct for elastic search
  3. Can kibana run on all master nodes?
  4. Multiple regions?
  5. Route 53 dns creation to master nodes
  6. If more than 1 master node we need an ELB
  7. nginx

elastic-search-setup's People

Contributors

rgparkins avatar

Stargazers

Marouani.Zied avatar Boris Gelfandbein avatar Michael Smyers avatar Daniel avatar

Watchers

 avatar James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.