A CLI tool facilitating experimentation on AWS.
It is recommended to install the package with pip3.
pip3 install exp-kit - Python 3.5+
- MongoDB
- AWS credentials used by AWS CLI. Below is a quick fix.
pip install awscli
aws configure- Create the file
~/.exp-kit/config.jsonwith configurations as follows.
{
// key pair name on AWS
"key_name": "key-pair-name",
// path to your private key
"key_path": "/path/to/key-pair-name.pem",
// public key associated with your key pair
"public_keys": [ "ssh-rsa XXXX key-pair-name" ]
// IAM role to create spot request
"iam_fleet_role": "something:like:this::<aws-id>:role/aws-ec2-spot-fleet-tagging-role",
// host of MongoDB uri
"mongo_host": "localhost",
// port of MongoDB uri
"mongo_port": 27017
}exp-kit new -c cluster_configuration.json
A sample cluster_configuration.json looks as follows.
{
// identifier of the cluster
"name": "cluster",
// number of nodes
"size": 3,
"instance_type": "m4.large",
// following two can be found in AMI section of EC2 page
"image_id": "ami-a51f27c5",
"snapshot_id": "snap-0907c7634681bc477",
// group_id can be found in Security Group section of EC2 page
"security_group_id": "sg-c36280ba",
// size in gigabytes
"disk_size": 20,
"spot_price": 0.251,
// default username of the image
"user_name": "ec2-user"
}The instance_type can include multiple types. They will be evenly distributed in the cluster, i.e., the number of instances of each type will roughly be the same.
{
"instance_type": [ "m4.large", "m3.large", "m4.xlarge", "m3.xlarge" ]
}exp-kit rm <cluster_name>
To list all clusters, use ls command directly.
exp-kit ls
To inspect a specific cluster, add its name as an option.
exp-kit ls <cluster_name>
- A cluster is created with a spot fleet request. Therefore, you can terminate is via AWS console.
- By default,
masteris the first instance of the instances list stored in MongoDB. - All nodes can login to each other via SSH without password.
- On each node,
~/machinefilelists the IP address and hostname of all other nodes except themaster.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent