cassj / catpaws Goto Github PK

These have a tendency to fail for no particularly good reason and they seem to be fine if you run them again, so break them up so you can run them one by one as needed.

Want to be able to have multiple people working on an analysis and do a pull request in GitHub. If SNAPID is different (which it will be if they've changed the data), merge will fail in git, so to resolve I want to be able to run a snapshot_merge process which will start an EC2 instance, create EBS vols from both snapshots and mount these then compare the contents of the EBS volumes and support the user in merging these. New files can just be copied over, modifed text files can be diff'd and the user can decide how to merge. Binary files - not sure, maybe when the task stuff is better defined we can show the task that created them and the diff of any script run in that task?

Need to be able to define multiple groups with multiple sets of access credentials and so on

get rid of the need for this.

Should poll until snapshot complete?