kartik894 Goto Github PK

autospotting

Automatically replace AWS EC2 instances in AutoScaling groups with identically configured but up to 90% cheaper spot instances

avro

Apache Avro is a data serialization system.

endofday-feeder-for-kdb-tickerplant

A mock kdb+ tickerplant setup with a python batch feeder

forensic-browser

A modified Firefox browser to log a series of JavaScript executions for fingerprinting detection

hadoop-sched

Hadoop is an open-source implementation of MapReduce enjoying wide adoption and is often used for short jobs where low response time is critical. Hadoop’s performance is closely tied to its task scheduler, which implicitly assumes that cluster nodes are homogeneous and tasks make progress linearly, and uses these assumptions to decide when to speculatively re-execute tasks that appear to be stragglers. In practice, the homogeneity assumptions do not always hold. MapReduce uses speculative execution to improve fault tolerance. Current Hadoop implementation decides whether to run speculative tasks based on the progress rates of running tasks, which does not take into consideration the absolute progress of each task. The modified Hadoop framework was deployed in 6 t2.medium EC2 instances in a master-slave configuration.

heron-multinode-setup

Heron multinode setup instructions

intro-to-math-logic

mesosphere-coding-challenge

Coding challenge for Distributed Systems Engineer recruitment

nirmaanactivitymanager

An activity manager for an NGO - Nirmaan at BITS Pilani, Goa

nlp

spot-bid-broker

EC2 spot instance launcher for a given bid and uptime

strata

Strata: A Cross Media File System