This is the repository for CS441 final project.
S.No. | First Name | Last Name | UIN | |
---|---|---|---|---|
1 | Ragavee | Poosappagounder Kandavel | 660425677 | [email protected] |
2 | Smrithi | Balki | 668488598 | [email protected] |
3 | Ramiya Shree | Seshiah | 660418618 | [email protected] |
4 | Anandavignesh | Velangadu Sivakumar | 662139789 | [email protected] |
5 | Lakshmanan | Meiyappan | 671997054 | [email protected] |
The goal of this course project is to create a streaming data by designing and implementing an actor-model service using Akka that ingests log file generated data in real time and delivers it via an event-based service called Kafka to Spark for further processing.
The project has been completed under the leadership by Ragavee Poosappagounder Kandavel. Ragavee Poosappagounder Kandavel, Ramiya Shree Seshiah, and Anandavignesh Velangadu Sivakumar worked on setting up Log Generator in the EC2 instances, Akka actors to monitor log changes and AWS MSK Kafka streams. Smrithi Balki and Lakshmanan Meiyappan worked on AWS MSK Kafka streams, processing and aggregating the log file changes in Spark and finally, email notification service after processing.