kislayer Goto Github PK

followers: 2.0 following: 3.0 repos: 39.0 gists: 0.0

Name: Kisalaya Kishore

Type: User

Bio: Data Engineer , IIITA'22

Location: Allahabad

Blog: http://kislaykishore.in/

Hi! I'm Kisalaya

Data Engineer at Sapper.AI , Ex- Data Engineer at Walmart

About Me :

I am working as a Data Engineer. I develop many data engineering projects using the below tools and frameworks. I always start working on the projects and jobs with a can-do approach. I always learn the best practices to increase efficiency and apply them while handling the tasks. I am a strong believer of sustainability and we, as data engineers, should complete the tasks as sustainable as possible. I also believe that theoretical part of the data is quite important. That's why I always learn and keep myself up-to-date about the principles of distributed computing, big data applications, how to handle the streaming data, scheduling/orchestrating the pipelines, working principles of cloud environments and many other topics. While doing those, I also develop myself in coding especially at Python and SQL. I create many complicated Python scripts as well as many SQL queries. You can find lots of data engineering projects here, welcome to my GitHub :)

Connect with me:

Tech Stack:

Kisalaya Kishore's Projects

airbnb-dbt-data-pipeline

airflow_kafka_cassandra_mongodb

Produce Kafka messages, consume them and upload into Cassandra, MongoDB.

androidstudiobenchmark

Firefox Focus: The privacy browser - Browse like no one’s watching.

apache-beam-pipeline-to-load-csv-data-into-a-postgresql-table

This sample project aims at loading data from a csv file into a PostgreSQL

apache-spark-demo

scala-spark-demo

awesome-competitive-programming

:gem: A curated list of awesome Competitive Programming, Algorithm and Data Structure resources

benchpython

calculatornode

A calculator using node.js and express.js using own server

cnn-benchmarks

Benchmarks for popular CNN models

compact-iiita

Compact - IIITA

covid19-classifier-using-cnn-and-svm

cssprojects

Using css with html making basic websites

cv2ndyearend

My CV as of 2nd Year

data-engineering-streaming-project

data-streaming-project

used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline

deepfacex

DeepFaceLab is the leading software for creating deepfakes.

dockerized-airflow-spark

A end to end ETL pipeline with airflow, pyspark and docker.

dpq

dpq is an open-source python library that makes prompt-based data transformations and feature engineering easy

drumfun

Javascript application with sound implementation

e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

hotel-website

Development of a hotel website

htmlprojects

Exploring basic functionality of HTML5

indoor-scene-recognition

javatest

kafka_spark_structured_streaming

Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra

kislayer

PF layout

no-spark-pipeline

This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power BI.