āØ Welcome to my Special repository āØ
š±I am Muhammad Mudassir Raza Complete Bachelors in Computer Science.
šļø Iām working as Python Developer and Data Engineer from last one year
š Iām interested in solution of problems related to python,ETL Pipeline , DataWare Housing.
šÆāāļø I'm looking to collaborate on open soure projects Data Engineer and Cloud (AWS , GCP).
. Python
. Scraping (requests, Beautiful soup, scrappy, Selenium)
. SQL (PostgreSQL, MySQL).
. NoSQL (MongoDB)
. Airflow, cron job
. ETL Pipelines and Data Warehouse and Data Modeling.
. Apache spark (SparkSQL and Pyspark)
. Kafka (Batch and stream processing)
. AWS (Glue, EC2, S3 bucket, Athena, AWS lambda,IAM Roles and policies, AWS Data Brew, AWS Quick Sight)
. Backend (Flask, Fast Api, Django)
. Data Visualization (Pandas,Matplotlib,Seaborn)
. Streamlit
. GCP ( compute engine VM ,python , jupyternotebook and Vertex AI, Google Cloud Storage , Google Cloud Bucket , Cloud Function)
. AWS Databricks
. Snowflake
. DBT Cloud
. Docker and Docker compose
. DevOPs and CI/CD and Microservices
. Git, Linux and Shell Scripting
. LLM (GPT-4 Turbo ,Dall-e-3 for image generation)
. Jira, Click up and Teaching Programming and Computer Science.
- Data_Orchestation_With_Airflow (2024)
Click Here
- PERSONALIZED DIGITAL MATERIAL MAKING APP USING LLM MODEL IN NEXT GPT HACKATHON (2024)
Click Here
- CRYPTO DATA ANALYTICS
Click Here
- REAL-TIME ROOM OCCUPANCY DETECTION
Click Here
- Data Transforamtion Kafka-Pyspark-docker
Click Here)
- STOCK MARKET DATA ANALYTICS
Click Here
- CRYPTO DATA ANALYTICS WITH DOCKER
Click Here
- PIPELINE DATA WITH AIRFLOW AND DISPLAY FINANCIAL CONSUMER REPORT ON STREAMLIT DASHBOARD
Click Here
- ETL-DWH-USING-PYSPARK AND SCD2 IMPLEMENTATION
Click Here
- SCRAPE ONE MILLION REPOSITORIES USING GCP AND PERFORM EDA AND VISUALIZATION
Click Here
- YOUTUBE DATA ANALYSIS
Click Here
- Essential_SQL_for_Data_Engineers
Click Here'
- Task-NoSQL
Click Here'
- scrape_e-commerce_data_and_dump_in_sql_and_showdata_on_frontend_using_flask
Click Here
- Airline_tickets_data_scrape
Click Here
- Hair_and_Conditioner_data_scrape
Click Here
I am Certified Data Engineer From KarachidotAI . The details of topics and Projects is here
The basic python begineers to advance level practice is here
The python task which i done taken from code with harry is here
The python task which i done take from hakerrank is here
The python task which i done take from code wars is here
The python task which i done take from PIAIC is here
The Crud operation Using Flask is here