Luis Yamada's Projects
Developer guide documentation for Amazon Kinesis Analytics
A serverless stack capable to collect data from AWS Cost Explorer API and publish as parquet into Amazon S3, serving it as a AWS Glue table for further queries
This repo stores python packages (zipped) and a CloudFormation script to deploy them as AWS Lambda layers
This is a DevOps guideline about how to quickly create an Amazon EKS cluster with all dependencies needed to run a data app, deployed by a CI/CD pipeline built on top of AWS services.
(PT-BR) O objetivo deste projeto é executar uma aplicação Python dentro de um container Docker (ou container Kubernetes utilizando a docker image) para rastrear e monitorar remessas dos correios
This project is related to a series of data analysis related to the worldwide famous tv show 'Game of Thrones', more specifically about all sentences said during the 8 seasons
This project is a POC of data analysis using Streamlit (https://www.streamlit.io/) to support us on the data exploration, reading data from decks built on https://www.hearthpwn.com/ and with help of the open API https://hearthstonejson.com/
Export python script from Jupyter Notebook to runnable .py file
A process for exposing JMX Beans via HTTP for Prometheus consumption
My profile =D
A web scraper + news watcher for monitoring and notifying through e-mail about new chapters of your favorite mangas
(PT-BR) Essa API foi desenvolvida para fornecer dados do endpoint de personagens da Global Marvel API, traduzindo os textos para o português para melhor atender aos usuários brasileiros. Tentando melhorar a experiência do usuário do que usar os dados de tradução da API oficial da Marvel, persistindo em um MariaDB para diminuir as chamadas para a API da Marvel
A python web scrap and data analytics project used to identify key metrics and BI insights about Brazilian Real Estate Investment Fund (aka FIIs)
This AWS Lambda function is capable of decompress the compressed broker logs generated by Amazon MSK clusters (.gz format), parse the data, and save them into Amazon S3 as an AWS Glue table.
This project represents a whole process of Anime data collection, preparation, and delivery as a data app, powered by technologies like Pandas, Jupyter, and Streamlit
Static Website for 99 Jiu Jitsu
A python microservice which runs in loop gathering data from Twitch and Twitter APIs about streamings, followers, and videos. As new events are noticed, the application sends messages to RabbitMQ queues for other applications consume.
This project brings multiple components to build and run a fast data application, messaging broker, streaming service, indexed db and real-time analytics dashboard
Presenting 3 ways to run Spark over containers, this project is recommended to those who seek to explore Big Data out of a Hadoop Cluster.
SQL classes in a very friendly way :)
An application built in Java using Quarkus as its core, to handle the production of events to Apache Kafka topics with high performance, about fake Valorant matches for future use in data pipelines.
Projects repo for tutorials for my YouTube Channel
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent