A python application to capture the onscreen health data of a game to process onscreen health and send it to hardware device through serial communication.

Python Application Feature :

• Saving different games health bar location / processing information
• Interactive screenshot to get the healthbar / health value co-ordinates
• Customizable serial communication (ports / badu rate selection)
• In built image editor
• Performs OCR on Health value
• Determines Health value based on Health bar

Arduino Application Feautre:

• ESP-NOW integrated
• Reads data from serial
• Drive different addressable RGB leds

• Python 3
• Arduino IDE
• Tessract

• Open CV
• Pillow
• numpy
• pyserial
• pytesseract
• pyautogui

Navigate to the main.py file location and run the command in cmd/power shell.

Python main.py 

Home page - Here select the com port where the device is connected and set the badu rate.

Interactive Screenshot - select the part of the screen where the health bar or health value is located. (Make sure the image/game is full screen when you do this)

Selection of health bar

Selection of health value

Editor Window - Here the images are processed to get the health value by using sliders (threshold, brightness and blur).

Editing for health bar

Editing for health value

• ESP-Core - by Ivan Grokhotkov
• NeoPixel - by Adafruit
• Fast LED

Open the Arduino IDE and follow the below steps:

Sketch -> include library -> ManageLibrary -> *Search for the above libraries*

Or follow the instructions on respective library repository.

Video explanation for hardware/circuit: Youtube link

This is the first version so there are way to many bugs for now, let me know what issues you find. The latency of processing the health value varies dpending on the specs of the PC.

LICENSE.md file for details