jdpdev / birbcam Goto Github PK

Add configuring the intervals between live and full pictures to config.ini

• Live picture interval
• Full picture interval

Add configuration of the minimum contour area threshold to config.ini

After evaluating a photo with Birbvision, save the results with the photo

For each photo, save a file with the information:

• Location of full-resolution image
• Location of thumbnail image
• Top X number of predictions with label and confidence

The server can utilize these files to serve images and metadata

Use Birbvision to determine if a bird is in a photo, and do not save photos without birds

Add a simplified version of the debug console that only shows the control section

The Birbvision model expects the bird to be prominent in the image, but images from the camera are often not bird-centered. So instead of passing one image, segment it into parts that separately get classified.

Assuming the source image is big enough, divide the image into three sections with overlap:

• 50% width on left side
• 50% width on right side
• 50% width centered

Concerns

• Performance
  • Early indication is that classifying on a single image isn't much of a burden

Whenever the monitor takes a photo, run it through Birbvision for ML evaluation

This task does not involve doing anything with the evaluation

Concerns:

• How does ML evaluation effect performance?
  • Should evaluation be done on a separate thread?

Implement picamerax's lens_shading_table and generate a table for the arducam lenses

Check out openflexure_microscope's implementation of generating the table https://github.com/rwb27/openflexure_microscope_software/blob/better_shading_correction/openflexure_microscope/utilities/recalibrate.py

Adjust exposure automatically to try to maintain a target level.

• Use the exposure set by user as the target
• Evaluate every configured amount of time

Configure the threshold value

Describe the bug
App crashes when trying to write to the picture log when the picture log has become too big

To Reproduce
Crash point appears to be when the picture log is a little north of 1 MB, and the crash happens when attempting to write to it.

Raspberry Pi (please complete the following information):

• OS: Buster

Additional context
When this happens, the whole drive the picture log resides on is set to read-only access.

PiCamera offers motion estimation and the PiMotionAnalysis class. Evaluate if this data can be used to weed out false positives from the detector from things like swaying of the feeder.

Add configuration of output image sizes to config.ini

• Full image size
• Live image size
• Thumbnail image size

Need to integrate with camera modes? https://www.raspberrypi.org/documentation/raspbian/applications/camera.md

Currently, automatic exposure adjustment only uses shutter to match the exposure. ISO adjustment can be used to expand the range of the adjustment, improve image quality, and minimize use of less useful shutter speeds.

Concerns:

• One stop of ISO is a big change, but smaller increments may not be as useful as small shutter increments
• Need to determine logic for deciding whether to change ISO
  • Configure a range of optimal shutter speeds?
• After adjusting ISO the direction of shutter movement may need to be reversed