ozett / esp32cam-ready Goto Github PK

Custom ISP Configuration
Companies with access to the ISP can create a custom ISP file configuration to calibrate correctly a specific sensor based on its own parameters Below is the procedure to follow:

1. When you develop a driver on the Jetson (TX1/TX2/Xavier/Nano) you are able to capture in 2 different ways. One is using the V4L2 standard API with applications such as GStreamer (v4l2src), v4l2-ctl or yavta. This is a direct capture and the Jetson will not do any color conversion or change in the imaging, the format is kept as given by the sensor. The second way is using the NVIDIA proprietary software, such as GStreamer nvcamerasrc/nvarguscamerasrc elements or libargus, when using these applications, the frames will pass through the internal Jetson's ISP, performing the debayering process (conversion from RAW to YUV format) and color conversions/corrections based on ISP configurable parameters.
2. These ISP configurable parameters can be managed and changed in 2 ways, one is using the libargus or nvcamerasrc/nvarguscamerasrc properties and options (run gst-inspect-1.0 nvcamerasrc to see the available properties) such as white balance, auto exposure, saturation and color effects, changing the ISP configuration at runtime and applying filters to the image. The second way is creating a file called camera_overrides.isp, which contains configuration and tuned parameters that the ISP uses to execute the internal algorithms.
3. This camera_overrides.isp file can be created with all the tuned configuration for an specific sensor or scene, in order the images to look exactly how the customer wants them to look. NVIDIA provides access to the creation and tuning of this file only to ODMs such as Leopard Imaging, and they have all the tools and procedures to tune the ISP for any sensor, doing calibration on Black level, Lens shading, White balance and Color correction. RidgeRun doesn't provide support on ISP tuning but only on driver development side.
4. Once the driver is ready and the capture is properly done, in case the customer wants to tune up the image, they can contact Leopard Imaging or D3 Engineering. Leopard Imaging contacts are Simon Zhu ([email protected]), Bill Pu ([email protected]) and Leopard Sales ([email protected]). You can mention RidgeRun recommendation on this task. For D3 Engineering, you can contact them directly or you can send us an email to [email protected] and we will put them in contact with you.
   In order to apply a new ISP calibration you will need to follow next steps:

1. If there are any nvcam_cache_#.bin and serial_no_#.bin files under /var/nvidia/nvcam/settings on Jetson, delete them.

sudo rm /var/nvidia/nvcam/settings/nvcam_cache_*
sudo rm /var/nvidia/nvcam/settings/serial_no_*
2. Copy camera_overrides.isp in the correct location:

cp /camera_overrides.isp /var/nvidia/nvcam/settings
3. Do below commands:

sudo chmod 664 /var/nvidia/nvcam/settings/camera_overrides.isp
sudo chown root:root /var/nvidia/nvcam/settings/camera_overrides.isp