Can one access both frames from the OPQV-dual stream and output the difference in real time? about picamera HOT 2 OPEN

It's not subsequent frames, it's different resolutions of the same frame.

The H264 codec needs to do a motion search, so it does a coarse search against a lower resolution version of the image to get roughly the right candidate, and then a fine search to refine that.

And no, there is no way to unpack the MMAL_ENCODING_OPAQUE buffers from the ARM side. It includes a handle to the buffer, but that uses a lookup which only exists on within the firmware.

from picamera.

Thank you so much - that makes sense.
I am doing something simple with python and cv2, keeping track of the prior frame and doing an absolute value subtraction for each frame.
I wonder if doing something with custom encoders would be a better solution, would greatly value your input but I understand if this is beyond the scope of the current question and if you don't have time to consider it!

# capture  and prior_frame are initialized to be numpy arrays that are the size of the frame
for frame in camera.capture_continuous(capture, use_video_port_true, format = 'bgra'):
  frame_diff = cv2.absdiff(frame, prior_frame)
  # can display or further process that frame_diff
  prior_frame = frame.copy()

from picamera.