Optimization of the flow in a robotized food production chain.

System regrouping machine vision, optimization and robot control to optimizing the flow of items on a conveyor belt.

Robot arm with vision system

• Image acquisition of 3 food/ingredients container.

• Processing of ingredients level (in pixels) within the 3 containers.

• Data communication server (socket) to exchange data between processes

• Optimization of the robot positioning depending (not only) of containers level and ingredients flow

• Timing of the command to be sent to the robot, provided by the optimization algorithm

• Data reception for vision and Serving to Robot control

• Robot control depending of the optimization commands

• Data reception process

System architecture

• Ashhadul Islam (Ph.D Student)
• Brenno Castrillon Menezes (Assistant Professor)
• Maxime Clement (Software Engineer)
• Mohammad Yaqot (Ph.D Student)
• Robert Eduard Franzoi Junior (PostDoc)
• Shaymaa Fawzi M. Khalifa (Software Engineer)

• OpenCV
• IMPL
• ZeroMQ
• FCN model
• Python