Using thrieu's darkflow, I trained a custom set of YOLOv2 weights to detect and highlight M1 Abrams tanks in a given image or video. This project is a continuation of my previous project, where I built an image classifier to detect M1 Abrams tanks in a given image.

The massive amount of photos and videos uploaded to social media today from conflict zones has provided opportunities for creative and new types of research and analysis. Experts such as those at Bellingcat and Armament Research Services have proven the power of this new type of open-source information in their analysis on everything from chemical weapons attacks to the capabilities of various armed opposition groups in Syria.

In some cases, these arms control experts spend hours sifting through battlefield footage and pictures to assess what types of weapons each combatant is using. This work is essential in ensuring that weapons legally sold or transferred from one country to another are not then sold or otherwise transferred to potentially unintended third-party users.

One of the more alarming such incidents occurred in Iraq in 2015 when Kata'ib Hezbollah, an Iraqi Shia militia group sanctioned as a terrorist organization by the US Treasury, uploaded a video to YouTube showing that an M1 Abrams tank had come into their possession. The United States had sold these main battle tanks to the Iraqi Army over the past decade, but it is unclear then how Kata'ib Hezbollah came to be in possession of one of them.

A YOLO model trained on images of high-risk weapons systems, in this case, M1 Abrams tanks, can help open source arms trackers monitor end-user issues and accelerate their research process.

I used the Fatkun Batch Download Image extension for Google Chrome to download the results of a Google Image search. The resulting dataset required manual cleaning as the downloader is rather brute force and Google Image searches were often polluted with images of non-Abrams tanks. In total, I have 1291 images of M1 Abrams tanks that I manually annotated with the RectLabel app.

I trained the model for 5125 steps/64 epochs using Google Colaboratory's free GPU compute. The model's loss leveled off around 1.5.

The model is able to detect M1 Abrams in all of the test photos, although with a low degree of confidence.

https://youtu.be/TGagMXkKJ4E

https://youtu.be/S9IXBASPzag