Coral Edge TPU compilable version of DeepLab v3 and DeepLab v3 Plus implemented in tf.keras with pretrained weights and Edge TPU pre-compiled models included.

Implementation follows original paper as close as possible, while still being compatible with Edge TPU. The only difference is that last upsampling layer has been removed from decoder due to performance reasons. Thanks to multi subgraph support in edgetpu_compiler, model runs almost all operations on TPU, where original model delegates entirety of decoder to run on CPU.

Thanks to pretrained weights and tf.keras implementation it's easy to fine tune this model, or even train it from scratch.

pip install git+https://github.com/xadrianzetx/coral-deeplab.git

You can train from scratch...

import tensorflow as tf
import coral_deeplab as cdl

model = cdl.applications.CoralDeepLabV3()
isinstance(model, tf.keras.Model)
# True

...finetune...

import tensorflow as tf
import coral_deeplab as cdl

model = cdl.applications.CoralDeepLabV3(weights="pascal_voc")
isinstance(model, tf.keras.Model)
# True

...or just pull pre-compiled Edge TPU models straight to interpreter (can use --no-deps for lightweight install).

import coral_deeplab as cdl
import tflite_runtime.interpreter as tflite

interpreter = tflite.Interpreter(
    cdl.from_precompiled(cdl.pretrained.EdgeTPUModel.DEEPLAB_V3_DM1),
    experimental_delegates=[tflite.load_delegate("libedgetpu.so.1")]
)

Use edgetpu_compiler version 14.1 or 15.0 to compile finetuned or trained from scratch models. Correct version can be obtained by running ./compiler/compiler.sh or here.

All models have been tested with 513x513 input on fresh install of Raspbian GNU/Linux 10 (buster).

From left: original image, DeepLab v3 (google), DeepLab v3 (this). All segmentation masks were produced with Edge TPU.

• Chen et al., 2017, Rethinking Atrous Convolution for Semantic Image Segmentation
• Chen et al., 2018, Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation