Awesome Road Environment Segmentation

Captured from Cityscapes (https://www.cityscapes-dataset.com/examples/)

Networks by architecture

DeepLabv3+ paper

• [Tensorflow] https://github.com/tensorflow/models/tree/master/research/deeplab
• [Tensorflow] https://github.com/tantara/JejuNet
• [Tensorflow] https://github.com/parachutel/deeplabv3plus_on_Mapillary_Vistas
• [Keras] https://github.com/bonlime/keras-deeplab-v3-plus
• [Keras] https://github.com/Golbstein/Keras-segmentation-deeplab-v3.1
• [PyTorch] https://github.com/jfzhang95/pytorch-deeplab-xception
• [PyTorch] https://github.com/y-ouali/pytorch_segmentation
• more...

HRNetV2 paper

• [PyTorch] https://github.com/openseg-group/openseg.pytorch
• [PyTorch] https://github.com/PkuRainBow/OCNet.pytorch
• [PyTorch] https://github.com/HRNet/HRNet-Semantic-Segmentation
• more...

Datasets

Name	Categories	Volume	Link
Cityscapes	road, sidewalk, guard rail, ...	30 classes / 25,000 images	Features
Mapillary (Vistas)	road, curb, barrier, wall, ...	152 classes / 25,000 images	Features
A2D21)	road, sidebars, curbstone, ...	38 classes / 41,280 images	Features
ApolloScape (Scene Parsing)	road, sidewalk, fence, ...	37 classes / 74,555 images	Features
DeepDrive2)	road, sidewalk, guard rail, ...	40 classes / 10,000 images	Features
KITTI2)	road, sidewalk, guard rail, ...	34 classes / 400 images	Features

1. A2D2: AEV(Audi Electronics Venture) Autonomous Driving Dataset

2. Class code inspired by 'cityscapes'. (ref.)

Annotation tools

• https://github.com/wkentaro/labelme
• https://github.com/labelbox/labelbox
• https://github.com/abreheret/PixelAnnotationTool
• https://github.com/buni-rock/Pixie
• http://www.robots.ox.ac.uk/~vgg/software/via/via.html
• https://github.com/opencv/cvat

Getting Started Guide

• A Keras Pipeline for Image Segmentation
• A Beginner's guide to Deep Learning based Semantic Segmentation using Keras
• Example of semantic segmentation in Keras

Benchmarks

• Papers with code: https://paperswithcode.com/task/semantic-segmentation
• Cityscapes: https://www.cityscapes-dataset.com/benchmarks/#scene-labeling-task
• KITTI: http://www.cvlibs.net/datasets/kitti/eval_semseg.php?benchmark=semantics2015
• WildDash: http://www.wilddash.cc/benchmark/summary_tbl?hc=semantic_rob
• Robust Vision Challenge: http://www.robustvision.net/leaderboard.php?benchmark=semantic
• MIT Scene Parsing Benchmark: http://sceneparsing.csail.mit.edu/

Evaluation of benchmarks

• Cityscapes: https://github.com/mcordts/cityscapesScripts
• Mapillary: https://github.com/mapillary/mapillary_vistas
• DeepDrive: https://github.com/ucbdrive/bdd-data/blob/master/bdd_data/evaluate.py
• MIT: https://github.com/CSAILVision/sceneparsing/tree/master/evaluationCode

Papers, blog posts and others

Papers

• [DeepLabv1, 2015] Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
• [DeepLabv2, 2017] DeepLab : Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
• [DeepLabv3, 2017] Rethinking Atrous Convolution for Semantic Image Segmentation
• [DeepLabv3+, 2018] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
• [HRNetV2, 2019] Object-Contextual Representations for Semantic Segmentation

Blog posts

• DeepLab V3+: Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
• DeepLabv3: Semantic Image Segmentation
• DeepLabv3+ on your own dataset
• Xception: Deep Learning with Depthwise Separable Convolutions
• Semantic Segmentation (FCN, Fully Convolutional Network)
• Semantic Segmentation: Introduction to the Deep Learning Technique Behind Google Pixel’s Camera!

Awesome series

• https://github.com/mrgloom/awesome-semantic-segmentation
• https://github.com/nightrome/really-awesome-semantic-segmentation
• https://github.com/Tramac/awesome-semantic-segmentation-pytorch

Reference repositories

• https://github.com/GeorgeSeif/Semantic-Segmentation-Suite
• https://github.com/MSiam/TFSegmentation
• https://github.com/qubvel/segmentation_models
• https://github.com/divamgupta/image-segmentation-keras
• https://github.com/NVIDIA/semantic-segmentation

Others

• Semantic Segmentation Datasets for Urban Driving Scenes
• Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving
• List of annotation tools for machine learning research
• Annotation tools for building datasets
• Machine learning datasets
• The Berkeley Artificial Intelligence Research Blog