LaserMix
[CVPR 2023 Highlight] LaserMix for Semi-Supervised LiDAR Semantic Segmentation
Install / Use
/learn @worldbench/LaserMixREADME
About
<strong>LaserMix</strong> is a semi-supervised learning (SSL) framework designed for LiDAR semantic segmentation. It leverages the strong <strong>spatial prior</strong> of driving scenes to construct <strong>low-variation areas</strong> via <strong>laser beam mixing</strong>, and encourages segmentation models to make <strong>confident</strong> and <strong>consistent</strong> predictions before and after mixing.
<br> <p align="center"> <img src="docs/figs/laser.png" align="center" width="50%"> <br> Fig. Illustration for laser beam partition based on inclination φ. </p> <br>Visit our <a href="https://ldkong.com/LaserMix" target='_blank'>project page</a> to explore more details. :red_car:
:books: Citation
If you find this work helpful, please kindly consider citing our papers:
@inproceedings{kong2023lasermix,
title = {{LaserMix} for Semi-Supervised {LiDAR} Semantic Segmentation},
author = {Kong, Lingdong and Ren, Jiawei and Pan, Liang and Liu, Ziwei},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
pages = {21705-21715},
year = {2023}
}
@article{kong2025multi,
title = {Multi-Modal Data-Efficient {3D} Scene Understanding for Autonomous Driving},
author = {Kong, Lingdong and Xu, Xiang and Ren, Jiawei and others},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
volume = {47},
number = {5},
pages = {3748-3765},
year = {2025}
}
Updates
- [2024.05] - Our improved framework, LaserMix++ :rocket:, is avaliable on arXiv.
- [2024.01] - The toolkit tailored for The RoboDrive Challenge has been released. :hammer_and_wrench:
- [2023.12] - We are hosting The RoboDrive Challenge at ICRA 2024. :blue_car:
- [2023.12] - Introducing FRNet, an efficient and effective real-time LiDAR segmentation model that achieves promising semi-supervised learning results on
SemanticKITTIandnuScenes. Code and checkpoints are available for downloading. - [2023.03] - Intend to test the robustness of your LiDAR semantic segmentation models? Check our recent work, :robot: Robo3D, a comprehensive suite that enables OoD robustness evaluation of 3D segmentors on our newly established datasets:
SemanticKITTI-C,nuScenes-C, andWOD-C. - [2023.03] - LaserMix was selected as a :sparkles: highlight :sparkles: at CVPR 2023 (top 10% of accepted papers).
- [2023.02] - LaserMix was accepted to CVPR 2023! :tada:
- [2023.02] - LaserMix has been integrated into the MMDetection3D codebase! Check this PR in the
dev-1.xbranch to know more details. :beers: - [2023.01] - As suggested, we will establish a sequential track taking into account the LiDAR data collection nature in our semi-supervised LiDAR semantic segmentation benchmark. The results will be gradually updated in RESULT.md.
- [2022.12] - We support a wider range of LiDAR segmentation backbones, including RangeNet++, SalsaNext, FIDNet, CENet, MinkowskiUNet, Cylinder3D, and SPVCNN, under both fully- and semi-supervised settings. The checkpoints will be available soon!
- [2022.12] - The derivation of spatial-prior-based SSL is available here. Take a look! :memo:
- [2022.08] - LaserMix achieves 1st place among the semi-supervised semantic segmentation leaderboards of nuScenes, SemanticKITTI, and ScribbleKITTI, based on Paper-with-Code. :bar_chart:
- [2022.08] - We provide a video demo for visual comparisons on the SemanticKITTI val set. Take a look!
- [2022.07] - Our paper is available on arXiv, click <a href="https://arxiv.org/abs/2207.00026" target='_blank'>here</a> to check it out. Code will be available soon!
Outline
- Installation
- Data Preparation
- Getting Started
- Video Demo
- Main Results
- TODO List
- License
- Acknowledgement
- Citation
Installation
Please refer to INSTALL.md for the installation details.
Data Preparation
Please refer to DATA_PREPARE.md for the details to prepare the <sup>1</sup>nuScenes, <sup>2</sup>SemanticKITTI, and <sup>3</sup>ScribbleKITTI datasets.
Getting Started
Please refer to GET_STARTED.md to learn more usage about this codebase.
Video Demo
| Demo 1 | Demo 2| Demo 3 | | :-: | :-: | :-: | | <img width="100%" src="docs/figs/demo1.png"> | <img width="100%" src="docs/figs/demo2.png"> | <img width="100%" src="docs/figs/demo3.png"> | | Link <sup>:arrow_heading_up:</sup> | Link <sup>:arrow_heading_up:</sup> | Link <sup>:arrow_heading_up:</sup> |
