ObjFormer

<div align="center"> <h1 align="center">ObjFormer</h1> <h3>Learning Land-Cover Changes From Paired Map Data and Optical Imagery via Object-Guided Transformer </h3>

Hongruixuan Chen^1,3, Cuiling Lan², Jian Song^1,3, Clifford Broni-Bediako³, Junshi Xia³, Naoto Yokoya^{1,3 *}

¹ The University of Tokyo, ² Microsoft Research Asia, ³ RIKEN AIP, ^* Corresponding author

Overview | Get Started | Taken Away | Common Issues | Others

</div>

🛎️Updates

• Notice: ObjFormer has been accepted by IEEE TGRS! We will upload the dataset and code soon. We'd appreciate it if you could give this repo a ⭐️star⭐️ and stay tuned!!
• Nov. 04nd, 2024: We have updated the code for benchmark, including code for some of the models as well as training and evaluation scripts. You are welcome to download and use them!
• July 01st, 2024: We have uploaded OpenMapCD dataset. You are welcome to download and use it!

🔭Overview

• OpenMapCD is the first benchmark dataset for multimodal change detecton tasks on optical remote sensing imagery and map data, with 1,287 samples from 40 regions across six continents, supoorting both binary and semantic change detection.

• ObjFormer serves as a robust and efficient benchmark for the proposed multimodal change detection tasks by combining OBIA techniques with self-attention mechanisms.

<img src="./fig/Overall_framework.jpg">

📋To Do List

• [ ] Release the ObjFormer code
• [x] Release the benchmark training and evalution code
• [x] Release the OpenMapCD dataset
• [x] Release the ObjFormer & OpenMapCD paper

🗝️Let's Get Started!

A. Installation

Step 1: Clone the repository:

Clone this repository and navigate to the project directory:

git clone https://github.com/ChenHongruixuan/ObjFormer.git
cd ObjFormer

Step 2: Environment Setup:

It is recommended to set up a conda environment and installing dependencies via pip. Use the following commands to set up your environment:

Create and activate a new conda environment

conda create -n objformer
conda activate objformer

Install dependencies

pip install -r requirements.txt

B. Data Preparation

Download OpenMapCD dataset from Zenodo and put it under the [dataset] folder. It will have the following structure:

${DATASET_ROOT}   # Dataset root directory
├── Benchmark
│   │
│   ├── OPT     # Optical remote sensing images
│   │   ├──aachen_1.png
│   │   ├──aachen_2.png
│   │   ...
│   │
│   ├── OSM     # OpenStreetMap data
│   │   ├ ... 
│   │
│   ├── LC_GT_OPT  # Land-cover labels of optical images	
│   │   ├ ... 
│   │     
│   ├── LC_GT_OSM  # Land-cover labels of OSM data
│   │   ├ ... 
│   │     
│   ├── BC_GT   # Binary change detection labels
│   │   ├ ... 
│   │
│   ├── SC_GT   # Semantic change detection labels
│   │   ├ ... 
│   │  
│   ├── train_list.txt   # Data name list, recording all the names of training data
│   └── test_list.txt    # Data name list, recording all the names of testing data  
│   
└── Application
    ├── ...
    ...

C. Model Training

Binary change detection

The following commands show how to train and evaluate the benchmark model on the OpenMapCD dataset for binary change detection:

python script/train_benchmark_bcd.py --dataset_path '<your project path>/dataset/OpenMapCD/benchmark' \
                                     --batch_size 16 \
                                     --crop_size 512 \
                                     --max_iters 7500 \
                                     --train_data_list_path '<your project path>/dataset/OpenMapCD/benchmark/train_list.txt' \
                                     --eval_data_list_path '<your project path>/dataset/OpenMapCD/benchmark/eval_list.txt' \
                                     --model_param_path '<your project path>saved_weight' \
                                     --learning_rate 1e-4 \
                                     --weight_decay 5e-3 \
                                     --model_type 'FCEF' 

Semantic change detection

The following commands show how to train and evaluate the benchmark model on the OpenMapCD dataset for semantic change detection:

python script/train_benchmark_scd.py  --dataset_path '<your project path>/dataset/OpenMapCD/benchmark' \
                                      --batch_size 16 \
                                      --crop_size 512 \
                                      --max_iters 10000 \
                                      --train_data_list_path '<your project path>/dataset/OpenMapCD/benchmark/train_list.txt' \
                                      --eval_data_list_path '<your project path>/dataset/OpenMapCD/benchmark/eval_list.txt' \
                                      --model_param_path '<your project path>/saved_weight' \
                                      --learning_rate 1e-4 \
                                      --weight_decay 5e-3 \
                                      --model_type 'HRSCD-S4_RCE' 

📜Reference

If this code or dataset contributes to your research, please kindly consider citing our paper and give this repo ⭐️ :)

@ARTICLE{Chen2024ObjFormer,
  author={Chen, Hongruixuan and Lan, Cuiling and Song, Jian and Broni-Bediako, Clifford and Xia, Junshi and Yokoya, Naoto},
  journal={IEEE Transactions on Geoscience and Remote Sensing}, 
  title={ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer}, 
  year={2024},
  volume={62},
  number={},
  pages={1-22},
  doi={10.1109/TGRS.2024.3410389}
}

🔗Other links

If you are interested in land-cover mapping and domain adaptation in remote sensing using synthetic datasets, you can also follow our three datasets below.

• OpenEarthMap dataset: a benchmark dataset for global sub-meter level land cover mapping.

• SyntheWorld dataset: a large-scale synthetic remote sensing datasets for land cover mapping and building change detection.

• SynRS3D dataset: a large-scale synthetic remote sensing datasets for global 3D semantic uploadnderstanding.

🙋Q & A

For any questions, please contact us.