360Tracking
A visual tracker supporting 360 (omnidirectional) videos in equirectangular projection
Install / Use
/learn @HuajianUP/360TrackingREADME
360Tracking
A simple tool based on SiamX for visual object tracking using normal or 360 images (euqirectangular projection). SiamX is an efficient long-term tracker achieving state-of-the-art results and runs at higher speed. If you are interested in the tracker SiamX, you could read the paper and find more detail in our project page. In this repository, it only exploits the network architecture of SiamX while does not contain the code for training and dataset evaluation.
<img src="360tracking_demo.gif" alt="demo" width=2850>Set up environment
cd $360Tracking
conda env create -f environment.yml
conda activate 360tracking
Download trained SiamX model
Please download the SiamX model here, and then uncompress and put it in ./SiamX.
Testing
In root path $360Tracking,
python tools/run.py --video YOUR_VIDEO_PATH --tracker omni --resume Your_Snapshot_Path
e.g., python tools/run.py --video ./SiamX/demo.mp4 --tracker omni --resume ./SiamX/snapshot/SiamX.pth
The default --tracker base does not support cross-boundary tracking. If the video is composed of 360 images, you should select --tracker omni for better performance.
You could also download and use our data for testing.
Citation
If you find any part of our work useful in your research, please consider citing our paper:
@inproceedings{hhuang2022siamx,
title = {SiamX: An Efficient Long-term Tracker Using Cross-level Feature Correlation and Adaptive Tracking Scheme},
author = {Huang, Huajian and Yeung, Sai-Kit},
booktitle = {International Conference on Robotics and Automation (ICRA)},
year = {2022},
organization={IEEE}
}
Reference
Related Skills
openhue
349.0kControl Philips Hue lights and scenes via the OpenHue CLI.
sag
349.0kElevenLabs text-to-speech with mac-style say UX.
weather
349.0kGet current weather and forecasts via wttr.in or Open-Meteo
tweakcc
1.6kCustomize Claude Code's system prompts, create custom toolsets, input pattern highlighters, themes/thinking verbs/spinners, customize input box & user message styling, support AGENTS.md, unlock private/unreleased features, and much more. Supports both native/npm installs on all platforms.
