OpenTracker
Real-time C++ ECO tracker etc. speed-up by SSE/NEON, support Linux, Mac, Jetson TX1/2, raspberry pi
Install / Use
/learn @rockkingjy/OpenTrackerREADME
What is OpenTracker?
OpenTracker is an open sourced repository for Visual Tracking. It's written in C++, high speed, easy to use, and easy to be implemented in embedded system.
- AND this is not only boring Codes,
+ It also has Maths and Implement Notes!
If you don't exactly know what this means:
<p align="center"> <img src="images/equation.png", width="480"> </p>Don't worry, it will be explained fully in the Notes. All the maths details of the Not-that-easy algorithms are explaned fully from the very beginning. If you have headache of reading the papers(as most of us have), this is a good tutorial. (Check Notes(draft now)).
Or, if you have problems with the implementation of a complicate cutting-edge algorithms, check this! You will get something!
<p align="center"> <img src="images/Crossing.gif", width="480"> </p> <p align="center"> <img src="images/trackingdemo.gif", width="480"> </p>Attention! OpenTracker is NOT designed just for tracking human beings as the demo images, it can track everything, even some special points!
For Multiple Object Tracker, check: OpenMultiTracker.
2018/11/06 -- New features add CMake compile support for ECO tracker. (Thanks to ou-zhi-hui)
2018/09/19 -- New features Performance tested on VOT2017 dataset!
2018/09/13 -- New features CN feature added!
2018/08/30 -- New features Support Initialize by Object Detection using Darknet and track.
2018/08/27 -- New features Support ECO API.
2018/08/24 -- New features Now ECO runs "almost" real-time on Raspberry Pi 3!
2018/08/24 -- New features Support FFTW.
2018/08/13 -- New features Speed up by multi-thread.
2018/08/09 -- New features Now it supports Raspberry Pi 3, and speed up with NEON!
2018/08/08 -- New features Speed up with NEON, speed up from ~32FPS to ~42FPS on Jetson TX2 with scale one.
2018/08/06 -- New features Speed up with SSE, speed up from ~86FPS to ~102FPS(quicker than matlab version) with scale one.
2018/07/07 -- New features OpenTracker Implement Notes draft published! Check notes/OpenTrackerNotes.pdf. Complete version is comming!
2018/07/06 -- New features Now it supports Nvidia Jetson TX1/2!
2018/07/05 -- New features Now it supports macOS!
2018/06/28 -- New features Now it supports automatic initialization with Web camera using OpenPose!
Supported tracker (more in progressing):
Included | Tracker
-------------------------------------------|---------------
:ballot_box_with_check: | CSK
:ballot_box_with_check: | KCF
:ballot_box_with_check: | DSST
:ballot_box_with_check: | GOTURN
:hammer: | ECO
Supported Dataset (more in progressing):
Included | Dataset | Reference -------------------------------------------|--------------|----------- :ballot_box_with_check: | VOT-2017 | Web :ballot_box_with_check: | TB-2015 | Web :ballot_box_with_check: | TLP | Web :ballot_box_with_check: | UAV123 | Web
Supported Autodetection with Web Camera
Included | Dataset | Reference -------------------------------------------|--------------|----------- :ballot_box_with_check: | OpenPose | Web
Tested Operating Systems / Platform
Included | OS / Platform
---------------------------|-------------
:ballot_box_with_check: | Ubuntu 16.04
:ballot_box_with_check: | macOS Sierra
:ballot_box_with_check: | NVIDIA Jetson TX1/2
:ballot_box_with_check: | Rasperberry PI 3
:hammer: | Windows10
Performance Analysis
<p align="center"> <img src="images/vot2017.png", width=""> </p>"ECOHCMATLAB" is the original matlab full version ECO-HC.
"ECOHCMATLABHOGCN" is the matlab version ECO-HC without fDSST scale filter.
"ECOHCMATLABHOG" is the matlab version ECO-HC without fDSST scale filter and CN feature.
"ECOCPPHOGCN" is the c++ ECO tracker in OpenTracker without fDSST scale filter.
"ECOCPPHOG" is the c++ ECO tracker in OpenTracker without CN feature and fDSST scale filter.
"KCFCPP" is the c++ KCF tracker in OpenTracker.
"NCC" is a demo tracker in vot-toolkit.
The test is on dataset VOT2017, and parameters are set exactly the same as "VOT2016_HC_settings" in matlab version. This is just for proof of validation of c++ version code, thus the parameters are not tuned for VOT2017.
You can see from the plot that, full-featured "ECOHCMATLAB" has the highest performance, "ECOCPPHOGCN" has almost the same performance with "ECOHCMATLABHOGCN", and "ECOCPPHOG" quite similar to "ECOHCMATLABHOG". And "KCFCPP" perform even better than the HOG-only ECO version, so it seems that CN feature matters.
Speed-up(without CN feature)
Included | Method(single thread) | FPS(scale=1) | FPS(scale=7) ------------------------|-------------------------|--------------|------------- :ballot_box_with_check: | Matlab ECO-HOG(Intel i9)| ~73 | ~45 :ballot_box_with_check: | no speed-up(Intel i9) | ~86 | ~36 :ballot_box_with_check: | SSE(Intel i9) |~260:cherries:| ~95:cherries: :ballot_box_with_check: | no speed-up(MacBook Air Intel i5)| ~60 | ~22 :ballot_box_with_check: | SSE(MacBook Air Intel i5)|~140:cherries:|~55:cherries: :ballot_box_with_check: | no speed-up(Jestson TX2)| ~32 | ~10 :ballot_box_with_check: | NEON(Jetson TX2) | ~60:cherries:| ~34:cherries: :ballot_box_with_check: | no speed-up(Raspberrypi)| ~11 | ~3 :ballot_box_with_check: | NEON(Raspberrypi) | ~24:cherries:| ~7.5 :hammer: | GPU | :hammer: | :hammer:
Speed Analysis(without CN feature)
<p align="center"> <img src="images/speedanalysis.png", width=""> </p>Quick start
With quick start, you can have a quick first taste of this repository, without any panic. No need to install Caffe, CUDA etc. (But of course you have to install OpenCV 3.0 first).
OpenCV 3.0 Install on Ubuntu check this [Tutorial].
Quick Run ECO Tracker:
In eco/runecotracker.cc, make sure to choose the dataset Demo:
string databaseType = databaseTypes[0];
Quick start -- Ubuntu
git clone https://github.com/rockkingjy/OpenTracker
cd OpenTracker/eco
make -j`nproc`
sudo make install
./runecotracker.bin
Quick start -- macOS
brew install tesseract
git clone https://github.com/rockkingjy/OpenTracker
cd OpenTracker/eco
make -j`nproc`
sudo make install
./runecotracker.bin
Quick Run KCF and DSST Tracker:
In file kcf/runkcftracker.cc, make sure to choose the dataset Demo:
string databaseType = databaseTypes[0];
Quick start -- Ubuntu
git clone https://github.com/rockkingjy/OpenTracker
cd OpenTracker/kcf
make
./runkcftracker.bin
Quick start -- macOS
brew install tesseract
git clone https://github.com/rockkingjy/OpenTracker
cd OpenTracker/kcf
make
./runkcftracker.bin
Quick Run (almost) all the tracker:
git clone https://github.com/rockkingjy/OpenTracker
cd OpenTracker
make
sudo make install
./trackerscompare.bin
Compile and Run
For the environment settings and detailed procedures (with all the packages from the very beginning), refer to: [My DeeplearningSettings].
The only extra-package is: Opencv3.x (already installed if you follow the environment settings above).
Of course, for trackers that use Deep features, you need to install [caffe] (maybe I will use Darknet with C in the future, I like Darknet :lips: ), and change the makefile according to your path. Compile of caffe refer to : [Install caffe by makefile].
If you want to autodetection the people with web camera, you need to install [OpenPose].
Parameters setting
If you want to use Openpose, in ./makefile, set OPENPOSE=1, else set OPENPOSE=0.
Change the datasets, in inputs/readdatasets.hpp, change the number of string databaseType = databaseTypes[1];
Change the path of datasets, in inputs/readdatasets.cc, change the path to your path of data.
To use web camera with openpose
By raising your two arms higher than your nose, it will atomatically detect the person and start the tracking programme.
Run to compare all the trackers at the same time
make all
sudo make install
./trackerscompare.bin
Run ECO
Compile without Caffe
If you don't want to compile with Caffe, that means you cannot use Deep features, set in eco/makefile: USE_CAFFE=0.
If you don't want to compile with CUDA, that means you cannot use Deep features, set in eco/makefile: USE_CUDA=0.
Compile with Caffe
If you want to compile with Caffe, set in makefile and **eco/make
Related Skills
openhue
342.5kControl Philips Hue lights and scenes via the OpenHue CLI.
sag
342.5kElevenLabs text-to-speech with mac-style say UX.
weather
342.5kGet current weather and forecasts via wttr.in or Open-Meteo
tweakcc
1.5kCustomize Claude Code's system prompts, create custom toolsets, input pattern highlighters, themes/thinking verbs/spinners, customize input box & user message styling, support AGENTS.md, unlock private/unreleased features, and much more. Supports both native/npm installs on all platforms.
