PURA: Parameter Update-Recovery Test-Time Adaption for RGB-T Tracking

Zekai Shao*, Yufan Hu*, Bin Fan, Hongmin Liu
School of Intelligence Science and Technology, University of Science and Technology Beijing
*Equal Contribution     Corresponding Author

Abstract

Maintaining stable tracking of objects in domain shift scenarios is crucial for RGB-T tracking, prompting us to explore the use of unlabeled test sample information for effective online model adaptation. However, current Test-Time Adaptation (TTA) methods in RGB-T tracking dramatically change the model's internal parameters during long-term adaptation. At the same time, the gradient computations involved in the optimization process impose a significant computational burden. To address these challenges, we propose a Parameter Update-Recovery Adaptation (PURA) framework based on parameter decomposition. Firstly, our fast parameter update strategy adjusts model parameters using statistical information from test samples without requiring gradient calculations, ensuring consistency between the model and test data distribution. Secondly, our parameter decomposition recovery employs orthogonal decomposition to identify the principal update direction and recover parameters in this direction, aiding in the retention of critical knowledge. Finally, we leverage the information obtained from decomposition to provide feedback on the momentum during the update phase, ensuring a stable updating process. Experimental results demonstrate that PURA outperforms current state-of-the-art methods across multiple datasets, validating its effectiveness.

Framework

Normal and Anomalous Representations

Overview of Parameter Update-Recovery Adaption (PURA). It consists of two key components: fast parameter update and parameter decomposition recovery. In the parameter updating phase, we use test data to adjust a small number of statistical parameters in the BatchNorm layer, effectively capturing new distribution features. In the parameter recovery phase, we analyze the parameter trajectory through singular value decomposition to isolate important parameters that align with the principal update direction for recovery.

Main Reults

Normal and Anomalous Representations

Attribute-based Performance

Normal and Anomalous Representations

Comparison between PURA and competing methods across various attributes in the LasHeR→RGBT234 scenario. Results prove the effectiveness of PURA in addressing domain shifts in complex environments, thereby significantly enhancing the model's generalization capability.

Visualization

BibTeX


    @inproceedings{shao2025pura,
    title={PURA: Parameter Update-Recovery Test-Time Adaption for RGB-T Tracking},
    author={Zekai, Shao and Yufan, Hu and Bin, Fan and Hongmin, Liu},
    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
    year={2025}
    }
      

This page was built using the Academic Project Page Template which was adopted from the Nerfies project page.
This website is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.