TY - GEN
T1 - Test-Time Training in CALF for Time Series Forecasting via Decomposition and Adaptive Freezing
AU - Agisucida, Gabriel Darma Prasetya
AU - Marasin, Alexandrio Kharisma Putra
AU - Halim, Donny
AU - Toofani, Naveed
AU - Setiawan, Budi Darma
AU - Yudistira, Novanto
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Time series forecasting is critical in domains such as finance, energy, and climate monitoring. Transformer-based models show strong results but often struggle to adapt to dynamic and unseen data distributions. This paper presents an enhancement to the CALF framework by integrating Test-Time Training (TTT), Time Series Decomposition, and Adaptive Freezing to improve forecasting accuracy and model adaptability. TTT allows the model to adjust parameters during testing, helping it handle new data distributions. Time Series Decomposition separates trend, seasonal, and residual components, focusing the model on relevant temporal features. Adaptive Freezing selectively freezes certain layers during fine-tuning to stabilize adaptation. Extensive experiments demonstrate that this integrated approach outperforms traditional models like ARIMA, LSTM, and state-ofthe-art Transformer-based models in forecasting accuracy while maintaining stable inference behavior in dynamic environments.
AB - Time series forecasting is critical in domains such as finance, energy, and climate monitoring. Transformer-based models show strong results but often struggle to adapt to dynamic and unseen data distributions. This paper presents an enhancement to the CALF framework by integrating Test-Time Training (TTT), Time Series Decomposition, and Adaptive Freezing to improve forecasting accuracy and model adaptability. TTT allows the model to adjust parameters during testing, helping it handle new data distributions. Time Series Decomposition separates trend, seasonal, and residual components, focusing the model on relevant temporal features. Adaptive Freezing selectively freezes certain layers during fine-tuning to stabilize adaptation. Extensive experiments demonstrate that this integrated approach outperforms traditional models like ARIMA, LSTM, and state-ofthe-art Transformer-based models in forecasting accuracy while maintaining stable inference behavior in dynamic environments.
KW - Adaptive Freezing
KW - CALF
KW - Decomposition
KW - Fine-Tuning
KW - Test-Time Training
KW - Time Series Forecasting
UR - https://www.scopus.com/pages/publications/105033052296
U2 - 10.1109/ICAICTA67604.2025.11335123
DO - 10.1109/ICAICTA67604.2025.11335123
M3 - Conference contribution
AN - SCOPUS:105033052296
T3 - 2025 12th International Conference on Advanced Informatics: Concept, Theory and Application, ICAICTA 2025
BT - 2025 12th International Conference on Advanced Informatics
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 12th International Conference on Advanced Informatics: Concept, Theory and Application, ICAICTA 2025
Y2 - 20 September 2025 through 22 September 2025
ER -