Conference: Proceedings of the LVII Brazilian Symposium on Operations Research

Combination of Transformer-Based Models for Wind Data Forecasting

Abstract

This study explores the use of combined Transformer-based models for time seriesforecasting, evaluating the Informer, Autoformer, Transformer, and CALF architectures. Models were trained on wind data under two configurations, with and without denoising, and evaluated across different forecasting horizons. Two combination strategies were developed: a Multi-Objective Optimization (MOO) approach using NSGA-III to balance MAPE and RMSE, and another one through the SAW multicriteria technique, which dynamically selects the most suitable model at each time step based on sliding windows. Results show that the SAW model outperformed the MOO-based approach by adapting to the evolving behavior of the data, while the MOO model consistently provided stable performance compared to the based model. Moreover, denoising did not have a clear impact on accuracy but significantly reduced training time. It is concluded that combined approaches can offer more robust forecasts than individual models, especially in scenarios with pronounced temporal variability.

DOI Slides

NoteHow to cite this work

Anjos, Doglas Querino Dos, Gilberto Reynoso Meza, and Ramon Gomes Da Silva. 2025. “Combination of Transformer-Based Models for Wind Data Forecasting.” Paper presented at LVII Brazilian Symposium on Operations Research. https://doi.org/10.59254/sbpo-2025-212309.

@inproceedings{dosanjos2025combination,
 address = {Gramado, Brazil},
 author = {Doglas Querino {dos Anjos} and Gilberto Reynoso-Meza and Ramon Gomes {da Silva}},
 booktitle = {Proceedings of the LVII Brazilian Symposium on Operations Research},
 doi = {10.59254/sbpo-2025-212309},
 publisher = {Galoá},
 title = {Combination of Transformer-Based Models for Wind Data Forecasting},
 year = {2025}
}