Beyond the Sparse Frontier: Enhancing Demand Forecast Trustworthiness through Semantic Variable Selection and High-Dimensional Grouping

Monday 26 January 2026, 1:00pm to 2:00pm

Venue

CHC - Charles Carter A02 - View Map

Open to

Postgraduates, Staff

Registration

Registration not required - just turn up

Event Details

CMAF forum with Yves Sagaert

Abstract: In the era of open data, the availability of vast numbers of potentially informative covariates has transformed aggregate-demand modelling. However, the resulting high-dimensional covariate spaces, often characterized by strong multicollinearity and small estimation samples, significantly degrade the performance of traditional variable selection methods. While Lasso regression remains a popular solution, its inherent instability in the presence of correlated predictors undermines the reliability and perceived credibility of business forecasts. This seminar presents a novel framework for addressing these limitations by structuring input variables into semantically coherent groups prior to selection. We discuss semantic representations by leveraging Semantic Bidirectional Encoder Representations from Transformers (SBERT) to capture domain-specific context, and compare this with statistical clustering and grouping on meta-data such as covariates popularity. Using an empirical case study, we evaluate these approaches across a multi-dimensional performance matrix: predictive accuracy, decision-oriented utility, and model interpretability. The findings reveal a critical trade-off: while factor-based approaches excel in aggregate forecasting for tactical planning, they lack the explainability required for user trust and perform poorly on disaggregated data. Conversely, semantic integration via SBERT yields more consistent improvements and significantly enhances model transparency.

Speaker

Yves Sagaert

VIVES University of Applied Sciences

Yves is head of the research group of Predictive AI and Digital Shift at VIVES University of Applied Sciences, Belgium and director of Belgium’s Forecasting Society, BELFORS. He is a researcher at KU Leuven and an Adjunct Professor at the IÉSEG School of Management in Lille (France). He strives to integrate business forecasting with real-world decisions and constraints, bringing forecast models closer to their cost impact.

Contact Details

Name Teresa Aldren
Email

t.aldren@lancaster.ac.uk

Directions to CHC - Charles Carter A02

Charles Carter Building