Seed Sensitivity Is Part of Model Selection

A configuration that wins once is not necessarily a good configuration: when the search process contains randomness, seed sensitivity is part of model selection.

Multiple Seeds Robust Aggregate Median Result Stable Configurations
A good configuration should survive more than one seed - seed sensitivity is part of model selection when randomness drives the search

TL;DR: A configuration that wins once is not necessarily a good configuration. When a forecasting-search workflow contains randomness, evaluate each promising configuration across multiple seeds and select on a robust aggregate such as the median result — because the goal is not the most impressive run but the configuration that remains useful when randomness changes.

The Problem

In a forecasting-search workflow, some candidate configurations looked excellent in one run. Then the seed changed. And the result changed too.

That is a problem when the search process itself contains randomness: stochastic model fitting, random sampling, evolutionary or genetic search, random feature or lag exploration, and resampled validation procedures all introduce variation between runs. If a configuration is selected from one run only, it may be selected because it got lucky.

The Approach

Instead of treating the single best score as the winner, I evaluated promising configurations across multiple seeds, then selected based on a robust aggregate such as the median result.

Where the randomness comes from

Stochastic fitting, random sampling, evolutionary or genetic search, random feature or lag exploration, and resampled validation all move the result between runs.

Judge configurations, not runs

A single score is evidence about one seed. A distribution across seeds is evidence about the configuration.

Pick the robust aggregate

The median result across seeds is more stable than the maximum: the flashy single-run winner can disappear, but what stays strong across repeated runs becomes easier to trust.

Outcome

The outcome was often less dramatic. The flashy single-run winner could disappear.

But the configurations that stayed strong across repeated runs became easier to trust — and that reliability is what makes a configuration worth deploying.

Key Takeaway

Design insight: Seed sensitivity is part of model selection when randomness drives the search process. Instead of selecting the most impressive single-run result, evaluate each promising configuration across multiple seeds and choose the robust aggregate such as the median — the goal is the configuration that remains useful when randomness changes, not the one that won once.

FAQ

Why is seed sensitivity part of model selection?

When a forecasting-search workflow contains randomness - stochastic fitting, random sampling, evolutionary or genetic search, random feature or lag exploration, resampled validation - a configuration selected from one run may simply have gotten lucky. Seed sensitivity is part of model selection because the single best score is not reliable evidence when the seed changes.

How should you pick a configuration when the seed changes the result?

Evaluate each promising configuration across multiple seeds and select on a robust aggregate such as the median result. The goal is not the most impressive run but the configuration that remains useful when randomness changes.

Comments

Machine Learning Feature Engineering MLForecast Time Series Decomposition Forecasting LightGBM XGBoost Catboost Clustering Segmentation NLP LLMs Web App R Markdown SQL Oracle DB SAS-Guide SAS E-Miner Dataiku BigQuery GCP Python R CRISP-DM Hypothesis Testing ANOVA Data Analytics Dimensionality Reduction Recommendation System Network Analysis Geospace Analysis Spatial Data Embedding Sampling Techniques Decision Rules Data Storytelling CVM Churn Fraud Detection Sentiment Analysis Topic Modeling IBM Watson PowerBI Looker Studio VBA Statistical Learning Ensemble Modeling Stacking Cross-Validation Profiling ABT Construction Plumber Tidyverse Shiny Prophet Deep Learning Scikit-Learn JSON SAS Programming Git VS Code CSS Styling Automated Reporting Outlier Detection Temporal Clustering Startup Survival Pre-Valuation Modeling K-Means Decision Trees Data Science Predictive Modeling SVM LDA Text Classification Weight Prediction Pattern Recognition Real-Time Detection Community Detection Pipeline Automation Data Quality Checks Data Reliability Specification Mapping Business Strategy Marketing Campaigns Try & Buy Frameworks KPI Dashboards Network Quality Sales Analytics Mentoring Statistics Lecturer Remote Work Hybrid Work Consulting Contract Full-Time Freelance Sofrecom Orange Group Tunisia Telecom Kiota Intelligence VC Analytics Series A Prediction Pre-Valuation Modeling Production ML Applied AI Prompt Engineering Business Forecasting Decision Systems Graph Analytics Household Detection Multi-SIM Detection FTTH Forecasting Audit Extraction Infrastructure Classification Pydantic GPT-4 OpenAI API Base64 Classification Zindi Codementor LAAS-CNRS ESSAI MIT xPRO Tunisia ML Competition Cell Tower Analysis Uber Logistics Uber Cape Town Necessary Condition Analysis Behavioral Signals Spike Smoothing Observation Unit Design Dendrogram Ward Clustering VIF Target Encoding Machine Learning Feature Engineering MLForecast Time Series Decomposition Forecasting LightGBM XGBoost Catboost Clustering Segmentation NLP LLMs Web App R Markdown SQL Oracle DB SAS-Guide SAS E-Miner Dataiku BigQuery GCP Python R CRISP-DM Hypothesis Testing ANOVA Data Analytics Dimensionality Reduction Recommendation System Network Analysis Geospace Analysis Spatial Data Embedding Sampling Techniques Decision Rules Data Storytelling CVM Churn Fraud Detection Sentiment Analysis Topic Modeling IBM Watson PowerBI Looker Studio VBA Statistical Learning Ensemble Modeling Stacking Cross-Validation Profiling ABT Construction Plumber Tidyverse Shiny Prophet Deep Learning Scikit-Learn JSON SAS Programming Git VS Code CSS Styling Automated Reporting Outlier Detection Temporal Clustering Startup Survival Pre-Valuation Modeling K-Means Decision Trees Data Science Predictive Modeling SVM LDA Text Classification Weight Prediction Pattern Recognition Real-Time Detection Community Detection Pipeline Automation Data Quality Checks Data Reliability Specification Mapping Business Strategy Marketing Campaigns Try & Buy Frameworks KPI Dashboards Network Quality Sales Analytics Mentoring Statistics Lecturer Remote Work Hybrid Work Consulting Contract Full-Time Freelance Sofrecom Orange Group Tunisia Telecom Kiota Intelligence VC Analytics Series A Prediction Pre-Valuation Modeling Production ML Applied AI Prompt Engineering Business Forecasting Decision Systems Graph Analytics Household Detection Multi-SIM Detection FTTH Forecasting Audit Extraction Infrastructure Classification Pydantic GPT-4 OpenAI API Base64 Classification Zindi Codementor LAAS-CNRS ESSAI MIT xPRO Tunisia ML Competition Cell Tower Analysis Uber Logistics Uber Cape Town Necessary Condition Analysis Behavioral Signals Spike Smoothing Observation Unit Design Dendrogram Ward Clustering VIF Target Encoding