Beyond Feature Importance: Investigating Predictive Sensitivity in Machine Learning Models

Simran Sharma; Mahesh Mulani

doi:10.36948/ijfmr.2026.v08i05.88412

Beyond Feature Importance: Investigating Predictive Sensitivity in Machine Learning Models

Author(s)	Simran Sharma, Dr. Mahesh Mulani
Country	India
Abstract	Feature importance is widely used in machine learning to assess the contribution of individual predictors to model performance and support the interpretation of model behaviour. However, it remains unclear whether features identified as highly important are also those to which a model is most sensitive when their values are disturbed. This study empirically investigates the relationship between feature importance and predictive sensitivity under controlled feature perturbations. Experiments are conducted on five classification datasets, namely Sonar, Ionosphere, Breast Cancer Wisconsin, Parkinson’s Disease, and Spambase, using Logistic Regression, Random Forest, and Gradient Boosting to represent different modelling characteristics. Permutation importance is used to estimate model-specific feature importance. Individual features in the test data are then progressively perturbed using Gaussian noise at multiple intensity levels, while the trained models remain unchanged. Predictive sensitivity is measured through the resulting degradation in F1 score, and Spearman rank correlation is used to examine the correspondence between feature importance and feature-wise sensitivity. The results show that higher feature importance is associated with greater perturbation sensitivity in several dataset and model combinations. However, the relationship is not consistent across all experimental conditions or classifiers. Both the magnitude and statistical significance of the observed associations vary across datasets, models, and perturbation intensities, with stronger associations observed at higher perturbation levels in several cases. These findings suggest that feature importance and perturbation sensitivity capture related but distinct aspects of model behaviour. Therefore, feature importance alone may not fully reflect how strongly model performance responds to disturbances in individual features. Controlled feature perturbation analysis can thus provide a complementary perspective for interpreting feature relevance and evaluating the robustness of machine learning models.
Keywords	Feature Importance, Predictive Sensitivity, Model Robustness, Permutation Importance, Machine Learning
Field	Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In	Volume 8, Issue 5, September-October 2026
Published On	2026-09-24
DOI	https://doi.org/10.36948/ijfmr.2026.v08i05.88412

View / Download PDF File

About IJFMR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9687-828-838	editor@ijfmr.com

International Journal For Multidisciplinary Research

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Beyond Feature Importance: Investigating Predictive Sensitivity in Machine Learning Models

Share this