Population stability Index vs Population Accuracy Index
Can anyone explain to me the difference between Population Stability Index(PSI) and Population Accuracy Index(PAI)?
Topic model-selection statistics machine-learning
Category Data Science
Can anyone explain to me the difference between Population Stability Index(PSI) and Population Accuracy Index(PAI)?
Topic model-selection statistics machine-learning
Category Data Science
Population stability refers to whether the the distribution of explanatory variables is changing over time. When this distribution changes there is more concern over whether the model is currently fit-for-purpose since the data used to develop the model differs from the data the model is being applied to.
The Prediction Accuracy Index (PAI) is defined as the average variance of the estimated mean response at review divided by the average variance of the estimated mean response at development. In PSI we don't take into account the predictive ability.
To summarise,the Population Stability Index (PSI), interprets whether the distribution of development data and the distribution of review data are similar. The PAI checks the predictive ability of the model on current data is not significantly worse than the predictive ability at development.
To know more refer this paper
Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.