I have a model that predicts the level of injury over 3 classes: Low, Medium and High. I wish to optimize the model parameters on the scoring basis of precision. However, precision is class specific, we can determine the precision of low, medium and high separately. Is there a way to determine something like "Overall Precision" from the confusion matrix?
Topic multiclass-classification
Category Data Science
Model parameters are only optimized through the loss function. Precision is not an useful loss function so precision can not be used to optimize model parameters.
Hyperparameters can be optimized with precision through cross-validation.
There are many types of multi-class precision, especially if there are class imbalances. Python's scikit-learn package lists five types: micro, macro, samples, weighted, binary.
Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.