What would be the main and essential criteria for evaluating auto-sklearn library ?

I m running experiments using benchmark datasets with auto-sklearn to see how its performance is different to the standard sklearn library, Since automl does an exhaustive search over parameters and sklearn has to be manually tuned. what could be the essential criteria to judge the performance between these two libraries

Topic metric evaluation scikit-learn machine-learning

Category Data Science

1
answered at

There are many ways to evaluate the differences. Here are a couple:

  • Performance on evaluation metric.
  • Search time.

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.