A data scientist is using grid search for hyperparameter optimisation for kNN. The grid search evaluates 5 values of $k$, 4 different distance functions, and 3 different feature combinations using 5-fold cross-validation. How many total model training operations will be performed during this hyperparameter optimisation process?

Question

BlackTom AI · Accepted Answer

We start by identifying the components involved in the grid search:
- Number of k values to try: 5
- Number of distance functions: 4
- Number of feature combinations: 3
These three factors multiply to give the total number of hyperparameter configurations tested:
5 × 4 × 3 = 60 configurations.
Next, each configuration is evaluated using 5-fold cross-validation. In 5-fold CV, the model is trained and evaluated five times for each configuration, corresponding to the five folds. Therefore, the total number of model training operations is:
60 configurations × 5 folds = 300 training operations.
Thus, the hyperparameter optimisation process involves 300 total model trainings. If there were multiple options to compare, this would be the figure to match for the total training count. The calculation hinges on multiplying the counts of each grid search dimension (k values, distance functions, feature combinations) by the cross-validation folds.

QBUS6810 (ND) Mid-Semester Practice Quiz

查看解析

登录即可查看完整答案

类似问题

Which statement best describes the difference between GridSearchCV and RandomizedSearchCV in scikit-learn?

In the project notebook the classification model building was never completed. After estimating generalization performance for the decision tree, logistic regression, and random forest algorithms we stopped. What would the next step in the model-building process have been if we had continued?

Which of the following numbers is closest to the best parameter setting for the random forest algorithm on the income data?

Question at position 36 Which of the following strategies/tools should we choose in order to decide the k value in a kNN model?Nested holdout testingNested Cross-validationCumulative response curveCross-validationLearning CurveLift curveFitting GraphHoldout testing

Which hyperparameter is NOT typically adjusted when tuning LLMs?

What is one challenge associated with LLMs?

In a consumer society, many adults channel creativity into buying things

Economic stress and unpredictable times have resulted in a booming industry for self-help products

更多留学生实用工具

考试浏览器助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单