Select the following trends of errors that occur as a neural network grows in complexity

Question

BlackTom AI · Accepted Answer

When a neural network becomes more complex, several error components shift in characteristic ways, so we should examine each option carefully.
Option 1: 'Estimation error increases' — This is typically true. As model capacity grows, the model can fit training data more closely, including noise, which increases variance and hence estimation error on unseen data. In other words, with more parameters, the risk of overfitting rises, leading to higher estimation error.
Option 2: 'Modeling error increases' — This is generally not correct. Modeling error (often viewed as bias) reflects how well the model class can represent the underlying function. Increasing capacity usually decreases bias, since a more flexible model can approximate more functions. Therefore, modeling error is not expected to increase with complexity; it tends to decrease or approach a lower bound.
Option 3: 'Optimization error decreases' — This statement is not universally true. While a larger model can in theory fit the data better, it can also introduce a more complex optimization landscape with more local minima, saddle points, or plateaus. In practice, optimization error may not systematically decrease and can even increase in some cases, depending on the training algorithm and data. So this option is not reliably correct.
Option 4: 'Modeling error descreases' — This aligns with the bias reduction intuition. As the model capacity grows, the ability to approximate the true function improves, reducing modeling error (bias). The phrasing here matches the conventional expectation that bias diminishes with higher capacity, assuming the data supports learning such a function and regularization is managed.

In summary, Option 1 reflects the well-known increase in estimation error with higher capacity due to variance, and Option 4 reflects the decrease in modeling (bias) error with increased capacity. Options 2 and 3 contradict common theoretical or practical expectations about how modeling bias and optimization difficulty behave as networks grow more complex. The overall reasoning shows why the selected trends are observed in practice, while the others either misstate the direction of bias change or conflate optimization difficulty with capacity in a way that’s not universally guaranteed.

CS-7643-O01, OAN, OSZ Quiz #3: Convolutional Neural Network Architectures (Lesson 6), Visualization (Lesson 7), Advanced Computer Vision Architectures (Lesson 8)

Select the following trends of errors that occur as a neural network grows in complexity

查看解析

登录即可查看完整答案

类似问题

Which statement is correct about bias, variance, and generalization error evaluated on the same problem?

Which of the following are true about model variance?

Question at position 13 Multiple Choice Question: A fitting curve plots Generalization performance vs. model complexityTrue positive rate vs. false negative rateTrue positive rate vs. false positive rateGeneralization performance vs. size of training set

A large tree will generally have trouble capturing the structure in the data, while a small tree will have high variance.

Fill in Blanks. Choose among Overfitting and Underfitting: What does Blank A represent: [Fill in the blank], What does Blank B represent: [Fill in the blank],

更多留学生实用工具

考试浏览器助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单