Which of the following is TRUE about softmax (mark all that apply).

Question

BlackTom AI · Accepted Answer

Question restatement: Which of the following is TRUE about softmax (mark all that apply).

Option by option analysis:

Option 1: "is not differentiable". This is incorrect. The softmax function is differentiable with respect to its inputs, which is essential for gradient-based learning. The Jacobian is well-defined and used during backpropagation.

Option 2: "provides a distribution over indices of inputs". This statement is correct. Softmax converts a vector of real numbers into a probability distribution over the input indices, with all probabilities nonnegative and summing to 1. This is the core purpose of softmax in many neural network applications like classification and attention weights.

Option 3: "is permutation invariant". This is incorrect. Softmax is not invariant to permutation of inputs. If you permute the input vector, the resulting probabilities simply permute in the same way; the function does not produce the same output for all permutations.

Option 4: "is a unique layer to transformers." This is incorrect. Softmax is a common activation used across many architectures, not unique to transformers. While transformers use softmax in attention, softmax itself is not exclusive to them and is used in various models.

Summary of reasoning: Only Option 2 correctly describes softmax as producing a distribution over input indices, and the other statements conflict with the differentiability, permutation behavior, and architectural ubiquity of softmax.

CS-7643-O01, OAN, OSZ Quiz #4: Module 3

Which of the following is TRUE about softmax (mark all that apply).

查看解析

登录即可查看完整答案

类似问题

Which of the following is true about the softmax function in the context of multinomial logistic regression?

In a consumer society, many adults channel creativity into buying things

Economic stress and unpredictable times have resulted in a booming industry for self-help products

People born without creativity never can develop it

A product has a selling price of $20, a contribution margin ratio of 40% and fixed cost of $120,000. To make a profit of $30,000. The number of units that must be sold is: Type the number without $ and a comma. Eg: 20000

Which of the following statement regarding cost is correct:

更多留学生实用工具

考试浏览器助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单