What is the equivalent of tokens in a DTM?

Question

BlackTom AI · Accepted Answer

When approaching the concept, it's helpful to map what is meant by tokens in a Document-Term Matrix (DTM).
Option 1: 'words' — This is correct. In a DTM, rows typically represent documents and columns correspond to tokens that appear in the corpus; these tokens are usually individual words or terms extracted from the text. So, recognizing tokens as words aligns with the standard construction of a DTM.
Option 2: 'objects' — This is not accurate in the context of a DTM. 'Objects' are not a typical unit of analysis or a standard feature representation in a document-term layout; DTMs focus on textual units like words or terms, not arbitrary objects.
Option 3: 'values' — While a DTM does contain values (the counts or frequencies) in the matrix cells, 'values' are not what the tokens themselves are. The tokens are the columns (features); the numbers in the cells are the counts or frequencies of those tokens in each document.
Option 4: 'terms' — This is correct. In many discussions of DTMs, tokens are referred to as terms (synonymous with words) that appear in the documents; the matrix is often called a term-document matrix or a document-term matrix depending on orientation, but 'terms' is a valid and common synonym for the units represented by the columns.

Business Analysis with Unstructured Data - DAT-7471 - BMBAN2 In-class knowledge check #2 (Remotely Proctored)

What is the equivalent of tokens in a DTM?

查看解析

登录即可查看完整答案

类似问题

In a consumer society, many adults channel creativity into buying things

Economic stress and unpredictable times have resulted in a booming industry for self-help products

People born without creativity never can develop it

A product has a selling price of $20, a contribution margin ratio of 40% and fixed cost of $120,000. To make a profit of $30,000. The number of units that must be sold is: Type the number without $ and a comma. Eg: 20000

Which of the following statement regarding cost is correct:

Under the assumptions used in cost-volume-profit analysis, as the activity increases:

The CVP and break-even analysis are supported by a range of important assumptions. Which of the following is not an assumption of the CVP:

The break-even point is that at which:

更多留学生实用工具

考试浏览器助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单