Create a term-document matrix using the result of Text Analysis - Advanced - Setup Text Analysis. A term-document matrix represents the processed text from a text analysis as a table or matrix where the rows represent the text responses or documents, and the columns represent the words or phrases (the terms). If the text response contains the word or phrase, then the corresponding cell of the table will contain a value of 1, otherwise it will contain a value of 0. For performance reasons, the term-document matrix is returned as a sparse matrix of class dgCMatrix using the Matrix package. There are a number of packages in R that will use this format directly. Otherwise, it can be converted to a normal matrix by wrapping it inside the function as.matrix, e.g.: as.matrix(term.document.matrix).
You must create an item using Text Analysis - Advanced - Setup Text Analysis before you can create a term-document matrix. All of the options for the text analysis are specified on that item.
This blog post describes the term-document matrix format and how it can be used as input to a predictive model.
Example
In Displayr:
- Go to Anything
> Text Analysis > Advanced > Term Document Matrix from the toolbar.
- From Properties
, go to Data > Setup item and select a Text Analysis - Advanced - Setup Text Analysis object.
- Click Calculate or ensure Calculate automatically is ticked.
In Q:
- Go to Create > Text Analysis > Advanced > Create Term Document Matrix.
- In the object inspector, under Inputs > Setup item, select a Text Analysis - Advanced - Setup Text Analysis object.
- Ensure the Automatic box is checked, or click Calculate
The output generated by this function will provide a sparse matrix since many values are likely to be zero.
To access/view the full matrix, take these steps:
1. Insert a new R output (Q: Create > R Output; Displayr: Calculation > Custom Code from the toolbar).
2. In the R Code editor (in Q) or Code panel (in Displayr), enter the code below, and replace term.document.matrix with the name of the object you just created:
as.matrix(term.document.matrix)3. Ensure the Automatic box (in Q) or Calculate automatically (in Displayr) is ticked or click Calculate. The result will be a table similar to this:
Options
Setup item An item created from Text Analysis - Setup Text Analysis.
Minimum document count Terms must appear in this many documents (rows) to be included in the matrix. This allows further control over the size of the table.
More Information
Text Analysis: Hooking up Your Term Document Matrix to Custom R Code
How to Set up Your Text Analysis in Displayr
Acknowledgments
Uses the tm package.
Next
Displayr: How to Create a Term Document Matrix