subject-mesmerism-gutenberg

This is an automatically generated overview of the Distant Reader study carrel called subject-mesmerism-gutenberg.

Given a corpus of narrative text, the Distant Reader and the Distant Reader Toolbox create data sets, and these data sets are affectionately called "study carrels". As data sets, study carrels are intended to be read by people as well as computers, and their purpose is to supplement the reading process, to increase use & understanding.

Study carrels are designed to be computable, and this Web page is the result of one such computing process; here you will find a simple analysis of the carrel's extracted features. Use the features to characterize the content of the carrel, and then use them like items in a back-of-the-book index for more in-depth analysis.

Basic characteristics

Outlined below are some introductory features of the carrel:

Feature Value Description
creator ubuntu Under what username was this carrel created?
date created 2024-10-09 When was this carrel created?
size in items 7 How many items are in the carrel?
size in words 293,355 Measured in words, how big is this carrel? By comparison, the Bible is about 800,000 words long.
readability score 76 Where 0 denotes impossible and 100 denotes easy, how difficult is this carrel to read?
other files stopwords What words have been denoted as function words such as "the", "a", and "an"?
other files entire corpus What does a bag-of-words form of the carrel look like?

Sizes

Measured in words, how big are the items in this carrel? To what degree are they of similar size? Are any of the items particularly large or small? In general, the typical scholarly journal article is between 5,000 and 8,000 words long.

sizes-boxplot sizes-histogram

Readability

Using a metric called Flesch -- where 0 means nobody can read the item, and 100 means everybody can read it -- how difficult are the items in this carrel to read? Shakespeare's Sonnets are relatively easy to read (with a score of about 90) because their vocabulary is small and the sentences are short. The typical novel by Jane Austen or Herman Melville have scores in the 70's. Scholarly articles are more difficult (scores between 50-70) because their langauge is more specialized. Texts of poor optical character recognition quality typically have very low scores.

readability-boxplot readability-histogram

Ngrams

Excluding stop words, what are the most frequent individual words and two-word combinations in the corpus, thus addressing the question, "What are the items in this study carrel about?"

unigrams-cloud

unigrams
bigrams-cloud

bigrams

Parts-of-speech

The most frequent extracted parts-of-speech features address questions of "What is discussed in this corpus, what do they do, and how are they described?"

pos-noun

nouns


pos-propernoun

proper nouns


pos-pronoun

pronouns


pos-verb

verbs


pos-adjective

adjectives

pos-adverb

adverbs

Entities

Similar to nouns, named-entities are real-world things but they are more specific. They help address questions of who, where, and how many.

entities-any

any entity


entities-person

persons


entities-gpe

geo-political entities
entities-org

organizations

Clusters

Through the use of a variation of the principle component analysis alogorithm, it is possible to plot the location of study carrel items in two- and three-dimentional spaces, thus addressing the questions, "To what degree is this study carrel holistic; to what degree are the items in this carrel easily subdivided into smaller group?"

cluster-dendrogram cluster-cube

Keywords

Excluding stop words, and through the use of a variation of the term frequency-inverse document frequency algorithm, the set of computed keywords are akin to subject terms, and they help address the questions of, "What are the items in this carrel about and to what degree?"

keywords-cloud

Additional models

Depending on how the carrel was computed against, the following point to additional models:

For more detail about study carrels, their structure, and how they can be used, start with the read me file.

Subdirectories

Each and every study carrel contains a number of subdirectories (folders). The first two are about the carrel's content:

The next few subdirectories contain extracted features in the form of tab-delimited text files:

Very important. All of the content in the subdirectories above are readable by any spreadsheet application, database program, or programming language. Therefore, you do not need special software to do analysis.

There are two additional subdirectories in every study carrel:

All of this is just the beginning. For more detail about study carrels, their structure, and how they can be used, begin with the read me file.


Date created: 2024-10-09