A Guided Reading Against a Journal Called The Dial

The Dial was a Transcendentalist literary journal initially published in 1841 and continued intermittently for approximately 85 years. I did my best to collect the whole of the journal and model it into a data set. The result is about 28 million words long, which is about the size of 112 copies of Moby Dick.

I then coupled my Distant Reader API with an MCP/LLM combination to read and analyze aspects of The Dial. More specifically, I asked a number of questions of the API, and in true LLM form, I was given responses:

I call this entire process a guided reading: get an overview of a large collection of text, ask questions of the collection, get responses, and repeat until tired. It is kind of like perusing a back-of-the-book index, which is something I have always thought to be a good time. Maybe you will too.

Workflow: Gather corpus → Run through Distant Reader API → Ask questions via MCP/LLM → Receive and review responses → Iterate with new questions → Compile and publish results.

Colophon

Again, this guided reading was built upon a thing I call a Distant Reader study carrel, which is really a collection of narrative texts that has been indexed and modeled in quite a number of ways. Those ways include but are not limited to: parts-of-speech, named-entities, topic modeling, semantic indexing, bibliographics, full-text indexing, et cetera.

Study carrel data is almost exclusively plain text in nature, readable with any text editor as well as just about any spreadsheet or programming language. Moreover, once downloaded, study carrels do not require any Internet connections. That said, study carrels are more easily... studied through the Distant Reader Toolbox -- a collection of Python models. For more information about study carrels, see the readme file as well as the Toolbox documentation.

The guided reading, above, is a mere example of what can be learned from The Dial. After all, this collection of The Dial is more than 100 times the size of Moby Dick. Surely there is more. If you want to learn more, if you want to study The Dial in greater detail, peruse the carrel's rudimentary bibliography as well as computed home page, and if your interest is still piqued, then download the whole carrel for the purpose of doing your own research:

http://carrels.distantreader.org/curated-dial-hathi/index.zip