Material of Language (Schedule Spring 2021)
NOTE: Readings and topics are provisional and subject to change!
Syllabus here. Readings should be generally available on the web, unless otherwise indicated. Some readings will only be accessible when connected to an NYU network. Please contact me if you have trouble accessing any of the readings.
Please use this form to turn in your homework assignments.
Session 01: Digital writing from scratch
Date: 2021-01-29
- Class introduction
- Invent digital writing from scratch
- Some material works and theory
- Installing Anaconda (download the “graphical installer” for your platform)
- Introduction to Jupyter Notebook
- Enough Python
Readings assigned
Pipkin gives a clear and friendly historical overview of character encoding. How might character encoding have turned out differently? Amiri Baraka and Ross Gay present different takes on writing interfaces. Consider the material of the tools you use for writing: where do those tools come from? What affordances do they have? What kinds of written artifacts do they produce? Scott Weingart talks in detail about digital materiality: how is text manipulated, contorted, reconstituted, constrained in the process of being digitized and transmitted electronically? Drucker gives an overview of different types of materiality on the page and argues that text is “an event, rather than an entity. The event is the entire system of reader, aesthetic object and interpretation – but in that set of relations, the ‘text’ is constituted anew each time.” Do you agree?
- Baraka, Amiri. “Technology & Ethos.” Raise, Race, Rays, Raze; Essays since 1965, Random House, 1972, pp. 155–58.
- Drucker, Johanna. “Entity to Event: From Literal, Mechanistic Materiality to Probabilistic Materiality.” Parallax, vol. 15, no. 4, Nov. 2009, pp. 7–17.
- Gay, Ross. “Writing by Hand.” The Book of Delights: Essays, Algonquin Books, 2019, pp. 31–33.
- Pipkin, Everest. “The fuzzy edges of character encoding.” Running Dog Magazine, 2020.
- Weingart, Scott B. “The Route of a Text Message, a Love Story.” Vice, 22 Feb. 2019.
Optional:
- For more on “lighght” (optional): Daly, Ian. “You Call That Poetry?!” Poetry Foundation, 25 Aug. 2007.
- On the materiality of American Sign Language: Christine Sun Kim, The enchanting music of sign language (cw: TED Talk, but it’s good!)
- More on Malzkuhn’s ASL translation of “Jabberwocky” (performed here by Joe Velez): Jeffrey Mansfield, “Space, Time and Gesture: Gestural Expression, Sensual Aesthetics and Crisis in Contemporary Spatial Paradigms,” in TACET #03 – From Sound Space (Paris: Les presses du réel, 2014).
- Mosher, Dave. “The QWERTY Effect: How Typing May Shape the Meaning of Words.” Wired, Mar. 2012.
Session 02: Text encodings and glitch poetics
Date: 2021-02-05
- Reading discussion
- Python: Text encodings and glitch poetics
- How to upload and share Jupyter Notebooks
Assignment #1
Due at the beginning of session 03.
Using the example code discussed in class, create a composition based on computational manipulation of data, either on a character-by-character or byte-by-byte basis.
Works and inspiration:
- Art of the PNG Glitch
- Seyffarth, Esther. How not to reverse a string.
- Joel Swanson: Lady Gaga’s Twitter Feed Translated Into Morse Code
- Jörg Piringer: Unicode
Session 03: Markup languages
Date: 2021-02-12
- Homework presentations
- History of computational layout (deck forthcoming)
- Python: Interpolating strings
Readings assigned
To be discussed in session 04.
Beingessner’s article is an informative overview of the technology of text rendering, and how even the most straightforward kinds of text rendering are incredibly complicated. Can you think of kinds of text that would be impossible to render with a computer? Cearley claims that concrete poetry shows “where the words of the language fail.” Do you agree that “there are ideas which defy encapsulation in words”? What material aspects of concrete poetry can be deployed to carry out this encapsulation? Jhave’s article brings together a number of important image-oriented text works and argues that the synthesis of text and image into a new hybrid form is historically inevitable. Pick one of the works that Jhave cites and read about it in more detail. Do you agree with Jhave’s conclusions? Li writes extensively on his techninques for writing concrete poetry (in Chinese) and strategies that have been deployed to translate it (into English). Can you think of other kinds of text or particular examples of texts that similarly resist translation? Reed’s text explores Terrance Hayes’ “Sonnet” as a limit case of concrete poetics, arguing that “in drawing attention to the ‘facticity’ of words” concrete poetry “suggests the possibilities of unsaying—speaking of the world and history without repeating the already said,” thereby enabling a unique form of witness.
- Beingessner, Alexis. “Text rendering hates you.”
- S Cearley. How to read a concrete poem.
- Johnston, David (Jhave). “The Assimilation of Text by Image.” Electronic Book Review, 7 Oct. 2012.
- Li, Chen. “Writing and Translating Concrete Poetry in Chinese Characters.” The Translation and Transmission of Concrete Poetry, edited by John Corbett and Ting Huang, 1st ed., Routledge, 2019, pp. 56–70. Crossref, doi:10.4324/9781315145563.
- Only pp. 27-37 from Reed, Anthony. “Broken Witness: Concrete Poetry and a Poetics of Unsaying.” Freedom Time: The Poetics and Politics of Black Experimental Writing, Johns Hopkins University Press, 2014, pp. 27–58.
Optional:
- Solt, Mary Ellen. Concrete Poetry: A World View
- D’Ambrosio, Matteo. “The Early Computer Poetry and Concrete Poetry.” MATLIT: Materialities of Literature, vol. 6, no. 1, Aug. 2018, pp. 51–72.
- Simonowski, Roberton. “Concrete poetry in analog and digital media.”
Session 04: Programming concrete compositions
Date: 2021-02-19
- Reading discussion
- Python: Concrete compositions with loops, trigonometry and markup generation (Note: this notebook is significantly truncated in the GitHub preview! Make sure you download it and work with it locally.)
Assignment #2
Due at the beginning of session 05.
R.P. Draper says that concrete poetry “is the creation of verbal artefacts which exploit the possibilities, not only of sound, sense and rhythm—the traditional fields of poetry—but also of … the two-dimensional space of letters on the printed page.” Imagine a concrete poetry that also exploits the possibilities of computation. Make use of the in-class example code or other computational tools.
Works and inspiration
- Qianxun Chen, Graphein
- Liza Daly, A Physical Book
- Ben Fry, Tendril
- Jen Bervin: Draft notation, Speechless
- bpNichol: First Screening, Konfessions of an Elizabethan Fan Dancer
- Augusto De Campos
- Guests on vispo.com
- Anatol Knotek
- Jürg Lehni & Alex Rich, Empty words
- Alyson Provax
Session 05: Writing as gesture and asemic writing
Date: 2021-02-26
- Homework presentations
- Writing as gesture (deck forthcoming)
- Asemic works
- Python: Flat, asemic writing, Bezier curves
Reading assigned
To be discussed in session 06.
- Aima, Rahel. “Definition Not Found.” Real Life, Sept. 2016.
- Durgin, Patrick. “Witness Mirtha Dermisache.” Jacket2, 8 Sept. 2014. See also: Barthes’ letter to Mirtha Dermisache)
- Gladman, Renee. Prose Architectures. Wave Books, 2017. (Just the introduction and Fred Moten’s afterword.)
- Hoff, Anders. “Spline Script.” inconvergent.net, 1 Oct. 2017.
- Vincler, John. “Dwelling Places: On Renee Gladman’s Turn to Drawing.” The Paris Review, 28 Aug. 2018.
Session 06: The computational asemic
Date: 2021-03-05
- Reading discussion
- Flat basics, continued
- Lines and asemic writing
Assignment #3
Due at the beginning of session 07. Create a computer program that produces asemic writing. Your program should implement a system of rules that produce visual artifacts that imitate the motion of physical writing or suggest the appearance of written language.
More inspiration:
- Sam Roxas-Chua
- Joel Swanson, Unrecognizable Letterforms (Alphabits)
- Manfred Mohr, Cubic Limit, other algorithmic experiments
- Bleeptrack & Harry Josephine Giles, glyphsprache
Session 07: Data-driven asemic writing
Date: 2021-03-12
- Homework presentations
- Python: Handwriting remix
- Python: Using Hershey fonts
Reading assigned
On fonts: what they are (Lehni), how they might come to be (Grießhammer), how they work (or don’t work; Nasser), how they’re designed (Shen).
- Lehni, Jürg. “Typeface As Programme.” Typotheque, 14 Apr. 2011.
- To watch: “The Hershey Fonts.” (Frank Grießhammer)
- Nasser, Ramsey. “Unplain text.”
- Shen, Juliet. “Aesthetic Innovation in Indigenous Typefaces: Designing a Lushootseed Font.”
Session 08: Fonts as data
Date: 2021-03-26.
- Reading discussion
- Introduction to how fonts work. Dear god.
- Python: Manipulating font files
Assignment #4
Due at the beginning of session 09. Extract shape information (or other information) from a font. Use this information to render text in an unexpected way.
Seesion 09: Machine learning and the letterform
Date: 2021-04-02.
- Homework presentations
- Python: Latent space of font models
- Python: Training a DCGAN on glyph images, part 1; part 2
Some works making use of typography and machine learning:
- Sarah Rosalena Brady, Reformation of 50,000 Letters
- Barney McCann, AI Typography
- Gene Kogan’s riff on A Book from the Sky
Reading assigned
- Borsuk, Amaranth. “The Upright Script: Words in Space and on the Page.” Journal of Electronic Publishing, vol. 14, no. 2, Oct. 2011. quod.lib.umich.edu, doi:10.3998/3336451.0014.212.
- Cayley, John. “Lens: The Practice and Poetics of Writing in Immersive VR (A Case Study with Maquette).” Leonardo Electronic Almanac, vol. 14, no. 05, 2006, p. 19.
- Ikonen, Teemu. “Moving Text in Avant-Garde Poetry. Towards a Poetics of Textual Motion.” Dichtung Digital, no. 4, 2003.
Some works to know and think about:
- Brian Kim Stefans, The Dreamlife of Letters (original Flash version)
- Noah Wardrip-Fruin and collaborators, Talking Cure
- Uh just everything here
Session 10: Language on the move and in response
Date: 2021-04-09.
- Reading discussion
- Python: Functions
- Python: Interactive widgets
- Python: Animations with image sequences and ffmpeg
Assignment #5
Due at the beginning of session 11. Take one of your previous assignments and make it interactive (with e.g. IPython widgets) and/or animated.
Session 11: Putting Python online
Date: 2021-04-16.
- Homework review
- Final project proposals
- Python: Standalone scripts, Glitch web apps
Session 12: Workshop
Date: 2021-04-23.
- Clean-up day: anything we haven’t gone over yet or had to skip because of time limitations.
- Final project workshop: Bring in a draft of your final project piece. We’ll workshop and review in groups.
Sessions 13 & 14: Final project presentations
Dates: 2021-04-30, 2021-05-07
- Final project presentations.