Written Response – Positions through contextualising

Written by

in

Annotated Bibliography

1. Drucker, J. (1994) The Visible Word: Experimental Typography and Modern Art, 1909–1923. Chicago: University of Chicago Press, p.3.

Sample: Typography operates as a visual system, not merely a linguistic one. (Drucker, 1994, p.3)

Drucker defines typography as a visual system rather than merely a linguistic carrier, which leads me to understand legibility as a visual condition that can be reshaped, or as a strategy that can be practiced. My aim is to explore the similarities and differences between machine and human mechanisms of recognising legibility. Humans can rely on context and association to complete meaning from incomplete information, whereas machines tend to depend on character outlines and structural features to make logical inferences.

In order to obtain more samples to analyse my research direction, I added functions to my website (my project) that can disrupt the visual structure of text. These functions are built based on OCR (Optical Character Recognition) mechanisms, including character shape, stroke continuity, and contrast & edge. Through this mode of practice, I challenge both human and machine modes of understanding, and identify the fundamental differences between these two recognition systems in the process.

·


2. Flusser, V. (2011) Does Writing Have a Future? Minneapolis: University of Minnesota Press, p.3.

Sample: Information is now more effectively transmitted by codes other than those of written signs. (Flusser, 2011, p.3)

Flusser’s discussion of technical images and coding systems points out that writing is shifting from a linear structure based on the alphabet to an information system composed of multiple technical codes. This suggests that in the future, text may gradually no longer be intended for human reading, but instead exist in forms that are more easily processed by machines, such as being handled and transmitted through more efficient technical media. These codes transform text into data structures, thereby altering how legibility is determined. However, this does not mean that human reading systems should be marginalised.

Based on this, my project explores and questions how legibility will be redefined when writing is taken over by machines. Therefore, I interfere with OCR recognition mechanisms to resist this tendency, allowing text to detach from machine grammar. Through this practice, I aim to explore whether design can possess the possibility of refusing machine recognition, and whether we can use design to reclaim ownership over text—for example, by creating distorted typography that can only be understood by humans but not recognised by machines.

·

3. Yang, J. (2020) Motion typography of Back to Me. Available at: https://bennybiangbiang.com/Back-to-me (Accessed: 27 April 2026).

Sample:

During my research, I found that machines’ ability to recognise dynamic content is significantly weaker than that of humans. This led me to explore dynamic typographic effects. The film produced by Yang inspired me to experiment with dynamic deformation of text.

In this film, the motion of the text changes according to the rhythm of the background music; the more intense the rhythm, the greater the amplitude of the movement. This makes legibility a constantly shifting condition.

For machines, recognition relies on clear character structures within fixed frames, and dynamic deformation interferes with OCR detection mechanisms. Humans, however, can integrate information through temporal continuity; even if a single frame cannot be recognised, meaning can still be inferred through the process of change. In my website, I combine animation speed with distortion so that text remains in a continuously unfinished state, creating a reading environment that is unfriendly to machines but perceptible to humans. This reinforces the distinction that human recognition is temporal, while machine recognition is structural.

·

4. Wecke, M. (2013) C.O.P.Y. P—DPA. Available at: https://p-dpa.net/work/c-o-p-y/ (Accessed: 27 April 2026).

Sample: The pages of C.O.P.Y remain empty for the human eye. After xeroxing or scanning the book reveals the essay “Copyright, Copyleft and the Creative Anti-Commons” by Anna Nimus. As in open source development, the text’s quality (legibility) gets better with every copy.

In order to conduct exercises that place human and machine legibility side by side, I also created conditions that are favourable to machines but unfavourable to human recognition. My inspiration comes from Wecke’s project C.O.P.Y. In this work, Wecke constructs a machine-prioritised legibility, where the text in the publication is invisible to the human eye and can only be revealed through photocopying or scanning. This mechanism reverses the conventional reading relationship, making the machine the first reader, while humans can only access legibility through the machine.

This brings the discussion back to the question of who has the right to read. In other words, legibility is not simply a property of text; its boundaries are often determined by who the reading subject is. This becomes evidence for my exploration of the differences between human and machine legibility: how design can manipulate the tendency of legibility and place it within a framework that defines who is able to read.

·


5. Queneau, R. (1998) Exercises in Style. London: John Calder.

Sample: This is a collection of 99 retellings of the same story, each in a different style.

In Exercises in Style, Queneau’s experiment of rewriting the same text in 99 variations reveals that textual comprehensibility does not depend on a single form, but can be continuously reconstructed through structural variation. The success of these experiments is closely related to human recognition mechanisms: humans can rely on context, experience, and linguistic patterns to maintain understanding even when the style of a text changes drastically, allowing meaning to exist independently of fixed form.

Queneau’s stylistic variations led me to treat my text-distortion website as an experimental field for testing the tolerance of legibility. By adjusting different parameters, I generate a large number of distorted texts, similar to Queneau’s writing experiments, in order to compare human and machine recognition strategies when encountering transformed text. For example, when faced with difficult-to-read text, humans may move closer, step back, or squint to perceive blurred outlines. Machines cannot do this, but they are able to detect subtle pixel-level information that is imperceptible to the human eye, and use large datasets and recognition models to select the most probable result. Although the two recognition systems differ, both gradually clarify their respective analytical paths through changes in the visual form of text.

·


6. Steyerl, H. (2012) ‘In defense of the poor image’, in The wretched of the screen. Berlin: Sternberg Press, p32.

Sample: The poor image tends toward abstraction: it is a visual idea in its very becoming. (Steyerl, 2012, p.32) 

Steyerl describes the poor image as a visual state that tends toward abstraction through continuous circulation and compression. As image quality decreases, meaning is formed through an ongoing process of generation and transformation. This perspective challenges my earlier practice. Previously, I tended to produce illegibility by disrupting character structures in order to distinguish between human and machine recognition. However, Steyerl argues that when visual information is compressed or disturbed, it does not necessarily become unreadable, but instead enters different reading logics—for example, a mode of recognition that depends on distribution and circulation.

This prompted me to reconsider the differences between machine and human recognition, leading me to generate a series of low-quality textual images for machine recognition. In practice, certain low-quality visual states (such as blur or noise) do not prevent machine recognition. In contrast, humans may lose recognition ability earlier when confronted with highly abstract visual information. Therefore, my research direction shifts from producing illegibility to testing asymmetries between different recognition systems (different humans and different algorithmic models), exploring how legibility dynamically shifts and emerges across different cognitive systems.

·

Line of Enquiry:

This project investigates how legibility operates differently in human and machine reading systems. Traditional typography is designed to achieve clarity or express a particular mode of interpretation (Flusser, 2011), whereas contemporary computational systems such as OCR rely on specific visual features (character shape, stroke continuity, and contrast & edge) to recognise text. I construct an interactive text-distortion website to interfere with these features and analyse their mechanisms.

The focus of this project is not simply to reduce legibility until both humans and machines fail to recognise text. Instead, I aim to observe how legibility shifts, persists, or breaks down across different systems. By generating conditions where text is machine-readable but human-unreadable, and vice versa, I compare the asymmetry between these two recognition logics. I reconceptualise legibility as a dynamic relationship dependent on the reading subject, and use design as a method to redistribute the capacity for recognition across different cognitive systems.

·

7. Yang, X. (2023) TYPES Come and Go. [Online] Available at: https://www.gdcaward.com/op/before_works/detail?id=1009&index=1&backurl=https%3A%2F%2Fgdcaward.com%3A443%2Fhomepage%3Flang%3Dcn&lang=cn (Accessed: 30 April 2026).

Sample:

TYPES Come and Go approaches its research from the paradox that stainless steel can rust, and in conjunction with the growth patterns of rust, employs typographic experimentation to interpret the cycle of iron as an element — forming a typography system co-forged by natural phenomena and human participation. This concept of translating the process of change in natural materials prompted me to expand my investigation of letterform into the direction of gradually generating content through the logic of the natural world. It led me to ask: how can the traces of biological growth serve as an expression of a project’s conceptual framework.

More specifically, my decision to use organisms from the natural world as my subject of study was an iteration of my prior Enquiry Line — seeking out the differences and coexistence between nature and machine through the traces of natural evolution. This is because natural products can grow organically, whereas machines can only learn and evolve through existing knowledge.

The logic by which slime mold searches for food bears a resemblance to the logic by which AI searches for answers: both conduct rapid breadth-first searches with feedback mechanisms to identify the fastest and most optimal route. This is the reason I selected slime mold as my subject of study and proceeded to develop my research further. I therefore chose slime mold as my research subject, and sent my requirements to AI, asking it to generate code from a machine’s perspective to simulate slime mold.

·

8. Lague, S. (2021) Coding Adventure: Ant and Slime Simulations [YouTube video]. Available at:  https://www.youtube.com/watch?v=X-iSQQgOd1A (Accessed: 18 May 2026).

Sample:

I asked AI to help me build this new feature, but it struggled to understand what I was describing. Initially, when I used natural language to instruct the AI — phrases such as “make it more like slime mold,” “give it more vitality,” or “don’t make it look like an ordinary line animation” — it frequently produced visually confusing outputs. I then began searching for coding tutorials related to slime mold, and started communicating with the AI in language closer to the way machines process meaning — terms such as agent-based simulation and pheromone trails. Lague’s slime mold effect coding tutorial proved pivotal. This reference functioned as a form of translation for me, enabling me to understand the behavioural systems and operational logic of code-based programming.

The process of this exploration itself became one of my research methods: I treated my communication with AI as a means of investigating the differences between human and machine. Throughout this process, I observed how the AI interpreted and misread the content I was expressing. By continuously defining rules for the AI — constraining its tendency toward “overinterpretation” and semantic distortion, and providing references and limiting conditions — I transformed human-machine collaboration into a practical experiment concerning legibility and comprehension. This is also the significance of my process of negotiation with the machine.

·

9. Valladares, D. (2023) Organism Generator. Available at:  https://valladares.dev/organism-generator (Accessed: 18 May 2026).

Sample:

Valladares’s project Organism Generator provided me with inspiration for interactive web functionality. Like my own project, this website was built with AI assistance. Valladares documented his conversation process with ChatGPT, and used p5.js to create the interactive features within the site. It inspired the “Feed” function I subsequently incorporated into my website. Within my slime mold typography system, when the mouse clicks anywhere on the screen, that position is treated as a high-concentration nutrient zone that attracts the slime mold. The slime mold trails, which originally grow along the structural forms of the letterforms, temporarily abandon their typographic configurations and rapidly converge toward the clicked location. Within this interaction, the audience’s use of sliders to adjust parameters is conceived as an act of altering the growth conditions of a living organism.

The Feed function responds to my research on legibility. It invites the audience to participate in the process through which legibility is constructed and dismantled. The user’s clicks simultaneously generate new visual aggregations and accelerate the dissolution of textual meaning. Through this function, I aim to convey to the viewer that what I have created is not a website that produces fixed images through SVG filter effects — it is a dynamic system that is continuously transformed by interaction, by human agency, and by the machine.

·

10. Chun, W. H. K. (2018) ‘On Patterns and Proxies’, e-flux architecture. [Online] Available at: https://www.e-flux.com/architecture/accumulation/212275/on-patterns-and-proxies (Accessed: 30 April 2026).

Sample (My Work):

In order to further understand the logical patterns of machines, I referenced Chun’s discussion in On Patterns and Proxies, in which she addresses two core concepts in machine learning and algorithmic recognition: pattern recognition and proxy. She argues that machines do not recognise the world through understanding in any human sense, but rather make judgements through statistical patterns and proxy features. That is to say, algorithms do not truly comprehend faces, letters, or identities — they merely identify a set of features that can be computed and classified. This argument connects directly to my project, as the Interactive Typography Website I have produced tests, through various methods and interventions, how these proxy features are recognised and how they break down.

Chun’s perspective offers a precise critical framework that prompted me to reconsider legibility in terms of both human and machine recognition. In the earlier stages of my project, I framed human and machine recognition as opposing modes of judgement: humans rely on context and association, while machines rely on structure and feature. However, Chun’s position on pattern led me to recognise that human reading is also dependent on pattern — although this pattern is not entirely equivalent to the machine’s proxy model. This shifted my research from exploring what is legible to humans but not to machines, toward asking: “What kinds of patterns does each recognition system depend upon? Under what conditions does each maintain legibility, and under what conditions does it break down?”

Chun’s argument suggests that machine recognition is not a neutral technical process — it is a power mechanism that transforms the world into computable features. This directly connects to the inquiry within my project concerning who is authorised to read. When design can render text legible to humans but not to machines, or legible to machines but not to humans, legibility is no longer an intrinsic property of the text itself — it becomes a relationship that is allocated on the basis of power. OCR’s recognition of text depends on visually computable cues such as character outlines, stroke continuity, edge clarity, and shape similarity. In Chun’s framework, these cues are understood as the proxies through which machines are able to identify text.

I therefore incorporated new features into the website through which audiences can use sliders and the Feed function to allow the slime mold growth system to participate in this allocation. These features can disrupt the morphology of letterforms, causing the character outlines, stroke continuity, edge clarity, and shape similarity of letters to lose regularity and become difficult to decipher — thereby undermining the proxy features upon which machines rely to identify text. Within the slime mold function, letters are gradually conjoined and reorganised through a biomorphic growth logic. This process transforms text from a stable object of recognition into a continuously evolving visual system that resists easy categorisation. This approach redirects the purpose of the text produced by the website: shifting from the goal of image quality degradation toward a reorganisation of the judgement structures upon which machines depend. I hope that this allows audiences, through their engagement with the function, to experience the process by which legibility is gradually constructed and dissolved through their own acts of “allocation.” In doing so, I employ my visual experiment as a bridge between the study of the politics of legibility and the relational dynamics of human-machine communication.

·

11. Duterne, M. (2023) Physarum type tool. Available at:  https://maxenceduterne.com/physarumtype (Accessed: 18 May 2026).

Sample:

Duterne’s Physarum Type Tool is a custom ecological simulation type tool that simulates physarum. It conceives of typography as a process capable of growing, diffusing, and losing stable boundaries. Within this project, the visual form of text exists in a state of continuous generation and transformation — an approach very close in spirit to my own project. I therefore drew on the visual effects presented in the Physarum Type Tool as a reference. In this project, the edges of letterforms are encroached upon by a growth logic analogous to that of Physarum polycephalum; strokes gradually extend outward, altering the original typographic structure in the process of expansion. Specifically, once text is entered into the website, the letters begin from a relatively conventional serif structure and progressively develop the tendril-like extensions characteristic of physarum. The entire process cannot be rewound or halted, requiring the audience to observe its continuous evolution without being able to fully control it.

The key critical stance of this project is embedded within its formal properties. It embodies a force through which nature is gradually reorganised in the process of growth, and employs the means of machine-simulated nature to manifest a sense of dramatic contradictory tension. For me, this represented an important provocation and inspiration. It prompted me to ask: what happens if the meaning of typography no longer derives from the designer’s direct control over form, but rather from the growth process of the system itself? As a result, across the second and third weeks of my website iterations, my focus gradually shifted from controlling typographic deformation toward allowing the text to be taken over by a biomorphic system. Having analysed what type of code the Physarum Type Tool used to achieve this cyclical effect, it became for me less a visual reference than a resource for exploring how humans and machines communicate with one another.

Consequently, in the third-week iteration, I removed the sliders and instead established a more autonomous slime mold growth system. This system is structured across three stages: Early Growth, Expansion, and Overgrowth. The text initially remains legible, but as the slime mold form diffuses freely, the letterforms gradually coalesce until they become an organic mass that can no longer be stably read. This transformation shifted my project from an interactive typography tool to an autonomous typographic organism.

Duterne’s project deepened my understanding of graphic communication design — specifically, the use of typography as a medium to generate meaning through loss of control and instability. It embodies communication through the very process by which text progressively loses its legibility. For instance, when I input the text “read this” into the website, the process by which the text is gradually eroded and rendered illegible itself communicates the core intention of the project. In this process, meaning migrates from semantic content to visual transformation and system behaviour. Duterne’s project therefore not only provided a reference for my visual form, but also helped me understand typography as a communication system possessing vitality, processuality, and performativity. This shifted my understanding of typography from a visual form controlled by the designer to a visual practice realised through human-machine collaboration.

·


12. Tsing, A.L. (2015) The Mushroom at the End of the World: On the Possibility of Life in Capitalist Ruins.  Princeton University Press.

Tsing’s The Mushroom at the End of the World provided my project with a broader ecological and critical framework. Although this book is not a direct reference to typography or coding, it helped me reconceptualise the duality of “ruins” and “mycorrhizal symbiosis” — that is, their coexistence rather than mutual annihilation. Within this condition, the relationship between existence and dissolution is one of symbiotic relationship: they sustain one another and co-evolve. The mushroom, as a particularly exemplary carrier, embodies precisely this. This concept of exploring relational dynamics and the generation of meaning formed a critical connection with my practice of investigating the collapse of legibility.

Tsing’s discussion of unstable ecological relationships inspired my thinking about communication: the disappearance of legibility does not equate to the disappearance of meaning, but rather signals the beginning of another form of communication. Tsing’s framework enabled me to understand slime mold typography as an ecological communication system — in which text, audience, AI, and biological logic collectively constitute an unstable relational network. This exploratory trajectory has also continuously reminded me, throughout subsequent iterations, to regard the loss of control within code as a productive new material, and to incorporate it as a constituent part of the research. This directly responds to the central concern of my project: how meaning continues to be generated under conditions that cannot be fully controlled.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *