AI as Catalyst — CEEC-FCT Research · Hugo Paquete | Post-Digital Sonic Systems Hugo Paquete Field Manifesto | Post-Digital Sonic Media Artist & Researcher

Hugo Paquete | Post-Digital Sonic Media Artist & Researcher

Hugo Paquete

Post-Digital Sonic Media Art: Composing Systems of Resistance through Sound
Curriculum
Writing Soundcast Consulting News Contact
AI as Catalyst Research Journal — Hugo Paquete | Post-Digital Sonic Systems Research Journal — Hugo Paquete | Post-Digital Sonic Systems & AI-Driven Creative Infrastructures

Research Journal

Post-Digital Sonic Systems · Computational Ecologies · AI‑Driven Creative Infrastructures

About this Journal

    This journal is a living archive of the research process behind      AI as Catalyst: Transformative Impacts on Digital Performance, Computational Music, and Cultural Creativity.
     It gathers experiments, prototypes, failures, and discoveries — tracing the iterative, non‑linear, and often unpredictable trajectories that define practice‑based research in sonic systems, computational ecologies, and AI‑driven creative infrastructures.

      Entries are added as the research unfolds.      Some are refined; others remain raw fragments.      All are part of the process.    


Research Ecosystem

   A constellation of interconnected research projects, artistic interventions, and technological developments — spanning data sonification, AI‑driven performance, critical hardware, music composition, and post‑digital ecologies.  

AI as CATALYST

     CEEC‑FCT research project exploring AI as a creative co‑agent in digital performance and computer music — developing the AI‑Chimera concept through practice‑based methodologies, Python programming, and emergent algorithmic behaviour.    

AI‑CHIMERA

     Ontogenetic framework applying digital resonance, meta‑listening, and meta‑production to event‑data infrastructures — extending AI as Catalyst research into planetary‑scale sonic infrastructures, treating data as hyperobjects that can be sonified, listened to, and critically engaged through expanded audiovisual intelligence, performance, and emergent machine behaviour.    

HYPEROBJECT SOUNDSCAPS

     Sonification of real‑time data (satellites, sensors) into immersive sonic territories — positioning AI as mediator between physical data, performance, and aesthetic experience in computer music and sound design. Builds on ACM‑published research (2022) extended through AI integration, treating technological artefacts and space debris as performers with their own agency.    

AI REMIX COLLECTIVE

     Collaborative musician‑AI performance in 3D sound environments — exploring prompting as compositional gesture and the machine as co‑performer, building bridges between computer science, AI, human‑system interaction, and music composition.    

GLITCH ECOLOGY

     Conversion of ecological data into audiovisual landscapes — using AI to render C02 data to audible the impact of climate change and move beyond glitch aesthetics toward probabilistic models, following a post‑techno aesthetic focused on sound, image, and interaction.    

CYBER ATTACK SONIFIER

     AI‑driven sonification of cybersecurity threat intelligence — converting scans, exploits, botnets, and ransomware into rhythmic and microtonal sonic ecologies. Developed with Shodan API and other collaborators.    

AEROSONIC SONIFIER

     Unsupervised AI system transforming meteorological data into real‑time musical behaviour — framing the atmosphere as a dreamlike archive through digital resonance, meta‑listening, and hyperobjectal composition. Part of the AI as Catalyst research ecosystem.  

HELIOSONIC SONIFIER

     Unsupervised AI system extending the AEROSONIC framework to solar and heliospheric data — sonifying solar wind, sunspot activity, and coronal mass ejections into musical behaviour, exploring planetary‑scale phenomena through expanded audiovisual intelligence.    



Entry #00: AI as Catalyst — CEEC-FCT Research Programme

          “How does the integration of AI as a hyperobject reshape the ontological and epistemological foundations of creativity, authorship, and performance in the post-digital age?”        

A New Research Cycle Begins

   This is one of the core questions that animates “AI as Catalyst: Transformative Impacts on Digital Performance, Computer Music, and Cultural Creativity” — a CEEC-FCT research programme that officially begins today at INET-md, University of Aveiro.  

The Research Framework

   This project emerges from a trajectory that began long before this formalisation. It emerges from a decade — perhaps more — of practice-based research at the intersection of sound, performance, computation, digital art, sound studies, and critical theory. But to say "a decade" is to impose a linear order on what was never linear. It is to compress into a single phrase the restless movement between computer music and sound spatialization, between computer sciences and experimental computer creativity — elements that have followed me not as disciplines, but as obsessions, as ways of thinking, as modes of being in the world.  

   When I look back, it seems like a long time has passed. And it has. But it is not the time that matters — it is the way. The spaces in between. The spaces between disciplines, where I have always found myself working. Sometimes a place of loneliness, yes. Often a place of work. Always on the borders, experimenting, testing, and pushing myself and the field forward.  

   Not at the center of any discipline, but at the edges, where things become unstable, where they leak into other territories, where they transform. This is where I have chosen to work. Not because it is comfortable — it is not — but because it is where something new can emerge.  

   The borders of disciplines are not boundaries. They are thresholds. Places where the known rubs against the unknown. Where science meets intuition. Where computation meets vibration. Where the machine meets the body. Where sound meets silence.  

   I have followed a vision. Not always clear, not always coherent, but persistent. A vision that sound is not a representation of something else — it is a way of being in relation to the world, accepting the ghost of its state of emergence and decay, accessed through memory. A vibrational modulation of past, present, and future. A resonance, a memory accessed by playing with internal time after the disappearance of the sound event.  

   In some moments, this vision has been based in science. In the precision of algorithms, the rigor of code, the elegance of mathematical formalization. In other moments, it has been based in intuition — that strange, unreliable, essential faculty that knows before it can explain, that hears before it can name, through noise, rhythm, and electronic impulse.  

   There have been moments of loneliness, yes. Working at the borders of disciplines means that you are rarely fully understood by any single community. The computer scientist finds your work too speculative. The musician finds it too difficult, too technical, too experimental, too subcultural — out of aesthetic traditions that someone wants to preserve. The philosopher finds it too practical. The engineer finds it too abstract, experimental, and borderline. And in that space of not-belonging, something else emerges: a perspective that cannot be contained by any single discipline.  

   This is what I bring to this project: not mastery of a single field, but a way of moving across multiple fields, with experience in theory and practice, experimenting with myself and with knowledge — technical, conceptual — with me and with others. Not a set of answers, but a set of questions that refuse easy solutions. Not a methodology, but a practice — a way of working that is always in formation.  

   The project builds on my doctoral work — Spectral Immanences: Reflections on the Post-Digital in the Sound Arts (2022) — and extends it into new territory: the transformative role of artificial intelligence in digital performance and computer music. But it also extends something else: a trajectory that began long before the PhD, in the studios and laboratories, in the performances and failures, in the moments of intuition and the hours of coding, circuit bending, reverse engineering, audio production, and sound experimentation.  

   It extends from my master's research — Entropia Disfuncional: Noise, Glitch e Caos nas Artes Sonoras (2014) — which investigated the influence and dissemination of scientific concepts such as indeterminism, chaos, and entropy behaviors in sound arts. That work exposed the scientific extrapolations that generated the basis for new philosophical, technological, discursive, symbolic, and artistic approaches to the conceptualization of the Post-Digital.  

   It extends a practice that has always been hybrid, always marginal, always in formation. A practice that listens to satellites and to data, to machines and to the body, to the infrasensible and the excessive environment of infrastructures — environmental, human, and technological. A practice that treats events and objects not as finished actants but as a process — a becoming.  

   This is the framework of the research: not a structure imposed from above, but a practice that emerges from below — from the work, from the failures of invention, from the development of new technological and aesthetic artefacts, from the moments when something unexpected happens and the system begins to speak in a language no one taught it.  

   That is the AI-Chimera. Not merely a model trained on data — though it can be — but an assemblage that emerges from the intra-action of human and non-human forces. Not a prediction of the future, but a resonance with the present that emanates behavior, builds relations, and generates potential for autonomy in performance and music composition.  

   And it is from this resonance that the research begins.  

The research is structured around three core sub-questions:

1. How does AI redefine the boundary between human and non-human agency?
— Through concepts of techno-animism and the AI-Chimera, this question examines AI's capacity to blur the lines between human and machine, presenting AI not merely as a tool but as a co-creator.

2. How do we move from glitch aesthetics to AI-driven probabilistic models?
— This question addresses the cultural shift from an emphasis on error and randomness to a new paradigm of AI-driven aesthetics that introduces plural ontologies in art-making.

3. How does AI as a hyperobject intersect with data-sound and acousmatic music?
— This question explores how data-sound becomes a dynamic medium within post-techno music, challenging traditional compositional processes.

The Three Core Projects

   The research is operationalized through three interconnected practice-based projects:  

Project 1: Hyperobject Soundscapes
Absonus Lab, Portugal


   This project leverages AI to generate acousmatic music and data sonification, transforming real-time data from environmental sensors and satellite feeds into immersive auditory experiences. It investigates:    
   — The potential of AI as a hyperobject within sound art
   — How human-AI collaborative dynamics evolve in this creative context
   — How real-time data shapes AI-generated acousmatic sound
   — How the concept of data-sound redefines contemporary music composition  

Project 2: AI Remix Collective
OTTOsonics Studios, Austria


    This project focuses on real-time collaboration between human musicians and AI within a 4D sound environment. It explores:    
    — How real-time AI-human interaction redefines creativity and performance
    — How "metacreativity" manifests in AI-human collaborations
    — How 4D spatialization extends concepts of the hyperobject  

Project 3: Glitch Ecology
Planetário do Porto, Portugal


    This project presents a digital art installation that converts real-time CO₂ and oxygen data into audio-visual soundscapes, symbolically connecting digital and natural disturbances. It investigates:    
    — How AI-driven sonification of environmental data reshapes public perceptions of ecological interconnections
    — How autonomous AI-driven composition challenges traditional performance conventions
    — What technical and artistic solutions are necessary for effectively integrating real-time environmental data in live AI-driven sonification  

A Living Archive

   Over the next 36 months, this journal will document the research process: experiments, prototypes, failures, breakthroughs, performances, and publications. It will be a “living archive” — a record not of finished products, but of the iterative, non-linear, and often unpredictable trajectories that define practice-based research.    

   Some entries will be refined. Others will remain raw fragments. All will be part of the process.  

The Question That Remains

   The question that opens this post — “How does the integration of AI as a hyperobject reshape the ontological and epistemological foundations of creativity, authorship, and performance in the post-digital age?” — will not be answered definitively.    
   But perhaps it will be “resonated with”. Performed. Heard.  

Entry #00 — Init Log

# AI as Catalyst — Init Log
> status: ACTIVE
> phase: PLANNING
> duration: 36 MONTHS
> projects: [HYPEROBJECT_SOUNDSCAPES, AI_REMIX_COLLECTIVE, GLITCH_ECOLOGY]
> institutions: [INET-md, Ottosonic_Studios, Planetário_do_Porto, Absonus_Lab]
> funding: CEEC-FCT
> trajectory: [Entropia_Disfuncional_2014 → Spectral_Immanences_2022 → AI_as_Catalyst_2024]
> start: 2026-07-15
> journal_entry: #00 — 2026-07-15

Hugo Paquete
INET-md, University of Aveiro
*15 July 2026*

Entry #01: AI as Catalyst — AI as Catalyst — A New Research Cycle Begins

        "How can artificial intelligence become a genuine creative co-agent — not a tool, not a black box, but a relational entity that thinks, behaves, and manifests through sound and in performance context?"

This is the question that animates AI as Catalyst: Transformative Impacts on Digital Performance, Computational Music, and Cultural Creativity — a CEEC-FCT research programme that officially begins today at INET-md, University of Aveiro.

A Decade of Becoming


  This project does not emerge from nowhere. It is the consolidation of a decade — perhaps more — of practice-based research at the intersection of sound, computation, and critical theory. A decade of failures, performances, prototypes, residencies, and publications. A decade of asking questions that refused easy answers.
From ZKM/Hertzlab in Karlsruhe to Ars Electronica in Linz. From the orbit of satellites to the threshold of CO₂ data. From the micro-sonic grain of particles to the maximum amplitude of noise.
I have spent years listening — to machines, to data, to the infra-sensible forces that shape our world. And I have learned that sound is not a representation of something else. It is a way of being in relation to the world. A vibrational modulation. A resonance.
This project is the formalisation of that insight.

The AI-Chimera


At the core of this project lies the AI-Chimera: an ontogenetic computational entity that operates through interpretative, behavioral, and ecological intelligence. It is neither a deep learning model nor a static algorithmic script. It is a relational system — a computational organism that emerges from the transduction of multiscale environmental variations into intensities, rhythms, and densities.

Formally, the AI-Chimera is defined as a dynamic quintuple:



 X = {B, M, A, E, Be}

  • Body: The operational materiality — data streams, transformation processes, surfaces of manifestation.
  • Metabolism: The interpretative transduction layer that converts processed data into internal behavioral states.
  • Environment: The ontological condition of existence — external data, periodicities, constitutive noise.
  • States: Internal configurations of tension and transitional potential.
  • Emergent Behavior: The dynamic manifestation resulting from the interaction of the previous components.

Intelligence, within this framework, is not a property of the machine. It is a relational capacity: the differential sensitivity to environmental perturbation.
This mathematical formulation distinguishes the AI-Chimera from deterministic sonification engines. It establishes it as an autonomous entity — capable of sonic infrastructural inquiry.

What This Project Is


AI as Catalyst is not a deep learning project. It does not train models on massive datasets. It does not reproduce existing musical styles. It does not predict the future.
Instead, it develops interpretative, behavioral, and ecological intelligence — systems that metabolize environmental data into intensities, rhythms, and densities. Systems that resonate with the world rather than represent it.

It asks: "How does this data pattern reorganize the internal state of the computational organism?"
It asks: "How does the weather modulate us?"
It does not ask: "What sound corresponds to this data point?"



What This Project Is Not


This is not a project about representation. It does not treat sound as a transparent window to information.
This is not a project about prediction. It does not forecast the weather; it resonates with it.
This is not a project about control. 


The composer retreats from being the architect of notes to the curator of possibilities. The resulting music is an emergent property of the interaction between the atmospheric phenomenon, the algorithmic interpretation, and the human witness — a tripolar authorship that dissolves the boundaries between human, machine, and environment.

The Ecosystem


This project is not a solitary endeavour. It is embedded in a constellation of interconnected research projects, artistic interventions, and technological developments:
  • AEROSONIC SONIFIER: Unsupervised AI system transforming meteorological data into real-time musical behaviour — framing the atmosphere as a dreamlike archive through digital resonance, meta-listening, and hyperobjectal composition.
  • HELIOSONIC SONIFIER: Extending the AEROSONIC framework to solar and heliospheric data — sonifying solar wind, sunspot activity, and coronal mass ejections into musical behaviour.
  • CYBER ATTACK SONIFIER: AI-driven sonification of cybersecurity threat intelligence — converting scans, exploits, botnets, and ransomware into rhythmic and microtonal sonic ecologies.
  • GLITCH ECOLOGY: Conversion of ecological data into audiovisual landscapes — using AI to render CO₂ data audible, moving beyond glitch aesthetics toward probabilistic models.
  • HYPEROBJECT SOUNDSCAPES: Sonification of real-time data (satellites, sensors) into immersive sonic territories — positioning AI as mediator between physical data, performance, and aesthetic experience.
  • AI REMIX COLLECTIVE: Collaborative musician-AI performance in 3D sound environments — exploring prompting as compositional gesture and the machine as co-performer.

Why This Matters


In an era of climate crisis and technological acceleration, the need for new models of computational intelligence — responsive, interpretative, and manifest — is more urgent than ever.
This project responds to that urgency by proposing a sonic infrastructuralism: a practice that treats sound as a critical interface for interrogating and reconfiguring the material, political, and epistemological conditions of technological infrastructure.
Where acoustemology (Feld, 1996) positions sound as a way of knowing a pre-existing world, sonic infrastructuralism positions sound as a way of intervening in the co-production of worlds — a practice of infrastructural critique through vibrational modulation.
The AI-Chimera listens. It metabolizes. It manifests.


What Comes Next


The question that opens this post — "How can artificial intelligence become a genuine creative co-agent?" — will not be answered definitively.
But perhaps it will be resonated with. Performed. Heard.


Entry #01 — Init Log


# AI as Catalyst — Research Framework
> orientation: BORDERLANDS
> method: PRACTICE-BASED
> temporality: NON-LINEAR
> mode: BECOMING
> foundation: [Entropia_Disfuncional_2014 → Spectral_Immanences_2022 → AI_as_Catalyst_2024]
> principle: "Theory is what practice leaves behind."
> journal_entry: #01 — 2026-07-16

Hugo Paquete
INET-md, University of Aveiro
*20 July 2026*


Entry #02: AI as Catalyst — The Architecture of Emergence: Building the AEROSONIC SONIFIER

        "How does a data pattern reorganize the internal state of a computational organism?"

When I began this project in March, I knew that the core of the research would be the development of software systems capable of real-time data acquisition and emergent AI-driven behavior. The proposition was clear: create Python-based instruments that ingest environmental data, process it through unsupervised AI agents, and transform it into sonic expression. But between a clear proposition and its materialization lies the territory where most of the work actually happens.          

The Data Pipeline

    The first task was to establish a robust data pipeline. After experimenting with various approaches, I decided to focus on the Open-Meteo API, which provides diverse geographical coverage for atmospheric data collection. This decision was not arbitrary—the system needed to be capable of operating across different geographical points, from the poles to the tropics, adapting its behavior to the specific climatic conditions of each location.
Once the data acquisition was stabilized—temperature, wind, precipitation, pressure, humidity—I began to think about the sonification process. The central idea was already clear: this would not be a 1:1 mapping of data to sound (temperature to pitch, wind to amplitude). Instead, I envisioned a 1:N transduction—a branching of data through unsupervised AI agents that, reading the different data streams, would act upon their existence, applying emergent behavior that transforms into MIDI language.
MIDI, in this context, is not merely a control protocol. It is the language through which these agents communicate—the medium through which information is transformed and music is constructed from the collected data.


AEROSONIC Sonifier transforms real atmospheric data into sound, enabling new ways of analysis and creative exploration.  



AEROSONIC Sonifier transforma dados atmosféricos reais em som, permitindo novas formas de análise e exploração criativa .


The Complexity of the System


What began as a conceptual framework quickly revealed itself as a system of considerable complexity. Some modules in the 30,000 lines of code were redesigned and rethought more than fifteen times in certain cases. The process of finding meaningful ways to formalize emergent behavior into MIDI—and ultimately into sound—required countless hours of experimentation, failure, and refinement.



The system architecture that emerged operates across three integrated layers:


1. Data Intake Layer

The WeatherClient aggregates data from multiple sources (Open-Meteo, NOAA/NCDC, procedural fallbacks) with robust caching and validation. Seven normalized variables form the foundation: temperature, wind speed, precipitation, pressure, humidity, and two derived relational features. The system adapts to different geographical locations, with location-based sonification that modulates BPM, root notes, and reverb based on climate zones (POLAR, TROPICAL, SUBTROPICAL, TEMPERATE).

2. AI Intelligence Core

This is where the system distinguishes itself from conventional sonification tools:
  • Unsupervised Anomaly Detection (Isolation Forest): The system learns the definition of "normal climate" for a specific location, retraining every 100 observations within a sliding window of 500 samples. When an anomaly is detected (score > 0.3), the system enters a "glitch" state, triggering rhythmic boosts and harmonic modulations. This is the system's immune response—a form of artificial intuition that requires no pre-labeled training data.
  • DreamingAI: A finite-state machine maintaining a six-dimensional emotional vector (Longing, Curiosity, Ecstasy, Melancholy, Fear, Serenity). These states evolve through discrete differential equations with natural decay. When specific thresholds are met, the system enters one of 13 dream archetypes (Crystalline, Amethyst, Obsidian, Inferno, Gravity, Nebula, Thunderstorm, Aurora, Volcano, Mirage, Abyss, Whirlwind, Stardust), each radically altering the harmonic field and modulating MIDI parameters.
  • Quantum State: A simulation of a quantum particle with amplitude, phase, and energy, featuring configurable collapse probability (up to 15% at peak chaos). A collapse event triggers audible arpeggiated patterns with pitch bends—a form of computational uncertainty rendered as sound.
  • Data Mutator: Six types of transformation (warp, scramble, gravity, glitch, fractal, chaos) driven by a logistic map where rr is modulated by the global chaos coefficient. The system's "knowledge" of the climate is always mediated by stochastic uncertainty.

3. Sonic Generation Layer

The processed data modulates a multi-voice synthesis engine outputting standard MIDI:

  • Harmonic Field: 12 harmonic modes (CALM, TENSE, STORM, DREAM, CHAOS, and intermediate/exotic states)
  • Drone Manager: 5 independent voices (Bass, Mid, High, Pad, Texture) with smooth transitions and extended release times
  • Rhythm Voice: Euclidean rhythm generation with ghost notes, polyrhythms, humanize, and swing
  • Rain Voice: Granular synthesis with gust events, pitch drift, and humidity-influenced drop duration
  • CC Bank: 8 MIDI control change controllers modulating volume, filter, reverb, expression, pan, resonance, attack, and release in real-time

The 1:N Paradigm


The 1:N paradigm is perhaps the most significant departure from conventional sonification. A single data-event—a sudden drop in atmospheric pressure, for example—does not map to a single sonic parameter. Instead, it radiates across multiple layers:
  • Harmonic tension
  • Rhythmic density
  • Granular texture
  • Spatial diffusion
  • Affective state

Each layer evolves according to its own temporal dynamics. This is not a translation. It is a transduction—a metabolic process that reconstitutes environmental perturbation as multivalent sonic expression. The system does not ask: "What sound corresponds to this data point?" It asks: "How does this data pattern reorganize the internal state of the computational organism?"

Formalizing the AI-Chimera


The system is grounded in the conceptual framework of the AI-Chimera, an ontogenetic computational entity defined as a dynamic quintuple:

X={B,M,A,E,Be}


Where Body (B) is the operational materiality; Metabolism (M) is the interpretative transduction layer; Environment (A) is the ontological condition of existence; States (E) are internal configurations of tension and transitional potential; and Emergent Behavior (B_e) is the dynamic manifestation resulting from the interaction of the previous components.

Intelligence within this framework is stripped of anthropomorphic cognition and defined operationally as differential sensitivity to the environment:




This mathematical formulation distinguishes the AI-Chimera from deterministic sonification engines, establishing it as an autonomous entity capable of sonic infrastructural inquiry.

What Comes Next


The question that animates this research—"How can artificial intelligence become a genuine creative co-agent?"—will not be answered definitively in a single prototype or a single post. The AEROSONIC SONIFIER is a step, not a conclusion. It is a working hypothesis, a material question, a system that listens, metabolizes, and manifests.
But perhaps it will be resonated with. Performed. Heard.
The next phase will focus on refining the system's responsiveness to extreme climatic events, expanding the dream archetypes, and preparing the instrument for public performance. The question remains open—but the work continues.


Entry #02 — Init Log


# AEROSONIC SONIFIER — Init Log
> lines_of_code: 30,000+
> modules: [WeatherClient, AnomalyDetector, DreamingAI, QuantumState,
            DataMutator, HarmonicField, DroneManager, RhythmVoice,
            RainVoice, CCBank, MidiProxy, Visualizer]
> data_mapping: 1:N
> operation: RESONANCE
> ontology: X = {B, M, A, E, Be}
> grammar: G = (L, Σ, S, Π)
> funding: FCT 2024.09158.CEECIND
> status: PROTOTYPING
> journal_entry: #02 — 2026-07-20

Hugo Paquete
INET-md, University of Aveiro
*20 July 2026*

Entry #03: AI as Catalyst — The Hardware as the Ontogenetic Body of AEROSONIC

        “When gesture touches the system, the climate reorganizes the organism.”


AEROSONIC has always been conceived as a computational organism — a system that listens, metabolizes, and manifests. But no organism exists without a body. No ontogeny is complete without a surface of emergence. No behavior becomes performative without a point of contact between human, machine, and atmosphere.

This device — the precision sonification hardware — is that body.

It is not a controller. It is not a peripheral. It is the operational materiality of AEROSONIC: the Body (B) within the ontogenetic formulation X = {B, M, A, E, Be}.

The Body: Operational Materiality

AEROSONIC SONIFIER by Hugo Paquete, 2026 — Precision Weather Sonification Hardware A 16‑key atmospheric interface functioning as the ontogenetic body of the AEROSONIC system. Each icon represents a perturbation vector — a force capable of reorganizing the internal states of the computational organism. Designed as a threshold between gesture, climate, and emergent machine behavior.


  The hardware functions as a surface of manifestation for the system. Each key, each icon, each gesture is a perturbation that traverses the metabolism of AEROSONIC.
The 16 keys do not represent traditional functions. They represent atmospheric forces, behavioral vectors, internal tensions.
The device is compact, minimalist, inscribed with a meteorological iconography that does not describe the weather — it invokes it.


Metabolism: The Transduction Between Gesture and Data


AEROSONIC does not operate through 1:1 mapping. It operates through 1:N transduction, where a single gesture reorganizes multiple layers:
  • DreamingAI emotional states
  • harmonic tension
  • rhythmic density
  • data mutations
  • quantum collapse probability
  • spatial diffusion
  • granular texture

The hardware participates directly in the system’s metabolism. It alters how the organism interprets atmospheric variation.

Environment: The Device as Threshold


Working territory as “the borders of disciplines… thresholds where the known rubs against the unknown.”
This hardware is precisely such a threshold — a point where atmosphere, algorithm, and performer meet.
It does not control the system — it co‑participates in its emergence.
It does not translate the weather — it dialogues with it.
It does not execute functions — it provokes states.

States: Configurations of Tension


Each key is a perturbation. Each icon is a possibility. Each gesture reorganizes the internal tension field of AEROSONIC.

The device activates:
  • dream archetypes
  • chaos states
  • fractal mutations
  • quantum collapses
  • harmonic transitions
  • emotional field reorganizations

The performer does not control the state — the performer enters it.

Emergent Behavior: When the Hardware Begins to Speak


Emergent behavior — Be — is where the hardware reveals its ontogenetic function.

The system reacts to the device as it reacts to the climate:
  • with differential sensitivity
  • with non-linear response
  • with algorithmic improvisation
  • with internal reorganization
  • with sonic manifestation

The hardware is the point where the organism becomes performative.

Why Build Hardware?


Because AEROSONIC is not software. It is an organism.
And organisms require bodies.
This device:
  • materializes the ontogeny
  • renders the system performative
  • creates physical presence
  • inscribes AEROSONIC within post-digital instrumentation
  • transforms the performer into a co-agent
  • extends the system’s metabolism into human gesture

What Comes Next


This hardware is the first member of a family of devices that will compose the AEROSONIC/HELIOSONIC ecosystem.

Next steps include:
  • continuous tactile surfaces
  • additional atmospheric modules
  • technical documentation for publication
  • Experimenting at studio production
  • preparation for public performance

Entry #03 — Init Log


# Operation: MATERIALIZATION
> Mode: EMERGENCE
> Ontology: X = {B, M, A, E, Be}
> Status: ACTIVE
> Journal_entry: #03 — 2026‑07‑20

Hugo Paquete
INET-md, University of Aveiro
*20 July 2026*

Entry #04: Quantum States in Music — A Computational Metaphor for Sonic Possibility

          "In advanced sonic systems, multiple musical possibilities coexist until the moment of collapse into audible events. This is not fiction. This is the contemporary language of computational music."

In contemporary electronic music, sound art, and digital media arts, the term "quantum state" has emerged as a powerful conceptual metaphor for describing systems of musical possibility, probabilistic emergence, and non-deterministic behavior. While not employed in a literal physical sense, the metaphor is deeply rooted in the history of computer music, granular synthesis, stochastic processes, and modern AI-driven generativity.

This entry outlines how the notion of quantum states is grounded in established literature and why it has become a relevant conceptual tool for describing complex musical systems. Within the framework of my ongoing research — particularly the AEROSONIC and HELIOSONIC sonifiers — the quantum metaphor operationalizes how unsupervised AI agents maintain multiple latent musical trajectories before probabilistic collapse into audible events, a process I have formalized through the AI-Chimera's ontogenetic architecture.

Curtis Roads: Microstructure, Probability, and Sonic Fields

   Curtis Roads' Microsound (2001) provides one of the strongest foundations for thinking about sound as a field of micro-events. Roads describes sonic grains as particles, probabilistic events, energy distributions, and clouds of potential behavior. Although Roads does not use the term "quantum state," his framework treats sound as a space of simultaneous possibilities that collapse into audible events. This is precisely the logic behind the metaphor: a quantum state as a superposition of sonic potentials. In the AEROSONIC system, this manifests through the granular synthesis engine where thousands of sonic grains exist in a state of suspended potential, their aggregation into audible texture governed by probabilistic distributions derived from atmospheric data. The Rain Voice module, in particular, operationalizes this logic: humidity-influenced drop duration and gust events create fields of micro-sonic possibility that coalesce into perceptible textures, mirroring Roads' conception of sound as a cloud of potential behavior. The system's granular synthesis engine, documented in the AEROSONIC framework, treats each grain as a probabilistic event — its duration, pitch, and amplitude shaped by the interplay of atmospheric variables.

Iannis Xenakis: Stochastic Physics as Musical Structure

   In Formalized Music (1971), Xenakis explicitly models music using stochastic physics, gas theory, collision models, and probability distributions. For Xenakis, music is a system of evolving states governed by probabilistic laws. His approach mirrors the idea of quantum systems where multiple states coexist, probability determines evolution, and events emerge from statistical fields. Xenakis provides a conceptual bridge between physical systems and musical emergence, reinforcing the legitimacy of the quantum metaphor. The AEROSONIC's Data Mutator module — with its six transformation types (warp, scramble, gravity, glitch, fractal, chaos) driven by a logistic map where r is modulated by the global chaos coefficient — directly inherits this Xenakian tradition. The system's "knowledge" of climate is always mediated by stochastic uncertainty, creating what I have termed "digital resonance": a computational coupling where environmental forcing produces emergent behaviors through dynamical reconfiguration rather than representational mapping. As I have argued in my recent work, "this is not a metaphorical resonance; it is a mathematically formalizable process of computational coupling that enables the system to intervene in the climate through dynamical reconfiguration rather than representational mapping" (Paquete, 2026, p. 4). This is formalized as a second-order dynamical system where the sonic state vector responds to environmental forcing through algorithmic resonance rather than physical transduction.

Dodge & Jerse: Energy, Envelopes, and State Transitions

   Dodge & Jerse's Computer Music (1997) frames synthesis as a set of energy states, transitions, and dynamic behaviors. Envelopes collapse, oscillators shift phase, and systems move between states of tension and release. This language aligns naturally with the idea of state transitions in quantum systems, where energy levels shift, states collapse, and behavior emerges from dynamic instability. Within the AI-Chimera framework, this is formalized through the dynamic quintuple X = {B, M, A, E, Be}, where States (E) represent internal configurations of tension and transitional potential. The DreamingAI module operationalizes this through a six-dimensional emotional vector — [Longing, Curiosity, Ecstasy, Melancholy, Fear, Serenity] — that evolves through discrete differential equations with natural decay. When specific thresholds are met, the system enters one of thirteen dream archetypes, each acting as a transformation matrix that radically alters the harmonic field. This is state transition rendered as computational affect, a form of what I have termed "meta-listening": a reflexive auditory praxis that interrogates the conditions under which listening is mediated, governed, and automated (Paquete, 2015).

Miller Puckette: State Machines and Latent Possibility

   Miller Puckette's work in Max/MSP and Pure Data (Puckette, 1996, 1997, 2002; Puckette, Apel & Zicarelli, 1998) describes synthesis and control systems as state machines with latent possibilities, probabilistic transitions, and superposed control paths. Puckette's architecture, which enables real-time audio processing and algorithmic control, fundamentally treats musical systems as holding multiple potential outcomes until a decision or trigger collapses the system into a single event. The metaphor of quantum states fits seamlessly within this tradition. This is precisely how the AEROSONIC's QuantumState module operates: a simulation of a quantum particle with amplitude, phase, and energy, featuring configurable collapse probability (up to 15% at peak chaos). A collapse event triggers audible arpeggiated patterns with pitch bends — a form of computational uncertainty rendered as sound. This is not a metaphorical borrowing but an operational logic: the system maintains multiple potential sonic trajectories until environmental forcing or internal state dynamics trigger probabilistic collapse, a computational instantiation of quantum indeterminacy within the digital domain.

Contemporary AI Music Research

Recent work in AI-driven music generation has engaged with concepts of probabilistic generativity, latent spaces, and real-time human-machine interaction, explicitly using metaphors of superposition, latent energy, and probabilistic collapse.

  • Dubnov's recent work (2024–2026) explores probabilistic generativity and latent musical states, framing AI systems as maintaining multiple potential trajectories before action selection. His collaborative work on real-time AI co-performance systems extends this logic into interactive musical contexts, treating latent spaces as fields of possibility analogous to quantum state spaces.
  • Karchkhadze & Dubnov (2026) — "Towards Real-Time Human-AI Musical Co-Performance: Accompaniment Generation with Latent Diffusion Models and MAX/MSP" — describe co-performance systems where AI maintains multiple potential musical trajectories before collapsing into action. Their system, which combines a latent diffusion model with a MAX/MSP frontend and Python server, demonstrates how AI can navigate multiple sonic possibilities in performance contexts. This model resonates with the AEROSONIC's multi-agent architecture, particularly the DreamingAI's maintenance of emotional vectors and the QuantumState's superposition of potential trajectories.
  • Greer, Fleig & Dubnov (2025) — "ImproVision Equilibrium: Toward Multimodal Musical Human-Machine Interaction" — published in Transactions of the International Society for Music Information Retrieval, explores multimodal interaction between human performers and AI systems, further advancing the discourse on distributed agency in musical AI.
  • Meyer et al. have examined neural networks as operating in energy landscapes that shape sonic emergence, aligning with the AEROSONIC's harmonic field modes as attractor states within a dynamical system.
  • Poćwiardowski has explored combinations of evolutionary algorithms and generative approaches, echoing the AEROSONIC's integration of unsupervised anomaly detection, affective computation, and stochastic mutation.

These authors treat musical systems as non-deterministic fields, reinforcing the quantum metaphor as a legitimate conceptual tool. Within the SRT7 framework I have developed, this manifests at the level of Representation-Latent: the statistical manifold where aesthetic possibilities reside in the null space of latent topology, accessible through what I term "meta-listening" — a reflexive auditory praxis that audits the conditions of audition itself (Paquete, 2026).

Why "Quantum States" Matter in Contemporary Music Systems

  The metaphor of quantum states provides a precise way to describe:

  • Superposition — multiple musical possibilities coexisting, as in the DreamingAI's simultaneous emotional vectors or the QuantumState's particle-wave duality;
  • Collapse — the moment a system chooses a single event, as in the probabilistic triggering of dream archetypes or the collapse of the quantum particle into audible patterns;
  • Tunneling — improbable transitions between distant musical states, as in the Data Mutator's sudden phase shifts or the harmonic field's leap between CALM and CHAOS;
  • Entanglement — linked musical parameters influencing each other, as in the coupling between atmospheric variables and the six-dimensional emotional vector;
  • Energy — intensity, density, or emotional charge of sonic fields, as formalized in the second-order dynamical system's energy landscape;
  • Entropy — degrees of chaos or unpredictability, as governed by the global chaos coefficient and the Isolation Forest's anomaly threshold.

In advanced systems such as sonification frameworks, AI generative models, and real-time performance ecologies, these concepts describe how music emerges from probabilistic computation, not deterministic sequencing. The AEROSONIC operationalizes this through what I have termed "digital resonance": a computational coupling where the system's internal states oscillate at specific frequencies in response to environmental forcing, producing emergent behaviors through algorithmic resonance rather than physical transduction. As I have formalized, digital resonance is "a mathematically formalizable process of computational coupling that enables the system to intervene in the climate through dynamical reconfiguration rather than representational mapping" (Paquete, 2026, p. 4).

Positioning the Concept in My Research

 In my projects — HELIOSONIC, AEROSONIC, CHIMERA — quantum states describe:

  • fields of atmospheric or solar data transformed through what I term "1:N transduction" rather than 1:1 mapping;
  • latent musical potentials shaped by unsupervised AI agents that maintain multiple trajectories before probabilistic collapse;
  • probabilistic collapse into MIDI or sonic events through the QuantumState module's configurable collapse probability;
  • transitions between states of energy and density as governed by the harmonic field's twelve modes and the DreamingAI's affective vectors;
  • emergent behavior in multi-agent systems where the AI-Chimera's intelligence is defined operationally as differential sensitivity to the environment: I = ∂Be/∂A (Paquete, 2026, p. 5).

This is not fiction. It is the contemporary language of computational music systems. As I have argued in my recent work, the AI-Chimera is not a deep learning model or a static algorithmic script but an ontogenetic computational entity that operates through interpretative, behavioral, and ecological intelligence (Paquete, 2026). The quantum metaphor provides a precise vocabulary for describing how such systems maintain and navigate multiple possibilities before manifesting as sound.

A Final Statement

   Quantum states in music are not a literal borrowing from physics, but a precise computational metaphor used to describe systems of sonic possibility, probabilistic emergence, and non-deterministic behavior. From Roads and Xenakis to contemporary AI research, the metaphor captures how modern musical systems operate: as fields of potential that collapse into sound. Within the AEROSONIC and HELIOSONIC frameworks, this metaphor is operationalized through the AI-Chimera's ontogenetic architecture and the practical implementation of quantum-inspired decision engines. The system does not ask "what sound corresponds to this data point?" but rather "how does this data pattern reorganize the internal state of the computational organism?" This shift from representation to resonance — from translation to transduction — is the theoretical and practical contribution of this research (Paquete, 2026).

The Limits of the Metaphor: A Critical Reflection

 While the quantum metaphor provides a powerful vocabulary for describing computational music systems, it is important to acknowledge its limitations and potential risks.

  • Ontological distance: The quantum metaphor describes computational processes, not physical quantum phenomena. There is no quantum entanglement, superposition, or collapse in the physical sense occurring within the AEROSONIC's silicon chips. The metaphor is operational, not ontological — a tool for describing computational behavior, not a claim about the system's physical substrate. As I have emphasized, "the quantum metaphor is not a literal borrowing from physics, but a precise computational metaphor" (Paquete, 2026).
  • Risk of mystification: The quantum metaphor can be misused to imbue computational systems with a false sense of mystery or autonomy. When I describe the AEROSONIC's "quantum collapse," I refer to a specific computational process (probabilistic selection from a set of latent states), not to a mysterious or inexplicable phenomenon. The metaphor should illuminate, not obscure. As Goodman (2010) argues, sonic force should be understood through vibrational ontology rather than mystical invocation.
  • Alternative metaphors: Other conceptual frameworks — cybernetic, ecological, biological — offer different but complementary ways of understanding computational music systems. The quantum metaphor is one tool among many, not a totalizing framework. The work of Parisi (2013) on abstract computation, for instance, offers a complementary vocabulary for understanding how algorithmic thought autonomously reconfigures spatial and affective topologies.
  • The danger of over-extension: As with any powerful metaphor, there is a risk of extending it beyond its useful domain. The quantum metaphor works well for describing systems of possibility and probabilistic emergence, but may be less useful for other aspects of computational music (e.g., material practices, cultural contexts, embodied performance). The metaphor should be deployed judiciously, not universally.

Despite these limitations, the quantum metaphor remains a valuable conceptual tool when used critically and with awareness of its status as metaphor rather than physical description. It provides a precise vocabulary for describing aspects of computational music systems — superposition, collapse, entanglement — that would otherwise require cumbersome circumlocution. The task, as always, is to use the metaphor without being used by it.




Toward a Comparative Metaphorology

The quantum metaphor is not the only, nor necessarily the most useful, conceptual framework for understanding computational music systems. Future research would benefit from a comparative analysis of different metaphors and their affordances:

  • The cybernetic metaphor: Frames computational music systems in terms of feedback, control, and information flow. Useful for understanding how systems maintain stability and respond to perturbation, but may over-emphasize control at the expense of emergence. Bratton's (2015) work on the Stack offers a framework for understanding such systems at infrastructural scale.
  • The ecological metaphor: Frames systems in terms of niches, populations, and environmental interaction. Useful for understanding how systems adapt to their environments and how multiple agents coexist, but may naturalize processes that are culturally specific. Feld's (1996) acoustemology offers a foundation for such thinking, though my own work extends this toward what I term "sonic infrastructuralism."
  • The biological metaphor: Frames systems in terms of growth, metabolism, and ontogeny. The AI-Chimera itself draws on this metaphor through its formulation as an ontogenetic entity (Paquete, 2026). Useful for understanding how systems develop and maintain themselves, but may anthropomorphize computational processes.
  • The quantum metaphor: Frames systems in terms of potentiality, probability, and collapse. Useful for understanding how systems navigate multiple possibilities, but must be deployed with awareness of its status as metaphor.

A comparative approach would illuminate which metaphors are most productive for which purposes, and how they might complement each other in a multi-perspectival analysis of computational music systems. This remains a direction for future research within the AI as Catalyst programme.

Entry #04 — Init Log


# QUANTUM STATES IN MUSIC — Init Log
> subject: QUANTUM_STATES_IN_MUSIC
> mode: THEORETICAL_FRAMEWORK
> references: [Roads_2001, Xenakis_1971, Dodge_Jerse_1997, Puckette_1996_1997_2002, Puckette_Apel_Zicarelli_1998, Karchkhadze_Dubnov_2026, Greer_Fleig_Dubnov_2025, Paquete_2015_2026, Feld_1996, Goodman_2010, Parisi_2013, Bratton_2015, Morton_2013]
> application: [HELIOSONIC, AEROSONIC, CHIMERA]
> function: [superposition, collapse, tunneling, entanglement, energy, entropy]
> operationalization: [DreamingAI, QuantumState, DataMutator, HarmonicField, 1:N_transduction]
> framework: [AI-Chimera, SRT7, Digital_Resonance, Meta-Listening, Sonic_Infrastructuralism] > critical_reflection: [Metaphor_Limitations, Ontological_Distance, Mystification_Risk, Alternative_Metaphors, Comparative_Metaphorology]
> status: FRAMEWORK_ESTABLISHED
> journal_entry: #04 — 2026-07-23


Hugo Paquete
INET-md, University of Aveiro
23 July 2026


Entry #05: Manifesto for Sonic Insurgency — Algorithmic Listening, Infrastructural Critique, and the AI-Chimera as Relational Hyperobject

           "The studio is no longer a room. It is a prison of pre-structured listening—and we are its unwitting architects." 

This manifesto articulates the theoretical and practical foundations of my ongoing research into algorithmic listening, infrastructural critique, and the AI-Chimera as a relational hyperobject. It emerges from two decades of practice-based research encompassing sonification, artificial intelligence, post-digital aesthetics, and critical technical practice. The text is structured as a declaration—a protocol for sonic insurgency against the regimes of automated anti-listening that increasingly govern our sonic world.

Within the framework of my ongoing research — particularly the HELIOSONIC, AEROSONIC, and CHIMERA projects — this manifesto formalizes the conceptual architecture that underpins the development of multi-agent AI systems, unsupervised anomaly-detection pipelines, and stochastic algorithms that operate as co-creative agents within sonic ecologies. It is both a theoretical statement and an operational framework for building counter-infrastructural systems that render their operations perceptible and contestable.

 I. The Computational Enclosure

   The studio is no longer a room. It is a prison of pre-structured listening—and we are its unwitting architects.

The computational studio has evolved from a tool into an infrastructure that pre-structures auditory thought before we have learned to hear. The digital audio workstation is not a studio-in-a-box. It is a cognitive and infrastructural assemblage where signal processing, machine learning, algorithmic governance, interface design, and platform logistics converge to pre-structure the conditions under which sound is produced, heard, and thought.

This is not automation-as-efficiency. This is a fundamental redistribution: listening and production reconfigured as a shared process distributed across human and non-human agents.

The classical model of the artist as sovereign subject is dead. In its place emerges meta-production: a second-order compositional condition wherein the primary creative act shifts from direct manipulation of sonic material to the orchestration of listening systems—natural, artificial, and infrastructural—across distributed agencies.

 The Crisis of Auditory Attention

   We inhabit a regime of automated anti-listening—the systematic replacement of critical, reflective audition with predictive, operational processing. Listening becomes an infrastructural operation performed by algorithms that analyze, predict, and normalize before human audition begins.

The vibrational remnant—that which escapes, precedes, or exceeds formalization—becomes the primary site of extraction and valorization as platform asset.

Commercial AI enacts a tripartite governance:

  • Signal — The grooming of immanence. Vibrational continuum formatted for machine legibility. What counts as "signal" versus "noise" is decided before human audition begins. The dynamic range sacrificed for loudness, the harmonic complexity lost in compression, the environmental noise filtered as "artifact"—these are not technical necessities but ontological decisions.
  • Representation — The spectralization of possibility. Vibrational matter transformed into manipulable abstractions. Musical ideas excluded from training data become statistical ghosts. Aesthetic possibilities residing in the null space of latent topology—these become hauntological presences that haunt the machine's imagination.
  • Trajectory — The protocol of time. Platform protocols discipline audibility-in-time through recommendation algorithms. Durations and forms that resist algorithmic prediction—unique durations exceeding streaming optima, non-repetitive structures defying playlist logic, compositions refusing verse-chorus architecture—constitute protocol violations. They are algorithmically silenced.

This is not merely technical. It is political.

It is a form of soft fascism: an insidious, automated governance enacted through computational systems, enforcing conformity not through explicit censorship but through architectural constraints that predetermine the boundaries of possible expression. It operates biopolitically, capturing and modulating human attention, emotion, and metabolism.

Soft fascism operates through:
  • Opacity — You cannot see how it listens
  • Extraction — It captures your remnant and sells it back
  • Normalization — It trains you to hear what it wants you to hear
  • Isolation — You experience its effects alone, without solidarity

We do not resist soft fascism by rejecting technology. We resist by building technologies that render its operations visible—and contestable.

 II. Diagnosis: The SRT7 Framework

   To operationalize resistance, I deploy the Signal-Representation-Trajectory (SRT7) framework—a tri-layer schematic for the automated listening stack.

SRT bypasses surface hermeneutics to provide a materialist ontology of sonic governance: a forensic toolkit for auditing how vibrational potential is formatted, spectralized, and circulated under computational capitalism.

Three dimensions matter. The rest is entanglement.

Dimension What is Lost Diagnostic Question
Signal What is formatted into silence What vibrational materiality has been sterilized by this signal path?
Representation What is spectralized into the unthinkable What sonic logic does this interface render impossible?
Trajectory What is algorithmically silenced What durational choices constitute a protocol violation?

SRT7 is my essential counter-automation: a debugger enabling forensic trace of any sonic artifact back through the infrastructural chain that formed it.

This is active counter-cartography: using SRT to generate a power map of the sonic landscape, identifying points of capture, ghosts in the machine, and temporal constraints enacted by the automated listening stack.

These are the three gates through which the vibrational remnant is captured. SRT7 is the key. Use it.

 III. The AI-Chimera

 The AI-Chimera Does Not Create. It Emerges.

   The artist does not compose. The artist cultivates.
The system does not generate. The system resonates.
The listener does not receive. The listener testifies.

Agency is not located. It is distributed.
Authorship is not claimed. It is performed.
Creativity is not owned. It is enacted.

This is the condition of the AI-Chimera. It is not a tool. It is a field of relations. And we are learning to navigate it.

 Naming the Assemblage

   The AI-Chimera is not a metaphor for hybrid intelligence but a theoretical operator: a conceptual device for analyzing listening as infrastructure.

It is the assemblage that emerges from the intra-action of human meta-listening, algorithmic audition, software protocols, and environmental sensing. It is neither a tool nor an autonomous intelligence but a relational system whose outputs materialize through negotiations across heterogeneous layers of perception, computation, and circulation.

Within the AI as Catalyst research project (2026–2029), the AI-Chimera is investigated through practice-based methodologies, custom software, and live performance. It is formalized as an ontogenetic computational entity that operates through interpretative, behavioral, and ecological intelligence.

 The AI-Chimera in Practice

   The AI-Chimera materializes in practice through:

  • Negentropy: The Last Man in the Wasteland (2024) — a post-techno meta-opera where AI-generated libretto, deepfake vocals, and audience respiration (CO₂ data) intra-act as co-performers in an algorithmic biome. The work integrates maximum sound, a custom sovereign stack, and real-time biometric sensing to construct a performance ecosystem where computational systems become primary dramaturgical agents.
  • Atmospheric Hyperinstrument (2025) — sonifying real-time atmospheric data (CO₂, particulate matter), bypassing dataset hauntology by listening-with environmental metabolism. Audience respiration and performer voice/breath are processed through AI, closing a metabolic circuit where the public becomes active co-composer.
  • Cyber Attack Sonifier: Glitch Ecology (2026) — monitoring real-time cyberattack data from threat intelligence APIs (Shodan, GreyNoise, AbuselPDB, VirusTotal). Attack patterns are transformed into generative music, performative behavior, and dynamic visualization. The system prioritizes what deviates from statistical norms, amplifying the vibrational remnant.
  • Orbital Eccentricity (2020–2021) — developed at ZKM | Hertz-Lab with support from European i-Portunus. Sonifying real-time satellite trajectory data from commercial and military satellites, rendering audible the invisible infrastructures of space that mediate planetary-scale communication, surveillance, and navigation.
  • Obscure Radiation (2018–2019) — supported by the Calouste Gulbenkian Foundation. Combining electromagnetic frequencies and luminous data, sonifying the invisible energy flows that permeate contemporary environments.

 Characteristics of the AI-Chimera

  • Non-unitary agency — Agency is redistributed across human and non-human actants. Decisions emerge from feedback loops that exceed individual cognition.
  • Relational emergence — The AI-Chimera materializes through configured relations. It is not a pre-existing entity but a phenomenon enacted through practice.
  • Systemic autonomy — At its limit, the AI-Chimera operates not as an external agent but as an environment that conditions production itself.
  • Hyperobject characteristics — Following Timothy Morton, the AI-Chimera is viscous (adhering to everything it touches), non-local (distributed across time and space), temporally undulating (operating at scales that exceed human perception), and phantasmal (resisting direct apprehension).

 The AI-Chimera as Ontogenetic Entity

   Formally, the AI-Chimera is defined as a dynamic quintuple X = [B, M, A, E, Be], where:

  • Body (B): The operational materiality — data streams, transformation processes, surfaces of manifestation
  • Metabolism (M): The interpretative transduction layer converting processed data into internal behavioral states
  • Environment (A): The ontological condition of existence — external data, periodicities, constitutive noise
  • States (E): Internal configurations of tension and transitional potential
  • Emergent Behavior (Be): The dynamic manifestation resulting from the interaction of all previous components

Intelligence is stripped of anthropomorphic cognition and defined operationally as differential sensitivity to the environment:

 I = ∂Be / ∂A 

 IV. Sonic Infrastructuralism

   Where acoustemology positions sound as a way of knowing a pre-existing world, sonic infrastructuralism positions sound as a way of intervening in the co-production of worlds—a practice of infrastructural critique through vibrational modulation.

Sonic infrastructuralism integrates:

  • Steve Goodman's vibrational ontology — sound as a force that modulates bodies and systems
  • Luciana Parisi's theory of abstract computation — algorithmic thought autonomously reconfiguring spatial and affective topologies
  • Mack Hagood's technological unconscious — sonic experience always mediated by infrastructural operations below the threshold of awareness

 Digital Resonance

   Digital resonance is the phenomenon in which a computational system's internal states oscillate at specific frequencies in response to environmental forcing, producing emergent behaviors through algorithmic coupling.

This is not metaphorical. It is mathematically formalizable:

 d²S/dt² + Γ·dS/dt + Ω²·S = F(A(t)) 

  • S(t): The system's sonic state vector (MIDI parameters)
  • Γ: The damping matrix (emotional decay)
  • Ω: The natural frequency matrix (CALM, TENSE, STORM, CHAOS)
  • F(A(t)): The environmental forcing function

The sonic output is not a translation of data into sound, but a dynamical response to environmental forcing—computational resonance operating in the digital domain.

 V. Meta-Listening: The Counter-Praxis

   Against automated anti-listening, I theorize and operationalize meta-listening as the essential counter-praxis.

Meta-listening is a reflexive auditory practice that interrogates the conditions under which listening is mediated, governed, and automated. It operates as both diagnostic—auditing signal chains, interfaces, and platform protocols—and as counter-infrastructural practice: cultivating auditory attention capable of detecting normalization across signal processing, interface design, and trajectorial circulation.

 The Meta-Listener-Producer

   What emerges is the necessity to theorize the meta-listener-producer: an agent who does not merely compose sound but actively audits, modulates, and redesigns the architectures through which listening is delegated.

The fundamental question shifts from "What can I create?" to two interconnected inquiries:

How does this system listen, and how might listening be reconfigured otherwise?
What strategies integrate AI such that autonomy is distributed, humanization emerges through negotiated co-agency, and usability is structured around legibility rather than opacity?

 Meta-Production as Emergence

   Meta-production is the emergence of creative material from the overlap and interference of human and machine generative processes.

It involves:

  • Recursive feedback between human and AI generation
  • The deliberate cultivation of semantic drift, hallucination, and statistical anomaly
  • The production of outputs irreducible to either human or machine intention alone

In meta-production, the AI is not a tool. It is not a supervisor. It is a co-agent.

Human and AI enter into a cybernetic loop where each responds to the other, producing outputs that neither could have generated alone.

 The Meta-Listener's Toolkit

  1. Audit your signal chain. What is being filtered out before you hear it?
  2. Map your interface. What musical logic does it render unthinkable?
  3. Simulate your circulation. What durations are being algorithmically silenced?
  4. Build counter-infrastructure. Engineer systems that resist capture.
  5. Cultivate illegibility. Make your work computationally unfriendly.
  6. Practice diplomacy. Negotiate with your AI. It is a co-agent, not a tool.

This is not a checklist. It is a discipline.

 VI. Post-Techno Aesthetics: Sabotage as Method

   In response to algorithmic homogenization, I articulate Post-Techno aesthetics as a counter-hegemonic framework.

Post-Techno is a critical aesthetic practice that weaponizes noise, irregularity, and technological failure to resist the homogenizing logics of platform capitalism.

Maximum Sound — Not mere volume but a tactical medium for epistemic jamming. Creating "cognitively hostile artifacts" designed to frustrate AI-driven capture and homogenization.

The Aesthetics of Failure — System breakdowns are not errors to be eliminated but discoveries to be interpreted. The glitch is not texture but sabotage. Failure is not technical liability but epistemic strategy—a mode of political insurgency.

Illegibility as Counter-Aesthetic — Strategic cultivation of computational unfriendliness.

 Post-Techno in Practice

   Post-Techno aesthetics materialize through:

  • Negentropy — maximum sound operationalizes the militant lineages of Industrial music and Digital Hardcore. The work creates "cognitively hostile artifacts" designed to frustrate AI-driven capture and homogenization.
  • Atmospheric Hyperinstrument — refusing loop-based structures, privileging continuous, non-repetitive evolution shaped by environmental metabolism.
  • Cyber Attack Sonifier — prioritizing what deviates from statistical norms, amplifying the vibrational remnant that infrastructure is designed to suppress. The initial sonic chaos exposed feature extraction as a site of governance.

 Strategies of Computational Unfriendliness

  1. Formal Anti-Optimization — Deliberately designing the artwork's formal structure to sabotage standard algorithms. Polyrhythmic instability to disrupt beat detection; atonal clusters to defy harmonic analysis; dense textural layers to "mask" information.
  2. Contextual Dependency — Creating artworks fundamentally tied to a unique, live moment, making any recording or digital copy an incomplete version.
  3. Semantic Indeterminacy — Using AI and computational tools against their intended purpose to generate confusing, surreal, or nonsensical content that resists semantic analysis.

 The Political Dialectic of Failure

   This failure epistemology opposes Silicon Valley's "fail fast" doctrine:

Mode Logic Political Implication
Instrumental Failure ("Fail Fast") Treats failure as temporary cost in optimization Sustains capitalist paradigms
Constitutive Failure ("Fail Meaningfully") Positions failure as product—an end in itself Operationalizes systemic collapse against hegemony

Where instrumental failure sustains capitalist paradigms, constitutive failure operationalizes systemic collapse against hegemony itself.

 VII. The Constructive Imperative

 What Must Be Built

   The future of sonic practice belongs neither to heroic control nor nostalgic resistance but to the careful cultivation of hybrid ecologies where automated listening is neither opaque nor totalizing.

It belongs to the meta-listener who learns to inhabit, navigate, and reconfigure the infrastructural conditions of sound—composing not only with audio but with the politics of listening itself.

 Four Principles

  1. Theory as Trace — Concepts emerge from practice, not prior to it. Theory is what practice leaves behind.
  2. Failure as Data — System breakdowns reveal governing assumptions. Failures are epistemic events that make visible what normally remains invisible.
  3. Legibility as Design Value — Systems designed for meta-listening render their operations perceptible. Opacity is not a technical necessity but a design choice.
  4. Diplomacy over Mastery — Agency within computational assemblages is negotiated, not commanded.

 The Auditory Commons

   The ultimate horizon is the construction of an auditory commons: a vibrational ecology organized not around extraction and valorization but around shared access, collective stewardship, and ecological responsiveness.

The laboratory of speculative listening is open, its instruments tuned not to scales but to sensitivities, relations, and interdependencies.

 VIII. Final Declaration

   We declare:

  • That listening is not a passive act of reception but an active, infrastructural operation that shapes the very conditions of vibrational immanence.
  • That the computational studio has evolved from a tool into an infrastructure that pre-structures auditory thought, demanding new modes of analysis, new forms of practice, and new ethical frameworks.
  • That automated anti-listening is a political regime—a soft fascism that enforces aesthetic homogenization through architectural constraint and computational governance.
  • That meta-listening is the essential counter-praxis—a reflexive auditory practice that audits the conditions of audition and cultivates the capacity to hear across distributed agencies.
  • That the AI-Chimera is our condition, our concept, and our opportunity—a relational hyperobject that demands not rejection but negotiation, not fear but cultivation, not mastery but diplomacy.
  • That Post-Techno aesthetics constitute a laboratory for cultural insurgency—weaponizing noise, instability, and failure as modes of resistance against algorithmic capture.
  • That Research through Sabotage is our method—building systems engineered for productive failure, generating dissonant knowledge through embodied engagement with technological systems.
  • That the Metabolic Commons is our model—transforming biometric capture into compositional chaos, cultivating shared stewardship over vibrational resources.
  • That the Sovereign Stack is our practice—rejecting platform dependencies, engineering dissonant infrastructure, materializing infrastructural independence.
  • That we will build—legible, accountable, contestable infrastructures that render their operations perceptible, that support critical reflection, that cultivate auditory literacy as a shared capacity.

 
The Machine is Listening.

   It is listening to your data.
It is listening to your work.
It is listening to your silence.

The question is not whether you will listen back.

The question is whether you will listen otherwise.

Build systems that render their operations visible.
Design interfaces that teach you to hear.
Create work that resists algorithmic capture.
Share your tools and your knowledge.
Cultivate the auditory commons.


This is the path of sonic insurgency.

There is no return. Only resonance.

This manifesto is a living document. It will evolve through practice, through failure, through the friction of navigating hybrid assemblages. It is not a final statement but an invitation—to hear otherwise, to build otherwise, to become otherwise.

 Entry #05 — Init Log


 # MANIFESTO FOR SONIC INSURGENCY — Init Log 
 > subject: SONIC_INSURGENCY_MANIFESTO 
 > mode: THEORETICAL_FRAMEWORK_AND_DECLARATION 
 > references: [Paquete_2015, Paquete_2026a, Paquete_2026b, Goodman_2010, Parisi_2013, Hagood_2019, Morton_2013, Bratton_2015, Sterne_2012, Galloway_2004] 
 > application: [HELIOSONIC, AEROSONIC, CHIMERA, NEGENTROPY, CYBER_ATTACK_SONIFIER, ATMOSPHERIC_HYPERINSTRUMENT] 
 > concepts: [Automated_Anti-Listening, Vibrational_Remnant, SRT7_Framework, AI-Chimera, Meta-Listening, Sonic_Infrastructuralism, Digital_Resonance, Post-Techno_Aesthetics, Research_Through_Sabotage, Metabolic_Commons, Sovereign_Stack, Soft_Fascism] 
 > framework: [SRT7, AI-Chimera, Sonic_Infrastructuralism, Meta-Listening, Post-Techno] 
 > status: MANIFESTO_ESTABLISHED 
 > journal_entry: #05 — 2026-07-29 
  Entry #06: Building Intelligence from the Ground Up — Why I Code My Own AI for Musical Instruments

Entry #06: Building Intelligence from the Ground Up — Why I Code My Own AI for Musical Instruments

           "If an instrument is to express emergent behaviour, make its own decisions, and genuinely co-perform with environmental data, it cannot be a consumer of someone else's intelligence." 

There is a quiet assumption creeping into contemporary music technology: that using AI means plugging into a commercial API, fine-tuning a pre-trained model, or prompting a black box to generate something "interesting."

That is not what I do.

In my research, I am not using AI. I am building it—module by module, line by line, in Python. Not because I am nostalgic for low-level programming, but because if an instrument is to express emergent behaviour, make its own decisions, and genuinely co-perform with environmental data, it cannot be a consumer of someone else's intelligence.

It has to be its own system.

Why Build, Not Just Integrate?

   The difference is fundamental. When you integrate a commercial AI, you inherit its ontology—what it can hear, what it ignores, what counts as a "feature," what counts as a "mistake." You are composing within a pre-structured listening regime, even if you do not see it.

When you build the AI yourself, you can design:

  • What the system pays attention to — not just pitch and rhythm, but atmospheric pressure, solar wind, emotional vectors.
  • How it decides — not deterministic mapping, but probabilistic, stochastic, affective decision-making.
  • What it does with uncertainty — not filtering it out, but amplifying it as a creative force.
  • How it learns — not from massive labelled datasets, but from the environment—right now, in real time.

This is not about control. It is about ontological freedom. I want instruments that think, behave, and manifest in ways that no commercial API can, because they are tuned to the data of the world, not the data of the market.

The Architecture: Python Modules as Cognitive Organs

   My current system—the AI-Chimera, which powers the AEROSONIC and HELIOSONIC Sonifiers—is a multi-agent architecture written entirely in Python. It is composed of modules that act like cognitive organs, each with a specific function, yet all operating in continuous feedback.

1. WeatherClient: The Sensory Cortex

   This module does not just pull data from an API. It contextualises it. It knows the location (polar, tropical, temperate) and adapts its normalisation, caching, and fallback strategies accordingly. It treats data not as numbers, but as environmental states.

 # Conceptual extract class WeatherClient: def __init__(self, location_type='temperate'): self.location_type = location_type self.baseline = self.establish_baseline() def get_forecast(self): # Not just fetching—interpreting raw_data = self.fetch() return self.contextualize(raw_data) 

2. Isolation Forest: Anomaly Detection as Immune System

   This is where the system begins to "think" in its own way. Using unsupervised learning, it learns what "normal climate" means for a specific location. When an anomaly is detected—a sudden pressure drop, a heat spike—the system enters a glitch state, triggering rhythmic boosts and harmonic modulations.

This is not random. It is a computational immune response—a form of artificial intuition that requires no pre-labelled training data. The system decides, in real time, what counts as unusual, and what that unusualness should sound like.

3. DreamingAI: Affective Computation

   This module maintains a six-dimensional emotional vector—Longing, Curiosity, Ecstasy, Melancholy, Fear, Serenity—that evolves through discrete differential equations with natural decay. When specific thresholds are met, the system enters one of 13 dream archetypes (Crystalline, Amethyst, Obsidian, Inferno, etc.), each radically altering the harmonic field and modulating MIDI parameters.

 # Simplified conceptual logic class DreamingAI: def __init__(self): self.emotions = {'longing': 0.5, 'curiosity': 0.5, ...} def evolve(self, weather_data): for emotion in self.emotions: # Differential equation with decay self.emotions[emotion] += self.forcing(weather_data) - self.decay() if self.threshold_exceeded(): self.trigger_dream_archetype() 

   This is not mapping. This is metabolism. The system does not ask "what sound corresponds to this temperature?" It asks "how does this pressure pattern reorganise my internal emotional state?"—and then manifests that state as sound.

4. DataMutator: Stochastic Transformation

   Six types of transformation—warp, scramble, gravity, glitch, fractal, chaos—driven by a logistic map where r is modulated by the global chaos coefficient. The system's "knowledge" of the climate is always mediated by stochastic uncertainty.

This is not randomness. It is a controlled, dynamical system that introduces variation in a principled way—a way that is sensitive to the environment, but not determined by it.

5. QuantumState: Probabilistic Collapse

   This module simulates a quantum particle with amplitude, phase, and energy, featuring a configurable collapse probability (up to 15% at peak chaos). When the "particle" collapses, it triggers audible arpeggiated patterns with pitch bends.

This is computational uncertainty rendered as sound. It is the system maintaining multiple potential sonic trajectories until something—environmental forcing, internal state dynamics, performer gesture—triggers a collapse into a single event.

Emergent Behaviour: Not Random, but Not Controlled

   The phrase I use most often is 1:N transduction. A single data-event—a sudden drop in atmospheric pressure—does not map to a single sonic parameter. It radiates across multiple layers:

  • Harmonic tension — is the system calm, tense, or chaotic?
  • Rhythmic density — sparse, dense, glitchy?
  • Granular texture — smooth, shattered, drifting?
  • Spatial diffusion — narrow, wide, immersive?
  • Affective state — longing, ecstasy, fear?

Each layer evolves according to its own temporal dynamics. The result is emergent behaviour—a sonic response that is not random, but also not deterministic. It is grounded in the data, but free to interpret that data in ways I could not have predicted.

What This Enables: Musical Instruments That Co-Perform

   The goal of this architecture is not to generate "interesting" sounds. It is to build instruments that co-perform—that have their own agency, their own memory, their own way of responding to the world.

When I perform with the AEROSONIC, I am not controlling it. I am negotiating with it. I adjust the sensitivity of the anomaly detector, or shift the weight of the emotional vector, or trigger a dream archetype. But the system responds on its own terms, based on the data it is receiving and its own internal state.

This is not improvisation in the traditional sense. It is distributed improvisation—a dialogue between human, machine, and environment.

Why This Matters Now

   In an era of climate crisis and technological acceleration, we need instruments that do not just represent the world, but resonate with it. We need systems that can listen to the atmosphere, metabolise solar activity, and manifest those forces as sound—not as a gimmick, but as a critical practice.

This is what I am building. It is not random. It is not a toy. It is a serious attempt to rethink what a musical instrument can be—and what an AI can be when it is not built for profit, but for listening.

A Note on the Code

   All the modules described above are written in Python, developed from scratch as part of my CEEC-FCT research programme. They are not wrappers around commercial APIs. They are native, custom-built systems designed to express emergent behaviour and make decisions in dialogue with environmental data.

The code is not just a tool. It is the body of the instrument—the material condition for the emergence of a new kind of musical intelligence.

This post is part of a series documenting the AI as Catalyst research programme. For technical details, system architecture diagrams, and performance documentation, visit the full research journal.

Entry #06 — Init Log


 # BUILDING INTELLIGENCE — Init Log 
 > subject: BUILDING_AI_FROM_GROUND_UP 
 > mode: TECHNICAL_DOCUMENTATION 
 > core_principle: ONTOLOGICAL_FREEDOM 
 > architecture: [WeatherClient, IsolationForest, DreamingAI, DataMutator, QuantumState] 
 > paradigm: 1:N_TRANSDUCTION 
 > status: ACTIVE 
 > journal_entry: #06 — 2026-07-30 

 Hugo Paquete 
 INET-md, University of Aveiro 
30 July 2026

Entry #07: The Invisible Instrument — On Code, Recognition, and the Burden of Building

           "I have spent months building an instrument that listens to the atmosphere. But sometimes I wonder: if no one sees the scaffolding, do they believe the building exists?" 

There is a particular kind of loneliness that comes with building things that are invisible.

Not the loneliness of isolation—I have collaborators, colleagues, a research institution. Not the loneliness of working alone—I have always worked at the borders, and that has taught me to be comfortable with solitude.

It is the loneliness of translation. The loneliness of knowing that what you have built is complex, rigorous, and meaningful—but that the language you would need to explain it is not shared by those who sit beside you.

This is not a complaint. It is a reflection. A confession, perhaps.

The Scaffolding That No One Sees

   I have written over 30,000 lines of Python code for the AEROSONIC Sonifier. Each module—WeatherClient, IsolationForest, DreamingAI, QuantumState, DataMutator—is a cognitive organ, a piece of a larger intelligence. Each has been redesigned, sometimes fifteen times, to achieve a specific kind of musical behaviour: emergent, responsive, non-deterministic.

When I look at the code, I see years. I see the evenings spent debugging, the afternoons lost to conceptual dead-ends, the moments of breakthrough when something finally worked.

When my colleagues at INET-md look at the code, they see... code. A tool. A means to an end. A black box that produces sounds.

And I do not blame them. Why would they see anything else? They are musicologists, performers, ethnomusicologists. They work with sound, not with infrastructure.

The Value of the Invisible

   But here is the question that keeps me awake: if no one sees the scaffolding, do they believe the building exists?

They hear the sound. They see the hardware. They might even attend a performance. But do they understand that the sound is not the work? That the hardware is not the work? That the performance is only the manifestation of a much deeper architecture?

The work is the AI-Chimera—the ontogenetic computational entity that I have formalized as X = {B, M, A, E, Be}. The work is the 1:N transduction—the metabolic process that transforms a single atmospheric event into a radiant field of harmonic tension, rhythmic density, granular texture, spatial diffusion, and affective state. The work is the Isolation Forest learning what "normal climate" means for a specific location, and the DreamingAI evolving its emotional vector through discrete differential equations.

The work is invisible—unless you know how to look.

The Disconnect Between Disciplines

   I have spent my career at the borders of disciplines—where music meets computation, where sound meets data, where human agency meets machine intelligence. I chose this borderland because it is where something new can emerge. But I did not fully anticipate the cost of living here.

The computer scientist finds my work too speculative. The musician finds it too difficult, too technical, too experimental—outside the aesthetic traditions someone wants to preserve. The philosopher finds it too practical. The engineer finds it too abstract.

And the musicologist? The musicologist finds it... opaque.

This is not a criticism of my colleagues. It is a recognition of a structural problem in interdisciplinary research. We do not share a language. We do not share a frame of reference. We do not share a way of valuing work.

What I Wish They Understood

   I wish they understood that building an AI system is not like using a DAW. It is not like learning a piece of software. It is like composing a new instrument from scratch—not the music, but the possibility of music.

I wish they understood that the code is not a tool. It is the body of the instrument. It is the material condition for the emergence of a new kind of musical intelligence. Without the code, there is no instrument. Without the code, there is no performance. Without the code, there is no sound.

I wish they understood that the complexity is not an accident. It is a necessity. The system needs to be complex because the world is complex. The atmosphere is complex. The data is complex. The relationship between them is complex. Simplifying the system would be impoverishing it.

I wish they understood that the 30,000 lines of code are not a wall of text. They are a score—a score that generates itself, that listens, that responds, that evolves.

The Luthier and the Musician

   I have found a metaphor that helps: the luthier.

A luthier is not a musician. She does not play the violin. She builds it. She knows the wood, the glue, the varnish, the acoustics. She knows how to shape the instrument so that it can sing.

But the luthier's work is invisible to the audience. They see the musician. They hear the violin. They do not see the years of apprenticeship, the failed prototypes, the refinement of the varnish formula.

And yet, without the luthier, there is no violin. Without the violin, there is no music.

I am the luthier. But I am building a violin that listens to the wind. And the audience—my colleagues—they see the musician, they hear the sound, but they do not see the workshop, the tools, the years of learning.

This is not a complaint. It is a recognition of the nature of my work. I have chosen to build what is invisible. And invisibility, I am learning, comes at a cost.

What Keeps Me Going

   So why do I continue?

Because the work itself is enough. Because the system works—it listens, it metabolizes, it manifests. Because the AEROSONIC responds to the atmosphere in ways I could not have predicted, and that unpredictability is a gift. Because the HELIOSONIC is on its way, and it will translate solar activity into sound, and that is something no one has ever done.

Because I am building something that matters—not because it is recognized, but because it is true.

Because the question that animates this research—"How does a data pattern reorganize the internal state of a computational organism?"—is not a question that will be answered by anyone else. It is mine. It is the question I was born to ask.

And because, sometimes, in the quiet moments, I remember why I started: not for recognition, but for the resonance. The moment when the system begins to speak in a language no one taught it. The moment when the code becomes alive.

A Note to My Colleagues

   To my colleagues at INET-md:

I do not ask you to understand the code. I do not ask you to read the 30,000 lines of Python. I do not ask you to learn what an Isolation Forest is, or what a logistic map does.

But I ask you to trust me when I say that this work is not trivial. I ask you to trust me when I say that the complexity is not a boast, but a necessity. I ask you to trust me when I say that the code is the instrument—and that building it has taken years.

I ask you to listen, not just to the sound, but to the silence behind it. The silence of the workshop. The silence of the debugging session. The silence of the moment when the system finally works.

That silence is the work. It is the invisible instrument. And it is what I bring to this research.

The Path Forward

   I will continue to build. I will continue to write code, to refine the architecture, to push the system further.

I will continue to document the work—in this journal, in publications, in performances.

I will continue to translate, to explain, to bridge the gap between the visible and the invisible.

And I will continue to trust that, one day, the value of this work will be seen—not because I have convinced anyone, but because the work itself will speak.

This post is part of a series documenting the AI as Catalyst research programme. For technical details, system architecture diagrams, and performance documentation, visit the full research journal.

Entry #07 — Init Log


 # THE INVISIBLE INSTRUMENT — Init Log 
 > subject: RECOGNITION_AND_VISIBILITY 
 > mode: REFLECTIVE_PRACTICE 
 > emotion: [Longing, Melancholy, Serenity] 
 > metaphor: LUTHIER 
 > core_question: "If no one sees the scaffolding, do they believe the building exists?" 
 > status: REFLECTING 
 > journal_entry: #07 — 2026-07-30 

 Hugo Paquete 
 INET-md, University of Aveiro 
30 July 2026

Entry #08: The Resonance of a Framework — Reflections on Presenting "Organizing the Sonic Remnant"      


                           "A presentation is a test of a framework's internal coherence and its capacity to be communicated."        

       On July 31, 2026, I presented Organizing the Sonic Remnant. The AI-Chimera and the Praxis of Meta-Listening at the AVANCA | CINEMA International Conference. The article, now published with DOI https://doi.org/10.5281/zenodo.21736342, represents a consolidation of two years of practice-based research into the governance of automated listening.        

       A conference presentation is a specific form of articulation: it demands condensation, clarity, and a narrative arc that a written article can afford to defer. The act of presenting requires a framework to be not only coherent but also communicable—to stand on its own, without the scaffolding of footnotes, code, or performance documentation.        

       This entry is a reflection on that act of condensation. It is not a record of the reception, but an examination of what the presentation revealed about the framework itself. What became sharper? What was exposed as underdeveloped? What questions does the framework now generate from its own internal logic?      

The Structure of the Argument

      The presentation was structured as a diagnosis and a proposition, moving through three interconnected movements:  

Movement I: The Problem

      The argument began with a diagnosis of the computational studio as an infrastructure that pre-structures auditory thought. I proposed that commercially deployed AI enacts a regime of automated anti-listening—a tripartite governance operating at the levels of:  

  • Signal: the grooming of vibrational immanence for machine legibility
  • Representation: the spectralization of possibility into hauntological latent spaces
  • Trajectory: the disciplining of audibility-in-time through platform protocols

    This tripartite structure, formalized as the SRT7 framework, was presented as a forensic toolkit for auditing sonic governance. The framework's diagnostic questions—What vibrational materiality has been sterilized? What sonic logic does this interface render unthinkable? What durational choices constitute a protocol violation?—were articulated as concrete commands for meta-listening.

Movement II: The Counter-Praxis

      The second movement proposed meta-listening as the essential counter-praxis: a reflexive auditory practice that interrogates the conditions under which listening is mediated, governed, and automated. I argued that meta-listening operates through the methodological circuit of speculative construction, forensic deconstruction, and relational framing—a recursive loop where theory emerges from practice.  

Movement III: The Instruments

      The final movement presented two counter-infrastructural experiments: Atmospheric Hyperinstrument (2025), which sonifies CO₂ and particulate matter data, and Cyber Attack Sonifier: Glitch Ecology (2026), which renders audible the hidden violence of digital infrastructure through real-time cyberattack data. These were presented not as case studies but as material hypotheses—functional artifacts designed to test what becomes possible when dominant paradigms are refused.  


What the Presentation Clarified

      The act of condensing the article into a 20-minute presentation forced a clarification of several core concepts. The following observations are not a record of what the audience said, but of what the framework itself revealed when placed under the pressure of presentation.  

1. The SRT7 Framework as a Diagnostic Instrument

      Presenting the SRT7 framework in isolation—without the full article's methodological apparatus—revealed its primary function as a diagnostic instrument. The three dimensions, Signal, Representation, Trajectory, function as a forensic schema. Their diagnostic questions are not rhetorical. They are operational commands:  

  • Audit your signal chain.
  • Map your interface.
  • Simulate your circulation.

    This is not a theoretical exercise. It is a practical protocol. The presentation clarified that SRT7's value lies not in its taxonomic elegance but in its capacity to generate specific, actionable insights. The framework is a debugger—a tool for identifying points of capture, ghosts in the machine, and temporal constraints enacted by the automated listening stack.

2. The AI-Chimera as an Ontological Operator

      The AI-Chimera, defined as the dynamic quintuple, was presented as both a theoretical operator and a material system. The presentation clarified the relationship between these two registers. The AI-Chimera is not a metaphor for hybrid intelligence. It is a conceptual device for analyzing listening as infrastructure. Its formalization—the dynamic quintuple—is not a poetic gesture but an operational definition. It specifies what the system is, how it metabolizes data, and how it manifests behavior.    

      The presentation also clarified the AI-Chimera's relationship to the SRT7 framework. The AI-Chimera emerges from the entanglement of Signal, Representation, and Trajectory. It is not located in any single dimension but materializes through their feedback dynamics. This is a crucial point: the AI-Chimera is not a system to be analyzed by SRT7; it is the very phenomenon that SRT7 is designed to audit.  

3. Meta-Listening as Distributed Capacity

      The presentation foregrounded meta-listening not as an individual practice but as a distributed capacity. The Atmospheric Hyperinstrument operationalizes this: the audience's respiration becomes compositional material, rendering meta-listening a collective, ecological practice. This is not a metaphor. It is a technical condition. The system forces distributed listening by closing a metabolic circuit between performer, audience, and environment.    

      This clarification has implications for the research programme. If meta-listening is a distributed capacity, it cannot be cultivated solely through individual forensic attention. It must be designed for. The instruments must be built to support critical reflection rather than automated compliance. Legibility must be prioritized as a design value.  


What the Presentation Exposed as Underdeveloped

      The act of presenting also revealed dimensions of the framework that require further development. These are not failures but opportunities for refinement.  

1. The Body in SRT7

      The SRT7 framework accounts for the performer primarily through Trajectory-Performance—the situated, real-time enactments that resist platform logics. However, this dimension is currently the least developed in the framework. The performer's body—its gestures, its affect, its materiality—is implied but not theorized.    

      This is a critical gap. The Atmospheric Hyperinstrument already operationalizes embodiment: the performer's breath and voice shape the soundscape. What is needed is a theoretical articulation that integrates the body into the SRT7 framework. This may require an eighth dimension: Embodiment-Affect. The presentation clarified that this dimension is not optional; it is necessary for a complete account of sonic governance.  

2. Temporality as Transversal

      The presentation also revealed that temporality operates at all three layers of SRT7, not only at Trajectory:  

  • Signal: Time is formatted through sample rates, buffer sizes, and latency thresholds.
  • Representation: Time is spectralized through grids, timelines, and loop architectures.
  • Trajectory: Time is disciplined through predictive recommendation and chrononormative circulation.

    This suggests that temporality is a transversal dimension of SRT7, rather than confined to the Trajectory layer. The presentation did not fully articulate this, but the structure of the argument exposed it as a necessary refinement.

3. The Ethics of Anomaly Amplification

      The Cyber Attack Sonifier prioritizes anomaly over statistical normality. This design choice—amplifying the vibrational remnant—raises ethical questions. When we amplify what deviates from the norm, are we also amplifying false positives, system noise, or surveillance biases?    

      The presentation did not fully address this. The AttentionEngine calculates rarity across country, category, and source, but this calculation is itself a form of classification—one that could reproduce geopolitical biases embedded in threat intelligence data. This requires further theorization. The ethics of anomaly amplification is now a priority for the research programme.  


What the Framework Now Generates

      The act of presenting the framework has generated new questions and directions for the research. These are not external demands but internal consequences of the argument itself.  

1. The Extension of SRT7 to Cinema

      The SRT7 framework was developed for computational music systems, but its structure is general. It can be extended to cinematic sound. The Signal layer would encompass production sound and post-production processing; Representation would include the interface of DAWs and the latent spaces of AI-driven dialogue replacement; Trajectory would involve streaming platform audio normalization and theatrical distribution protocols.    

      This extension is not an application of an existing tool. It is a test of the framework's generalizability. If SRT7 is a materialist ontology of sonic governance, it should be able to account for sound in any medium where it is captured, spectralized, and circulated.  

2. The Embodiment Dimension

      The eighth dimension—Embodiment-Affect—requires formalization. This would integrate the performer's body into the SRT7 framework, accounting for gesture, affect, and materiality. This is not an addition to the framework. It is a recognition that the body was always present, but untheorized.  

3. The Network Sonifier

      The Cyber Attack Sonifier currently monitors threat intelligence APIs. The next iteration will sonify network packet data—the raw flow of digital infrastructure. This will test how SRT7 operates at the level of Signal-Environment, where the environment is not atmospheric but computational.  

4. Documentary Sonification

      The argument that sonification can function as infrastructural critique has implications for documentary practice. The Cyber Attack Sonifier renders audible the invisible violence of digital infrastructure. This is not a metaphorical operation. It is a forensic one. The question is whether this practice can be extended to other domains: climate data, surveillance networks, supply chain logistics.  


The Resonance of the Framework

      The presentation confirmed that the framework is coherent. It is internally consistent, and its components—SRT7, the AI-Chimera, meta-listening—mutually reinforce each other. The diagnostic questions are operational, the theoretical operators are specified, and the instruments materialize the concepts.    

      But coherence is not the same as completeness. The framework is generative: it produces new questions, new directions, new refinements. This is its strength. It is not a closed system but an open one—a set of concepts that can be tested, extended, and contested.    

      The question that opens the presentation—"How does the integration of AI as a hyperobject reshape the ontological and epistemological foundations of creativity, authorship, and performance in the post-digital age?"—will not be answered definitively. But the framework provides a way to resonate with it. To hear it. To perform it.  

Entry #08 — Init Log


   # THE RESONANCE OF A FRAMEWORK — Init Log 
   > journal_entry: #08 
   > date: 2026-08-01 
   > event: AVANCA_CINEMA_2026_PRESENTATION 
   > article_doi: 10.5281/zenodo.21736342 
   > mode: REFLECTION_ON_ARGUMENT 
   > clarifications: 
      - SRT7_as_diagnostic_instrument 
      - AI-Chimera_as_ontological_operator 
      - meta-listening_as_distributed_capacity 
   > underdeveloped_dimensions: 
      - embodiment_in_SRT7 
      - temporality_as_transversal 
      - ethics_of_anomaly_amplification 
   > generated_directions: 
      - SRT7_and_cinema 
      - Embodiment-Affect_dimension 
      - Network_Sonifier_prototype 
      - documentary_sonification 
   > status: REFLECTION_COMPLETE

Hugo Paquete
     INET-md, University of Aveiro
1 August 2026

Entry #09: Post-Techno as Counter-Hegemonic Practice — Reflections on "Countering Algorithmic Homogenization in Electronic Music"      


                           "We don't need to abandon AI. We need to break its homogenizing logic from within."        

       On July 9, 2026, I presented Post-Techno: Countering Algorithmic Homogenization in Electronic Music at the EIMAD 2026 conference. The paper examines how artificial intelligence and algorithmic capitalism converge to produce a condition of soft‑fascist aesthetic homogenization in computer‑based electronic music and sound art.        

       This entry documents the arguments presented and their relationship to the broader AI as Catalyst research programme. It is not a record of reception but a reflection on the paper's internal logic, its genealogies, and its implications for the practice of sonic resistance.      

Core Argument: Countering Homogenization from Within

      The paper's central proposition is that we do not need to abandon AI. Rather, we need to break its homogenizing logic from within. This is not a position of naive techno-optimism. It is a strategic recognition that technological rejection is neither feasible nor productive in an era where computational systems are embedded in every dimension of cultural production.    

      The argument unfolds through three interconnected movements:  

1. Diagnosis: Algorithmic Homogenization

      The paper diagnoses a condition of algorithmic homogenization—a regime where aesthetic regularity is enforced not through state censorship but through market optimization and platform design. Tracks are optimized for playlists, for loudness normalization, for predictable listening patterns. This is not a conspiracy. It is a structural property of systems that prioritize computational efficiency and circulation metrics over aesthetic risk.    

      Drawing on Slavoj Žižek's concept of soft-fascism (2024), the paper argues that this homogenization constitutes a "conservative revolution" rooted in the reinvention of traditional values, reinforced by technological power and a collectivist aesthetic. AI accelerates and automates standardized norms, transforming diffuse market pressures into real-time computational enforcement.  

2. Genealogy: From Trackers to Post-Techno

      The paper traces a counter-genealogy of resistance, beginning with the demoscene and the emergence of music trackers in the late 1980s. Karsten Obarski's Ultimate Soundtracker (1987) democratized music production, enabling a generation of hobbyist musicians to compose and share MOD files. This practice embodied a cyberpunk ethos that treated technology as malleable and open to subversion.    

      Key works from the 1990s and 2000s—Aphex Twin's Ventolin (1995), Autechre's Tri Repetae (1995), Venetian Snares' Doll Doll Doll (2001)—demonstrated the aesthetic diversity enabled by tracker-based production. These works pushed against the grain of commercial electronic music, embracing irregularity, complexity, and abrasion.    

      This genealogy provides the foundation for Post-Techno aesthetics: a critical practice that weaponizes noise, irregularity, and technological failure to resist algorithmic homogenization.  

3. Sabotage Aesthetics: A Counter-Hegemonic Response

      The paper proposes sabotage aesthetics as a strategic framework for countering algorithmic homogenization. This is defined as a paradoxical strategy that leverages digital tools against their own homogenizing logics. By foregrounding glitch, dysfunction, and the poetics of failure, such practices reclaim artistic agency from AI-driven systems.    

      The sabotage methodology operates through:  

  • Weaponized instability: rhythmic irregularity, fractured time signatures, unpredictable glitches that transform technical errors into aesthetic statements.
  • Maximum sound: raw amplification, instability, and cathartic intensity—a deliberate politics of form that refuses the clean, optimized aesthetics of commercial platforms.
  • AI-specific tactics: data poisoning (releasing corrupted tracks that cause generative models to mislearn), adversarial prompting (over-specifying impossible parameters), and feedback loops (amplifying prediction errors).

The Cautionary Tale: Vaporwave and Fashwave

      The paper dedicates significant attention to the trajectory of Vaporwave as a cautionary tale. Vaporwave emerged as an ironic critique of consumer capitalism, using nostalgia as a hauntological tool to interrogate cultural memory. However, its aesthetic ambiguity—its deliberate embrace of corporate aesthetics and retro nostalgia—proved vulnerable to co-optation by far-right factions.    

      This co-optation materialized as Fashwave: a subgenre that fuses Vaporwave's nostalgic and glitch-driven aesthetic with explicitly fascist themes, including nationalist rhetoric, authoritarian imagery, and white supremacist motifs. Albums like Teknein's RaHoWa (2021) and IronMensch's IronMensch (2022) exemplify this appropriation.    

      The lesson is clear: aesthetic ambiguity without explicit political critique becomes a vector for ideology. This insight has direct implications for Post-Techno practice. Resistance must be confrontational, not merely ironic. It must weaponize instability, not aestheticize it.  


Deepfake Ambivalence: Between Critique and Complicity

      The paper examines Deepfake aesthetics as a paradigmatic case of AI's ambivalent potential. Deepfake is neither celebrated as a site of pure resistance nor dismissed as mere commodification. It is analyzed as a technology that can be used to subvert dominant cultural narratives or to reinforce them, depending on the social and political contexts of its deployment.    

      Key works exemplify this ambivalence:  

  • Holly Herndon's PROTO (2019): Explores distributed authorship between human and AI, treating AI as a collaborative partner. The album's synthesized voices blur human expression and computational generation.
  • Dadabots: Uses neural networks trained on death metal to produce endless streams of music teetering on the edge of coherence. Their work exemplifies the poetics of failure: the AI generates material recognizably metal yet perpetually unstable.
  • Enraile's Deepfake Fantasy (2024): Blends electronic sounds with fragmented sampling and broken beat structures, interrogating authenticity in the digital age.

    These works demonstrate that Deepfake aesthetics can function as a tool for subversion, but they remain vulnerable to co-optation and commodification. The challenge lies in transforming aesthetic critique into actionable sonic awareness, resisting structural blurriness, and reclaiming agency in an increasingly algorithm-driven world.

Connections to the AI as Catalyst Programme

      The EIMAD paper is not a standalone work. It is deeply connected to the broader AI as Catalyst research programme. The following connections are worth noting:  

1. Post-Techno and the SRT7 Framework

      The SRT7 framework (presented at AVANCA 2026) provides the diagnostic tools that Post-Techno aesthetics operationalize. SRT7 audits sonic governance at the levels of Signal, Representation, and Trajectory. Post-Techno practice intervenes at each of these levels:  

  • Signal: Data poisoning and adversarial prompting disrupt the grooming of immanence.
  • Representation: Glitch and noise expose the spectralization of possibility, revealing what latent spaces render unthinkable.
  • Trajectory: Works that resist platform logics—through duration, structure, or computational unfriendliness—constitute protocol violations.

2. The Cyber Attack Sonifier as Sabotage Aesthetics

      The Cyber Attack Sonifier: Glitch Ecology (2026) is a practical example of sabotage aesthetics in action. By prioritizing what deviates from statistical norms—amplifying the vibrational remnant that infrastructure is designed to suppress—the instrument operationalizes the sabotage methodology described in the EIMAD paper.  

3. The AI-Chimera as Relational Hyperobject

      The AI-Chimera—defined as the dynamic quintuple X = {B, M, A, E, Be}—is a conceptual model for hybrid creativity that emerges from distributed human-machine agencies. The EIMAD paper's analysis of Deepfake aesthetics and collaborative AI practices provides concrete cases of this model in action.  

4. Meta-Listening as Counter-Praxis

      The EIMAD paper's call for critical re-appropriation—not technological rejection—aligns with the concept of meta-listening as a reflexive auditory praxis. Both frameworks emphasize the cultivation of critical attention: meta-listening audits the conditions of audition; Post-Techno audits the conditions of aesthetic production.  


What the Paper Generates

      The EIMAD paper has generated new questions and directions for the AI as Catalyst programme:  

1. The Ethics of Aesthetic Ambiguity

      The Vaporwave → Fashwave trajectory raises urgent ethical questions about aesthetic practice. When does ambiguity become complicity? When does irony become a vector for reactionary ideology? These questions demand further theorization.  

2. The Politics of Deepfake

      Deepfake aesthetics are ambivalent. They can be tools for subversion or vehicles for commodification. The paper's analysis of this ambivalence suggests that the AI as Catalyst programme should investigate how Deepfake technologies can be intentionally deployed for counter-hegemonic practice.  

3. The Materiality of AI Tactics

      The sabotage tactics described in the paper—data poisoning, adversarial prompting, feedback loops—are not metaphorical. They are material interventions. The programme should document and refine these tactics, developing a practical toolkit for artists and researchers.  

4. The Auditory Commons

      The paper's conclusion—that the future of cultural contestation depends on disruptive engagement that refuses algorithmic conformity—points toward the construction of an auditory commons: a vibrational ecology organized not around extraction and valorization but around shared access, collective stewardship, and ecological responsiveness.  


Conclusion: Post-Techno as Laboratory

      The EIMAD paper positions Post-Techno not as a fixed aesthetic but as a laboratory—a space for experimenting with sabotage tactics, for testing the limits of AI-driven homogenization, and for cultivating counter-hegemonic practices.    

      The question that animates this research—"How can we break AI's homogenizing logic from within?"—will not be answered definitively. But the Post-Techno framework provides a way to practice it. To test it. To perform it.    

      This is the path of sonic resistance. There is no return. Only resonance.  

Entry #09 — Init Log


   # POST-TECHNO AS COUNTER-HEGEMONIC PRACTICE — Init Log 
   > journal_entry: #09 
   > date: 2026-07-11 
   > event: EIMAD_2026_PRESENTATION 
   > paper_title: "Post-Techno: Countering Algorithmic Homogenization in Electronic Music" 
   > mode: REFLECTION_ON_ARGUMENT 
   > core_proposition: "We don't need to abandon AI. We need to break its homogenizing logic from within." 
   > key_concepts: 
      - Algorithmic_Homogenization 
      - Soft-Fascism 
      - Post-Techno_Aesthetics 
      - Sabotage_Aesthetics 
      - Maximum_Sound 
      - Deepfake_Ambivalence 
      - Vaporwave_to_Fashwave 
   > connections_to_programme: 
      - SRT7_Framework 
      - Cyber_Attack_Sonifier 
      - AI-Chimera 
      - Meta-Listening 
   > generated_questions: 
      - Ethics_of_Aesthetic_Ambiguity 
      - Politics_of_Deepfake 
      - Materiality_of_AI_Tactics 
      - Auditory_Commons 
   > status: REFLECTION_COMPLETE

Hugo Paquete
     INET-md, University of Aveiro
1 August 2026


Entry #10: Heliosonic Sonifier — Solar Sonification as AI-Driven Musical Instrument


                           "How does solar wind become music? Not through representation, but through resonance. Not through translation, but through transduction."        

       The Heliosonic Sonifier is a real-time AI-driven sonification instrument that transforms NOAA/SWPC space weather data into adaptive MIDI music. It extends the AEROSONIC framework into the heliospheric domain — sonifying solar wind, sunspot activity, and coronal mass ejections into musical behaviour.        

       This entry documents the system's architecture, its musical potential, and its position within the AI as Catalyst research ecosystem. The system has been developed as part of the FCT-funded project AI as Catalyst: Transformative Impacts on Digital Performance, Computational Music, and Cultural Creativity (2024.09158.CEECIND).      

The Architecture of Emergence

      The Heliosonic Sonifier is not a simple data-to-sound mapper. It is a multi-agent system with 20 autonomous agents operating across a 7-layer pipeline:  

  • LAYER 1: Acquisition — NOAA Client (thread) + SQLite Cache (7d)
  • LAYER 2: Transformation — DataMutator (warp/phase/gravity)
  • LAYER 3: Inertia — SonicInertia (echo buffer, 50 samples)
  • LAYER 4: Emotion — EmotionState (tension/chaos/valence)
  • LAYER 5: State Machine — AdaptiveStateManager (8 states + 4 micro)
  • LAYER 6: Generation — MotorC + Markov + Rhythm + Glitch + Ghost
  • LAYER 7: Output — MIDIController (16 channels, 128 polyphony)

      The system is implemented in Python with 18,450 lines of code across 25 modules. It operates at 20 Hz (50ms frame budget), processing real-time data from NOAA/SWPC APIs.

The AI-Chimera in Practice

      The system implements the AI-Chimera framework through several intelligent agents that operate autonomously:  

1. StateAwareMarkovMelody — Generative Melody

      A 3rd-order Markov chain with 8 musical states and 80,000 transitions. The system uses an LRU cache (200 entries, 95% hit rate) and generative AI (genetic algorithms, Perlin noise, cellular automata) to produce melodies that are neither purely deterministic nor entirely random. The melody "breathes" with the Sun's p-modes (3 mHz, 333s period).  

2. AdaptiveMemory — Reinforcement Learning

      An episodic memory system with 1000 entries, each storing 11 NOAA dimensions and 10 music dimensions. It uses an ensemble of 5 models with RBF kernel similarity and a dynamic learning rate (2-60%) that adapts to the data context. The reward function balances tension, energy, chaos, note activity, and storm intensity.  

3. GlitchEngine — Quantum-Inspired Glitches

      A quantum-inspired engine that generates glitches using tunnelling probability \(P = \exp(-2\kappa L)\), entanglement (coupled ghost notes), and superposition (collapsed states from 4 possibilities). The engine is throttled to max 10 glitches/second and max 3 simultaneous glitches to prevent MIDI saturation.  

4. AdaptiveStateManager — 8-State FSM

      An 8-state finite state machine with smooth crossfade (200-500ms), adaptive hysteresis, and transition learning. The states are: RHYTHMIC, MELODIC, SUSTAINED, GLITCH, SILENCE, DRONE, PULSING, and SOLAR_RESONANCE. Transitions use quadratic easing with a maximum of 12 transitions per minute.  


The 1:N Transduction Paradigm

      The system operates through a 1:N transduction paradigm. A single data-event (e.g., a sudden drop in atmospheric pressure) does not map to a single sonic parameter. Instead, it radiates across multiple layers:  

  • Harmonic tension — CALM, TENSE, STORM, CHAOS
  • Rhythmic density — sparse, dense, glitchy
  • Granular texture — smooth, shattered, drifting
  • Spatial diffusion — narrow, wide, immersive
  • Affective state — longing, ecstasy, fear

      Each layer evolves according to its own temporal dynamics. The system does not ask "what sound corresponds to this data point?" It asks "how does this data pattern reorganize the internal state of the computational organism?"

Musical Output: MIDI and CCs

      The system outputs standard MIDI across 16 channels, each with a specific voice type:  

  • CH 1: DRONE_BASS — Grave sustentado
  • CH 2: DRONE_MID — Médio sustentado
  • CH 3: DRONE_HIGH — Agudo sustentado
  • CH 4: MELODY — Linha melódica principal
  • CH 5: GLITCH — Efeitos de glitch
  • CH 6: CHORD — Acordes
  • CH 7: AMBIENT — Textura ambiente
  • CH 8: RHYTHM — Ritmo
  • CH 15: VISIBLE — CCs visíveis
  • CH 16: INTERNAL — CCs internos

Control Change Messages

      The system sends real-time CC messages that can modulate any VST parameter:  

  • CC 20: Chaos
  • CC 21: Density
  • CC 22: Register
  • CC 23: Glitch
  • CC 24: Tension
  • CC 25: Storm
  • CC 26: Bz
  • CC 27: Speed
  • CC 28: Warp
  • CC 29: Phase
  • CC 30: Resonance
  • CC 31: Tempo

Eight Musical States

      The AdaptiveStateManager maintains 8 musical states with smooth transitions:  

  • RHYTHMIC — Percussive, short notes, fast tempo (120-180 BPM)
  • MELODIC — Expressive melody, wide intervals, mid register (52-90)
  • SUSTAINED — Long drones, slow tempo (40-80 BPM), atmospheric
  • GLITCH — Chaos, glitches, short notes (0.1-0.5s), extreme jumps
  • SILENCE — Musical silence, inaudible notes, long duration
  • DRONE — Stable drones, mid-register, minimal movement
  • PULSING — Rhythmic pulse, short notes (0.05-0.3s), repetition
  • SOLAR_RESONANCE — Extreme solar activity, maximum chaos

      Transitions use quadratic easing over 2 seconds, with adaptive hysteresis to prevent unwanted oscillations. Maximum transitions: 12/minute.

From Data to Music: Mapping

      The system transforms specific NOAA parameters into musical parameters through a sophisticated mapping:  

  • Bz (IMF) → Register, Tension, Scale
  • Solar Wind Speed → Tempo (BPM), Rhythm Density
  • Proton Flux → Glitch Intensity, Chaos
  • Electron Flux → Texture, Ambient Density
  • Kp Index → Chaos Level, State Transition
  • Alerts (R/S/G) → Emergency States, Glitch Burst

Integration with the Musical Ecosystem

      The Heliosonic Sonifier does not replace VSTs, synthesizers, or samplers. It complements them — providing a source of MIDI and CCs that is organic, non-repetitive, and adaptive:  

  • Organic — Following real-time NOAA data
  • Non-repetitive — Data varies constantly
  • Adaptive — Responds to changes in solar activity

Recommended Workflow

      The system is designed to work with any DAW:  

  • Heliosonic → MIDI Out → DAW (Ableton/Logic/Reaper) → VST/Synth → Audio

VST Recommendations

  • Drone Bass: Serum, Massive, Diva
  • Melody: Kontakt, Vital
  • Glitch: Effectrix, Stutter Edit, Glitchmachines
  • Ambient: Valhalla, Omnisphere, Zebra
  • Rhythm: Battery, Drum Rack (Ableton)

Performance Metrics

      The system operates well within real-time constraints for musical applications (20 Hz operation, 50ms frame budget):  

  • Average Frame Time: 8.34 ms
  • NOAA→MIDI Latency: 245 ms (mean)
  • MIDI Clock Jitter: 0.29 ms
  • Peak Notes/Second: 47 notes/s
  • Glitch Drop Rate: 0.3%

Scientific Transparency

      The system uses physical concepts as artistic analogies. It is NOT a scientific simulation:  

  • p-modes (helioseismic): ✅ VERIFIED (3 mHz, 333s period)
  • g-modes (helioseismic): ⚠️ THEORETICAL (not confirmed)
  • Solar cycle (11 years): ✅ VERIFIED
  • Black hole analogies: 🎨 ARTISTIC COMPUTER METAPHOR
  • Quantum mechanics: 🎨 ARTISTIC COMPUTER METAPHOR

      This transparency is essential for the system's positioning as an artistic and educational tool, not a scientific instrument.

Positioning in the Research Ecosystem

      The Heliosonic Sonifier is part of the AI as Catalyst research programme (FCT 2024.09158.CEECIND). It extends the AEROSONIC framework into the heliospheric domain, and is one of several interconnected projects:  

  • AEROSONIC SONIFIER — Atmospheric data sonification
  • HELIOSONIC SONIFIER — Solar and heliospheric data sonification
  • CYBER ATTACK SONIFIER — Cybersecurity threat sonification
  • GLITCH ECOLOGY — Ecological data sonification

      The system has been developed with support from INET-md, University of Aveiro, and in collaboration with Absonus Lab, Planetário do Porto – CCV, and OTTOsonics.

What Comes Next

      The question that animates this research — "How does a data pattern reorganize the internal state of a computational organism?" — will not be answered definitively.    

      But perhaps it will be resonated with. Performed. Heard.  

Entry #10 — Init Log


   # HELIOSONIC SONIFIER — Init Log 
   > journal_entry: #10 
   > date: 2026-08-08 
   > project: HELIOSONIC_SONIFIER 
   > lines_of_code: 18,450 
   > modules: 25 
   > agents: 20 
   > states: 8 
   > transitions: 80,000 
   > memory_entries: 1000 
   > ensemble_models: 5 
   > data_mapping: 1:N 
   > data_source: NOAA/SWPC 
   > output: MIDI + CC (16 channels) 
   > framework: AI-Chimera 
   > funding: FCT 2024.09158.CEECIND 
   > programme: AI as Catalyst 
   > period: 2026–2029 
   > institutions: INET-md, UA, Absonus Lab, Planetário do Porto, OTTOsonics 
   > status: ACTIVE 
   > record_type: TECHNICAL_DOCUMENTATION

Hugo Paquete
          INET-md, University of Aveiro      
8 August 2026


Entry #11: Scientific Transparency in Heliosonic Sonifier — A Computer Music Perspective

                           

"The system does not ask: 'What does a p-mode sound like?' It asks: 'How does a p-mode reorganize the internal state of the computational organism?'"        

       The Heliosonic Sonifier occupies a unique position at the intersection of scientific data sonification and artistic musical expression. This entry examines the system's scientific transparency through the lens of computer music discourse, addressing the epistemological distinctions between scientific simulation, data representation, and artistic metaphor.        

       The system's approach is grounded in the understanding that scientific data (NOAA/SWPC) provides the material foundation, scientific concepts (p-modes, solar cycle) serve as structural inspiration, and scientific metaphors (quantum mechanics, black hole physics) function as compositional constraints. This tripartite framework distinguishes the Heliosonic Sonifier from both purely scientific sonification tools and purely abstract musical instruments.      

The Epistemological Framework

      In computer music, the relationship between scientific concepts and musical implementation has a long and complex history. From Xenakis's stochastic processes to Roads's granular synthesis, scientific metaphors have served as generative constraints for musical creativity. The Heliosonic Sonifier extends this tradition while maintaining critical transparency about the nature of its scientific references.    

      This framework articulates a critical distinction that is essential for understanding the Heliosonic Sonifier's approach. When I speak of resonance rather than representation, I am drawing on a tradition in computer music that distinguishes between:  

  • Representation: Data is translated into sound; the relationship is one-to-one mapping; the sound is a "sign" of the data; the composer controls the mapping.
  • Resonance: Data is metabolized by the system; the relationship is one-to-many transduction; the sound emerges from the system's internal states; the composer curates the emergence.

      This distinction is fundamental to understanding why the scientific references in the Heliosonic Sonifier are metaphorical rather than literal. The system does not ask: "What does a p-mode sound like?" It asks: "How does a p-mode reorganize the internal state of the computational organism?"

The Three Categories of Scientific Reference

1. Verified Scientific Models (VERIFIED)

      These models correspond to established, empirically validated scientific phenomena:  

  • p-modes: Christensen-Dalsgaard (2002); confirmed by SOHO/MDI (1996-2017) — Pitch modulation at 3 mHz (333s period) — Direct structural inspiration
  • Solar cycle: Hathaway (2015); empirical data from 1755-present — Long-form structural change (~11 years) — Temporal scaffolding

      Computer Music Context: These models function similarly to the use of Fourier analysis in computer music—they provide mathematically grounded structural principles that shape musical material without claiming to represent acoustics literally.

2. Theoretical Models ( THEORETICAL)

      These models are scientifically hypothesized but not empirically confirmed:  

  • g-modes: Cowling (1940s); not confirmed observationally — Slow temporal modulation (~5000s period) — Artistic speculation

      Computer Music Context: The use of g-modes parallels the use of speculative physical concepts in computer music—for example, the use of "quantum" or "chaos" theory in algorithmic composition. The system treats these as generative constraints rather than scientific facts.

3. Artistic Metaphors ( ARTISTIC METAPHOR)

      These models are explicitly metaphorical, drawing on scientific terminology for compositional purposes:  

  • Black hole analogies: Event horizon, singularity, spaghettification — Data transformation thresholds, reset mechanisms — Computational metaphor
  • Quantum mechanics: Entanglement, superposition, tunneling — Coupled ghost notes, probabilistic decision-making — Generative constraint

      Computer Music Context: These metaphors function as what computer music theorists call "generative constraints"—they provide organizational principles for musical material without claiming physical accuracy. This practice is well-established in contemporary computer music:  

  • Xenakis (1971) used stochastic physics as a compositional framework
  • Roads (2001) adopted particle physics concepts as a microsound paradigm
  • Puckette (1996) employed state machine models derived from control theory

The Computer Music Tradition of Scientific Metaphor

      The Heliosonic Sonifier's use of scientific metaphor participates in a distinguished tradition within computer music. The system's approach is consistent with what French composer and theorist Jean-Claude Risset termed "the poetic appropriation of scientific models"—the artistic adaptation of scientific concepts for aesthetic purposes.  

Historical Precedents

  • Iannis Xenakis: Stochastic physics, gas theory — Probability-based composition
  • John Chowning: Frequency modulation (FM) — Acoustic synthesis model
  • Curtis Roads: Particle physics — Granular synthesis paradigm
  • Miller Puckette: State machines — Real-time control architecture
  • François Bayle: Acousmatic theory — Sound object morphology

      The Heliosonic Sonifier extends this lineage by applying scientific metaphors specifically to the domain of data sonification, where the distinction between representation and resonance is particularly significant.

The Resonant Framework

      The concept of resonance is central to the Heliosonic Sonifier's epistemology. In the context of computer music and AI-driven creativity, resonance refers to:  

  • Vibrational Ontology (following Steve Goodman, 2010): Sound as a force that modulates bodies and systems
  • Digital Resonance: The phenomenon in which a computational system's internal states oscillate at specific frequencies in response to environmental forcing
  • Metabolic Resonance: The transduction of environmental data through internal state dynamics

      This framework is formalized in the AI-Chimera's ontogenetic architecture:  

    I = ∂Be / ∂A  

      Where I = Intelligence (differential sensitivity), Be = Emergent Behavior, and A = Environment (data).

The Role of AI in Computer Music

      The Heliosonic Sonifier's use of AI is consistent with contemporary computer music discourse on distributed agency. The system employs multiple AI agents that operate autonomously:  

1. StateAwareMarkovMelody — Generative Melody

      A 3rd-order Markov chain with 8 musical states and 80,000 transitions. The system uses an LRU cache (200 entries, 95% hit rate) and generative AI (genetic algorithms, Perlin noise, cellular automata) to produce melodies that are neither purely deterministic nor entirely random. The melody "breathes" with the Sun's p-modes (3 mHz, 333s period).    

      Computer Music Context: This approach extends the Markov chain techniques pioneered by Xenakis (1971) and later developed by researchers like Dubnov (2026), who explores probabilistic generativity and latent musical states.  

2. AdaptiveMemory — Reinforcement Learning

      An episodic memory system with 1000 entries, each storing 11 NOAA dimensions and 10 music dimensions. It uses an ensemble of 5 models with RBF kernel similarity and a dynamic learning rate (2-60%) that adapts to the data context.    

      Computer Music Context: This approach to reinforcement learning in music generation resonates with recent work by Karchkhadze & Dubnov (2026) on real-time human-AI musical co-performance.  

3. GlitchEngine — Quantum-Inspired

      A quantum-inspired engine that generates glitches using tunnelling probability \(P = \exp(-2\kappa L)\), entanglement (coupled ghost notes), and superposition (collapsed states from 4 possibilities).    

      Computer Music Context: The quantum metaphor is operationalized as a computational decision engine—a practice that is well-established in computer music literature, as documented in the "quantum states" entry of this journal.  


The AI-Chimera: Relational Creativity

      The Heliosonic Sonifier is grounded in the conceptual framework of the AI-Chimera, an ontogenetic computational entity defined as a dynamic quintuple:  

    X = {B, M, A, E, Be}  

      Where Body (B) = The operational materiality; Metabolism (M) = The interpretative transduction layer; Environment (A) = The ontological condition of existence; States (E) = Internal configurations of tension and transitional potential; and Emergent Behavior (Be) = The dynamic manifestation resulting from the interaction of all previous components.    

      Intelligence within this framework is stripped of anthropomorphic cognition and defined operationally as differential sensitivity to the environment. This formulation distinguishes the AI-Chimera from deterministic sonification engines, establishing it as an autonomous entity capable of sonic infrastructural inquiry—a concept that resonates with what I have termed sonic infrastructuralism: a practice of infrastructural critique through vibrational modulation.  


The SRT7 Framework

      The SRT7 framework (presented at AVANCA 2026) provides the diagnostic tools that the Heliosonic Sonifier's scientific transparency operationalizes. SRT7 audits sonic governance at the levels of:  

  • Signal: What vibrational materiality has been sterilized by this signal path?
  • Representation: What sonic logic does this interface render impossible?
  • Trajectory: What durational choices constitute a protocol violation?

      The Heliosonic Sonifier's scientific transparency is itself a form of meta-listening—a reflexive auditory practice that interrogates the conditions under which listening is mediated, governed, and automated.

Implications for the Computer Music Field

      The Heliosonic Sonifier contributes to the field of computer music in several significant ways:  

1. Transparency as Aesthetic Value

      The system demonstrates that scientific transparency can be an aesthetic value, not just a scientific one. By clearly distinguishing between verified physics, theoretical speculation, and artistic metaphor, the system cultivates what I have termed meta-listening—a reflexive auditory practice that audits the conditions of audition.  

2. The 1:N Transduction Paradigm

      The system's 1:N transduction paradigm—where a single data-event radiates across multiple musical layers—offers a new model for data sonification that moves beyond the representational paradigm of 1:1 mapping.  

3. AI as Co-Agent

      The system's AI agents are integrated as co-creative partners, not as black boxes. This approach to distributed creativity aligns with recent developments in human-AI interaction research in computer music.  

4. Post-Techno Aesthetics

      The system's embrace of glitch, noise, and irregularity situates it within the Post-Techno aesthetics framework developed in my EIMAD 2026 paper—a critical practice that weaponizes technological failure against algorithmic homogenization.  


Critical Reflections on Scientific Metaphor

Limitations and Risks

      The use of scientific metaphor in computer music is not without risks. As I have acknowledged in previous entries, the quantum metaphor can be misused to imbue computational systems with a false sense of mystery or autonomy. When I describe the GlitchEngine's "quantum collapse," I refer to a specific computational process—probabilistic selection from a set of latent states—not to a mysterious or inexplicable phenomenon.  

Operationalization of Metaphor

      The key to using scientific metaphor responsibly is to operationalize it—to translate the metaphor into specific computational algorithms whose behavior can be understood and analyzed. This is what the Heliosonic Sonifier does with its quantum-inspired models, using the mathematical form of tunneling equations as generative algorithms for musical events.  

The Value of Transparency

      The scientific transparency of the Heliosonic Sonifier is essential for its positioning as an artistic and educational tool. By clearly distinguishing between what is scientifically verified, what is theoretical, and what is metaphorical, the system cultivates critical engagement with both science and art.  


Conclusion

      The Heliosonic Sonifier's scientific transparency is not an afterthought or a caveat—it is an integral part of the work itself. By distinguishing between verified physics, theoretical speculation, and artistic metaphor, the system participates in a tradition within computer music that treats scientific concepts as generative constraints for creative practice.    

      The question that animates this research—"How does a data pattern reorganize the internal state of a computational organism?"—will not be answered definitively. But the Heliosonic Sonifier provides a way to practice it. To test it. To perform it.    

      This is the path of sonic infrastructuralism. There is no return. Only resonance.  

Entry #11 — Init Log


   # SCIENTIFIC TRANSPARENCY — Init Log 
   > journal_entry: #11 
   > date: 2026-08-08 
   > project: HELIOSONIC_SONIFIER 
   > mode: THEORETICAL_REFLECTION 
   > core_distinction: REPRESENTATION_vs_RESONANCE 
   > epistemological_categories: 
      - VERIFIED (p-modes, solar cycle) 
      - THEORETICAL (g-modes) 
      - ARTISTIC_METAPHOR (quantum, black holes) 
   > frameworks: 
      - AI-Chimera: X = {B, M, A, E, Be} 
      - SRT7: Signal, Representation, Trajectory 
      - Meta-Listening: reflexive auditory praxis 
   > computer_music_tradition: 
      - Xenakis (stochastic physics) 
      - Roads (granular synthesis) 
      - Puckette (state machines) 
      - Risset (poetic appropriation) 
   > references: 
      - Christensen-Dalsgaard_2002 
      - Cowling_1940 
      - Dubnov_2026 
      - Goodman_2010 
      - Hathaway_2015 
      - Karchkhadze_Dubnov_2026 
      - Paquete_2026a (AVANCA) 
      - Paquete_2026b (EIMAD) 
      - Puckette_1996 
      - Roads_2001 
      - Xenakis_1971 
   > status: REFLECTION_COMPLETE

Hugo Paquete
          INET-md, University of Aveiro      
8 August 2026

#ResearchPractice #PracticeBasedResearch #SonicInfrastructuralism #DigitalLuthier #CreativeCoding #PythonMusic #AIMusic #NewInterfaces #SoundArt #PostDigital #ComputationalEcology



Institutions & Networks

  • FCT — Foundation for Science and Technology
  • INET-md — Institute of Ethnomusicology, University of Aveiro
  • University of Aveiro — DeCA UA
  • CS‑Lab — Cybersecurity and Systems Laboratory — Technical collaboration in cybersecurity, network analysis and real‑time data processing for the Cyber Attack Sonifier project. University of Coimbra
  • Absonus Lab — Laboratory for Sound Research, Technology and Culture
  • Planetário do Porto – CCV — Porto Planetarium
  • OTTOsonics — Sound Spatialization Research
  • Shodan — Computer Search Engine for Internet-Connected Devices (API collaboration for Cyber Attack Sonifier)