Network Bending as Circuit-Bending Inspired Live Neural Synthesis Hacking

Błażej Kotowski blazej.kotowski@upf.edu Universitat Pompeu Fabra, Barcelona, Spain

Frederic Font frederic.font@upf.edu Universitat Pompeu Fabra, Barcelona, Spain

Abstract

Circuit bending has long framed technical malfunction and misuse as sites of musical invention, enabling non-expert, hands-on engagement with electronic sound circuits through the practice of an immediate canvas. This paper articulates Network Bending as a circuit-bending–inspired approach to neural audio synthesis, making its connection to the tradition and ethos of circuit bending explicit. Network Bending is presented here as realtime, hands-on modification of neural network parameters—specifically weights and biases—during sound generation, where instability, breakdown, and opacity become compositional material.

The paper situates this practice within histories of musical hacking and instrument repurposing, and introduces an open-source Network Bending tool that enables parameter-level intervention in neural audio models within a realtime environment. Drawing on repeated use in performances and workshops, we introduce the Bending Log as a compositional technique for documenting and reusing exploratory interventions across models and performance contexts, and present a complementary Network Blending experiment that combines corresponding parameter spaces across models. We further reflect on workshop-based dissemination and community uptake, positioning Network Bending as an instrument-centered performance practice, a pedagogical tool, and an exploratory engineering approach for engaging with the internal dynamics of neural audio systems.


Bending session

The video shows a network bending session of a rhythmic DDSP model with use of a previously prepared Bending Log.


Model blending

This video documents a process of Model Blending two different DDSP models.


Bending Tutorial

A minimal version of a bending workshop described in the paper, in a video format.


Bending Log for drums.ts

Bending Log created for the drums.ts, available in the Google Drive directory shared below.

id name operation result
17 pretrained.decoder.input_latent_bottleneck.0.bias roll to the right produce more harmonic and brighter timbres
17 pretrained.decoder.input_latent_bottleneck.0.bias squeeze sharper, more compressed sound (a bit like OTF)
24 pretrained.decoder.input_latent_bottleneck.6.weight roll to the right smear the transients
26 pretrained.decoder.input_latent_bottleneck.7.weight scale low – lower volume, higher dynamics
mid – introducting distortion
high – introducing extra tonal timbral elements
32 pretrained.decoder.input_features_bottleneck.3.weight various various operations embellish different parts of the spectrum in a difficult to explain way
34 pretrained.decoder.input_features_bottleneck.4.weight flip add a lot of highs
36 pretrained.decoder.input_features_bottleneck.6.weight draw various interesting short-term timbral glitches
36 pretrained.decoder.input_features_bottleneck.6.weight roll effects similar to highpass / lowpass filtering
37 pretrained.decoder.input_features_bottleneck.6.weight offset up bring up brightness and detail
40 pretrained.decoder.gru.weight_ih_l0 roll abrupt timbral changes, from slight smearing to complete deconstruction
40 pretrained.decoder.gru.weight_ih_l0 scale lower values – rhythmic modulation
higher values – distortion
40 pretrained.decoder.gru.weight_ih_l0 drawing drawing in area around 75–90% of the array brings timbral changes without affecting temporal structure
41 pretrained.decoder.gru.weight_hh_l0 scale expanding – interesting array of temporal glitches
contracting – timbral shift
41 pretrained.decoder.gru.weight_hh_l0 drawing lower half – rhythmic modulation
upper half – distortion
overall – a spectrum of glitches, timbral shifts and modulations
44 pretrained.decoder.gru.weight_ih_l1 scaling contracting – fast rhythmic modulation
44 pretrained.decoder.gru.weight_ih_l1 rolling all kinds of timbral shifts
59 pretrained.decoder.inter_mlp.7.bias scaling, offseting low pass filtering
58 pretrained.decoder.inter_mlp.7.weight offseting upwards – adding noise and reverb
downwards – spectral modeling style effects
52 pretrained.decoder.inter_mlp.3.weight rolling small room reverbs and various distortions
52 pretrained.decoder.inter_mlp.3.weight drawing smearing and drone
60 pretrained.decoder.output_params.weight rolling spectral modeling style effects
60 pretrained.decoder.output_params.weight scaling scaling up – sinusoidal modeling, watery sounds
60 pretrained.decoder.output_params.weight drawing adds narrow-band noise of different frequencies

Pd patch, modified nn~ external, models

The Pd Network Bending patch can be found in the repository.

https://github.com/network-bending-nime/network-bending-nime.github.io/blob/main/nime-network-bending.pd

The following directory contains:

https://drive.google.com/drive/folders/1w9SJLuUZOYmRyn2HUhtEL3Z4BlanR4Rd?usp=drive_link

In order to install nn~ external please refer to the original installaction instructions for Pure data.

https://github.com/acids-ircam/nn_tilde

You can find many compatible .ts models for example at RAVE models download page.

https://acids-ircam.github.io/rave_models_download