renato.design

Field

WIP Figure/Ground Sensorument

field recording

An iPhone in your pocket, AirPods on your head, a Mac in the other room. Twenty channels broadcasting at sixty hertz, dropped into Blender so the geometry breathes with your pulse and turns when you turn… as a first experiment.

bornMay 6, 2026·currentv00000-003 · May 8, 2026

A 3D rendering of a body's recorded trace: a horizontal trail along the ground branches upward into a dome of overlapping arm-circle loops; thin attention beams shoot down and outward where the head was facing at sampled moments. The first artifact captured by Field, written up as the exemplum ‘...by his red right hand’.
In the field

Three pieces, talking to each other across one room.

i · phone

An iPhone reads its IMU, magnetometer, barometer, mic level, ARKit world position, plus AirPods Pro head orientation, heart rate, and HRV. Every reading goes out as a sample over WebSocket.

ii · bridge

A small Mac program accepts the phone's stream and fans it out three ways — WebSocket, OSC, MIDI — while writing every sample to a JSONL file. Records and replays.

iii · Blender

An add-on drops every channel onto a hidden empty named FieldRecorder. Bind a driver to any property in any scene and that property is now your property.

What it might be for
  • Drawing Walk a perimeter holding the phone like a flashlight; ARKit traces the camera's metric path. Loop the perimeter at hood-line, again at greenhouse, again at rocker, and you have a wireframe of an exterior. The driveway is the studio.
  • Mocap Strap the phone to a limb and you have one rigid body of position + orientation tracked. AirPods adds head rotation. iPhone Pro's LiDAR + Vision can do markerless 3D skeleton if the phone watches the subject from a tripod — not Vicon, but real.
  • Jewelry A small walked motion in front of one bench object becomes a wrist-scale form. The magnetic field of the room enters the geometry as an embedded second-author. Wear back the magnetic shadow of a place.
  • Live performance Twenty channels at thirty to sixty hertz are also a thing a DAW can read. OSC out, MIDI out. The body's sensor stream becomes the controller you didn't have to buy.
  • Field witnessing A recorded session is a kind of biography no one was supposed to keep. Read carefully it tells you what a body did with its mass, where it went, what it looked at, and silently what it did not.
First artifact
A 3D rendering of a body's recorded trace: a horizontal trail and a dome of overlapping arm-circles.
Exemplum · 2026-05-08

...by his red right hand

Sensorecording fifty-six seconds. An unseen arm drew, a silent head looked down, walk, draw, spin, what?

in the field — one user, one phone, one Mac, one Blender. Building outward.