Embedded AR Storytelling Supports Active Indexing at Historical Places
TEI
2022
BEAT
ROSSMY
creative technologist
PROJECTS
COMB
comb is a tangible user interface for musical interaction. different drum voices are sequenced depending on the shape of the interface (dot: kick drum; line: snare, claps, rim-shot; triangle: the hi-hat). all drum sounds are triggered by comb. all synth sounds are backing tracks.
capacitive touch plates recognize interactions with the silicone pads.
ws2812b LEDs provide full RGB light feedback.
teensy LC handles interaction, neighbor detection, and shape recognition.
magnets hold the connection and springloaded connectors transmit data via I2C.
StringTouch
StringTouch is a prototype of a tangible user interface (TUI) concept that is derived from the expressive play of musical string instruments. We translated this interaction paradigm to an interactive interface which offers a novel gesture vocabulary (strumming, picking, etc.).
the silicone layer includes magnets and a perforated base layer to create rigid and flexible subareas.
the PCB layer includes capacitive touch areas to track light touches on the silicone surface.
hall-effect sensors track the silicone's deformation based on the changes in the magnetic field strength.
teensy LC analyses the interaction patterns and detects gestures and micro interactions.
TouchGrid
TouchGrid explores the combination of the flexibility of touch interaction with the tangibility of button-based musical grid interfaces. interaction concepts known from hte interaction with touchscreen devices are adapted to reduce infrequently used UI elements.
TouchGrid is built on an Adafruit NeoTrellis DIY kit.
an additional PCB is added under the top surface which contains capacitive touch areas.
thus, touch gestures such as swiping or dragging can berecognized.
the teensy LC analyses the capacitive touch data and detects all gestures.
Punishable AI
Punishable AI is a speculative design project which examines users' attitude towards robot punishment. this speculation addresses the ongoing anthropomorphization of technologies and the questions of intelligence and personality of intelligent machines.
a teensy LC controlls the robot's movement patterns and analyses the sensor data.
a LSR is used to evaluate the flash light interaction.
the robot's legs a re manufactured from PCB material and include touch areas and perforated breaking lines.
the movement is executed by 12 servo motors.
RESEARCH
StringTouch – From String Instruments towards new Interface Morphologies
TEI
2021
Shaping Concrete for Interaction
TEI
2021
Supporting Learning Interaction in a Distributed Learning Environment with Tangible User Interfaces
CSCL
2021
TouchGrid – Combining Touch Interaction with Musical Grid Interfaces
NIME
2021
Musical Grid Interfaces: Past, Present, and Future Directions
NIME
2021
Tangible Interaction with Light: A Review
MDPI
2020
Punishable AI: Examining Users' Attitude Towards Robot Punishment
DIS
2020
A Human Touch: Social Touch Increases the Perceived Human-likeness of Agents in Virtual Reality
CHI
2020
Metaphors and Technologies for New Tangible User Interfaces
TEI
2020
Affordances Based on Traces of Use in Urban Environments
TEI
2020
Lure the Drones-Falconry Inspired HDI
iHDI
2019
StringTouch: A Scalable Low-Cost Concept for Deformable Interfaces
CHI EA
2019
COMB – Shape as a Meaningful Element of Interaction
TEI
2019
Augmenting Everyday Objects – A Reflection on Reuse as an Interface Design Method
MUC
2019
The Modular Backward Evolution – Why to Use Outdated Technologies.
NIME
2019
MUSIC TOOLS & MUSIC
SuperBrain
SuperBrain is a midi sequencer script for the norns music computer environment, originally developed for the LanchpadX controller. the goal of the script is to allow parallel sequencing of multiple instruments with different sequencer styles.
VITA
EDUCATION
Ph.D. in Human Computer Interaction
LMU Munich
2022
M.Sc. in Human Computer Interaction
LMU Munich
2018
B.A. in Art and Multimedia
LMU Munich
2014
ART PROJECTS
AWARDS
StringTouch: Honorable Mention Award
TEI
2021
COMB: Best Demo Award
PerDis
2018
Total Revolution: KARL & FABER Award
ADBK Munich
2016
SKILLS
Languages
German, English
Programming Languages
Java, Processing, C++, Lua
Javascript, Python
Pure Data, Max MSP
Software
Illustrator, Affinity Designer, Blender, Ableton Live
Photoshop, Affinity Photo, Davinci Resolve, Eagle
Prototyping Techniques
Laser cutting, silicone casting, soldering, smd soldering
PCB design
3D printing, CNC routing
EXPERIENCE
technological and media pedagogical consulting
in form of concepts and reports for the usage and implementation of creative technologies in the museums pedagogical context
Museum Brandhorst
2021
software development
of visualizations of building information for the Corporate Headquarters Global Study using processing for interactive data exploration
OECC
2016 - 2017
hardware prototyping
of a hybrid piezo/oled-based headphone for the european Light.Touch.Matters project using teensy
Pilotfish
2016
software prototyping
of light animations and data visualizations to create ambient light displays using processing
feno
2014
research
on topics of interaction design, tangible user interfaces, musical interaction and expression, design theories, and speculative design in HCI
LMU Munich
2018 - 2022
conception and teaching
of courses with a focus on: creative coding; basic programming; hardware prototyping; concept development; user expereince
LMU Munich
2015 - 2022