Categorieën
Projects

Haptic Keys

PHASE ZERO

The Problem

When I moved to Eindhoven in 2019, I really missed having a piano in my tiny 10-square-meter room. I obviously couldn’t fit my parents’ upright piano, so I explored alternatives. The differences were vast—sound quality, design, price, interface, keys, materials, and portability. Even the premium models often felt cheap, and finding the right one was a journey. Ultimately, a choice was made; the Nord Electro 6HP. However, with my bands demanding lighter, faster and more responsive electric piano sounds, a desire for a lighter keybed started to form. The following question rose:

“What if I could adjust the feel of my keyboard and tailor it to match each sound?”

PHASE ONE

Researching piano’s and keyboards

Piano’s and keyboards come in all sorts and kinds. What originally started with the ‘arpicimbaloa’ (harpsichord) from Christofori in 1700, resulted into a large array of keyboard-instruments, all serving a different purpose. Just like fashion, piano and keyboard players will have their preference per instrument or use these instruments as tools to create the sounds they strive. I.e., keyboards and stage piano’s try to mimic as much sounds and interface elements from different instruments (grand piano, organ, rhodes, synthesizer).

Current research into haptic force feedback for keyboards and pianos reveals no commercial products with integrated haptic keys to modify key touch perception. However, studies like the MIKEY project and research by Timmermans explore creating realistic feedback and dynamic simulations. Timmermans developed a haptic piano key with custom actuators and sensors to replicate the feel of a grand piano. Other efforts, like Supakkul’s use of Stanford’s Hapkits, also investigate haptic feedback. Commercially, features like Nord’s “Dynamic Curve” and “polyphonic aftertouch” offer limited key feel adjustments.

To fully understand all elements of keyboards, piano’s, their feel and haptic implementation a fundemantal understanding of these topics was needed. This included a deep-dive in the history of piano’s, their mechanical working, the difference in keybeds, key sizes and instrument types.

Source: Kawai Pianos
PHASE TWO

Exploration; haptics, sketching, mechanics

Keybeds from manufacturers like Fatar are designed to mimic the feel of original instruments, such as grand pianos’ hammer-action keys and organs’ waterfall keys, while maintaining a portable form factor. However, these keybeds cannot dynamically change their feel or weight. Haptic force feedback offers a solution by using actuators to provide counterforce, replicating the sensation of weight or resistance. For this project, GB36-2 haptic motors and FEELIX software were used to design the haptic force feedback curves, enabling a more versatile and responsive keybed experience.

Haptic Force Feedback Design implementation in FEELIX project

To implement this technology within the design space of keyboards and keybeds, a linear approach is needed. Based on several research and linear actuation mechanism an initial design was iterated. This sketch was then translated into a 3D-design to test limitations, issues and act as design research artefact.

The execution of this sketch to a 3D-printed prototype brought many issues and complexities to the surface., helping to shape the problem statement and discover possible solutions.

Initial Sketch and 3D-printed Prototype of Haptic Keys Prototype 1 “The White One”
PHASE THREE

Iterative prototyping; an explorative approach

Following the initial prototype, multiple iterations were developed using a modular and explorative approach. This sandbox environment allowed for extensive testing and refinement of individual components. Each iteration was first designed in a 3D environment using Cinema 4D, complete with dynamic simulations. The designs were then optimized for 3D printing and fabricated with PETG to ensure material stability and strength.

Haptic Keys Prototypes; The White One, The Tall One, The Overcomplicated One, Back to the Basics and The Considered Final One.
All Haptic Keys Prototype Parts, designed with a Modular Approach

The second iteration of haptic keys, dubbed The Overcomplicated One, aimed to minimize plastic contact for a high-end immersive experience. Inspired by JON-A-TRON’s linear motion concept (2017), I developed a rotational freedom mechanism with Feelix. The first version, The Tall One, used a hinge mechanism to create linear motion but still involved plastic friction. The Overcomplicated One eliminated plastic parts by using steel rods and bearings, but its complexity led to poor interaction. Ultimately, The Tall One’s simpler approach proved more functional, highlighting the importance of straightforward mechanical design.

The Considered Final One embraced a “back to the basics” approach based on the learnings from the Tall One. This simplified design minimized errors and allowed for effective motor mappings to simulate light, medium, and heavy key resistance. Although this implementation does not repect the limitations and linear approach needed for a haptic implementation in keyboards, it opened up explorative testing opportunities in a simple manner.

A push sensor was add to map force to MIDI CC values, creating two mappings: pitch-range and velocity. In pitch-range, more force raised the note, creating an arpeggio effect. In velocity, more force increased loudness, mimicking a piano’s hammer action. This design also enabled an “aftertouch” function, adding further versatility. The required force by the user was less when the motor mapping was weak, and stronger when the motor mapping was mapped at a heavy setting.

PHASE FOUR

Learnings & Business Opportunities

The Haptic Keys project has commercial potential but faces significant challenges. Implementing haptics in an 88-key keyboard is costly and impractical, highlighting the need for more efficient solutions. However, this research is an important first step towards affordable, seamless, and reliable haptic keyboards. The final prototype successfully demonstrated how haptics can enhance MIDI interactions, with heavier haptics allowing easier access to high notes and the slide sensor offering new musical possibilities. These innovations could inspire new products and ways for pianists and keyboard players to create music, indicating promising business opportunities with further development. The haptic implementation could improve the overall play ability and useability of keyboard instruments, and enable an “one-for-all” instrument system.

An overview of several events and demonstration of Haptic Keys
VIDEO

Watch & Learn?

Categorieën
Projects

Living Leather

PHASE ZERO

The Challenge & Initial Iterations

As humans and organisms, we live, we breath, we think, we interact, and we use the world around us to get inspiration and discover new opportunities. Interactive design is about creating unique interactions. By applying an approach to interactive design, such as the Material Oriented Design (MOD) method, an interactive entity can be created from a different perspective. Within this approach the Material stands central. In this paper we present Living Leather, a MOD driven interactive entity which respects its history and uses interactive systems to incorporate the alive element. We show the benefits of applying this approach and the unique aspects of reviving the live in modified artefacts. By combining two interactive elements, the sweat and breathing layer, we designed a standalone entity which is unpredictable, might evoke emotions and provides a unique immersive interaction.

“What if we could ‘revive’ leather to re-expose its amazing natural qualities?”

PHASE ONE

Understanding materials

In our project, we explored leather’s dual-layer structure: the grain and the flesh (suede). The grain, being dense, smooth, and hydrophobic, contrasts with the suede, which is open, looser, and hydrophilic. Understanding these properties was crucial as the suede’s composition significantly affects leather’s thickness and stretchiness. This guided our selection process based on the intended application, balancing malleability and durability.

We also delved into the historical and cultural context of leather. Initially a staple material, leather’s role has evolved due to synthetic alternatives. Today, it represents craftsmanship and luxury, influenced by societal values and ethical considerations. This awareness informed our approach, ensuring sensitivity to leather’s complex contemporary perception.

Five different leather types, varying based on thickness, pebble-pattern and stretchiness.
PHASE TWO

Material Driven Design

With a fundamental understanding of leather our challenge was to create a unique experience. We started with Material Experimentation, thus changing and manipulating the properties of leather to create new interactive properties. This meant; bending the leather, stretching it, poking small holes, watering it, etc. This created interested insights from which a haptic experience could be designed.

Process overview of Living Leather. From Material Experimentation to Gestalt.

To revive leather we wanted to incorporate the ‘sweating’ aspect compared to the human-skin. By poking small holes and testing different patterns, needles (diameter) and techniques we developed a first prototype. To mimic movement we created two prototypes; one including a rotational approach to test the haptic feedback of moving leather, and one other to create a fully randomized movement by the implementations of a haptic force feedback motor and different size paper and wooden balls.

Two iterative prototypes to test the manipulation of the main material; leather. On the left an early randomizing movement prototype, on the right an early prototype of the sweat mechanism.
PHASE THREE

The Final Prototype

With a fundamental understanding of leather our challenge was to create a unique experience. We started with Material Experimentation, thus changing and manipulating the properties of leather to create new interactive properties. This meant; bending the leather, stretching it, poking small holes, watering it, etc. This created interested insights from which a haptic experience could be designed.

A breakdown of the final artefact that shows how the experiments with the materials, mechanisms, and interactions came together.

  1. Demonstration of the pinholes in the leather to allow the surface to sweat.
  2. The selections of lather to decide the final surface, we chose a thicker pebbled leather.
  3. The selection of sponges and foams used to retain and release the water.
  4. The cling film layer to protect the electronics as well as assist in pushing the water up through the leather surface.
  5. One of the mechanisms to give the artefact movement, the balls are used to create randomized movement as they roll over each other and press against the leather.
  6. The final artefact was printed in PETG, which supports a more sturdy base and housing for both the Feelix Motor as the balls and leather attachment.
  7. The Feelix Motor system which provided the needed power to move the final artefact.
PHASE FOUR

Concluding

“Living Leather” demonstrates the potential for creating immersive experiences using a MOD approach while honoring the material’s history. We successfully recreated a breathing and sweating layer, reflecting the original features of leather. By analyzing, synthesizing, and detailing aspects of interactive materiality, designers can research material properties, delve into its history, and explore interaction opportunities. Ultimately, our project showcases key learnings and design process elements, illustrating how to integrate material history into MOD-driven interactive design.

VIDEO

Introducing Living Leather