Case Study / Creative System

Muse
Sketch

A mobile composition system designed to move musical ideas from intuition to notation without interrupting creative flow.

Role
Product Design · Interaction Design · Music Systems
Scope
Mobile UX · Notation Logic · Audio Interaction
Status
In Development
MuseSketch mobile gestural composition interface
Primary composition interface / Gesture to notation
01 / Context

The problem was not musical literacy.
It was interface mismatch.

Traditional notation software assumes that musical thought begins with notation. Most ideas begin somewhere less formal: gesture, contour, rhythm, and motion.

MuseSketch began with a different premise. The interface should preserve the shape of an idea before asking the musician to formalize it.

02 / Intent

Let musical thought stay musical
for as long as possible.

Intent / 01

Capture gesture

Translate melodic contour and movement directly, before symbols or discrete note entry become necessary.

Intent / 02

Delay precision

Introduce formal structure only when it adds value instead of forcing it at the moment of inspiration.

Intent / 03

Keep it physical

Make composition feel responsive and embodied rather than clerical or menu-driven.

Constraints
  • Small-screen interaction
  • Real-time audio feedback
  • Traditional notation compatibility
03 / System

From motion
to meaning.

The system introduced precision in stages. Each layer respected the information and ambiguity preserved by the one before it.

  1. 01
    Gestural canvas

    Continuous movement captured melodic contour without requiring discrete note entry.

  2. 02
    Interpretive quantization

    A translation layer found musical structure without treating the original gesture as an error.

  3. 03
    Notation engine

    Formal notation emerged as an output when it became useful, not as the primary interface.

04 / Key Decisions

Preserve ambiguity.
Introduce precision later.

  1. 01

    Use continuous gestures

    Movement offered a more natural expression of contour than selecting individual notes on a small screen.

  2. 02

    Interpret, don’t correct

    Quantization became a collaborative translation of intent rather than a judgment about accuracy.

  3. 03

    Let sound lead

    Immediate audio feedback carried more meaning than additional visual confirmation or interface chrome.

  4. 04

    Make notation an output

    The system could arrive at formal structure without forcing the creative process to begin there.

05 / Artifacts

A fluid idea becomes
a reusable composition.

Gestural composition walkthrough / Interactive prototype
MuseSketch notation engine output
Notation engine output / Formalized musical structure
06 / Outcome

Good creative tools do not replace intuition. They protect it until structure is ready.

MuseSketch reframed composition as a fluid process. Ideas could be captured naturally, translated deliberately, and formalized without turning structure into an interruption.

Previous Case Study / 01

Bron

Giving agent intelligence timing, tone, and presence.

Explore Bron
Bron sports intelligence interface