Joy Zeng—Multidisciplinary Artist + Designer

Work

Info

Resume

An interactive live projection performance experience.

EKUA Project Thumbnail

EKUA: To Get To The Other Side

EKUA: To Get To The Other Side is an interactive music experience that bridges live performance, projection art, and customized audience contribution.

𖤐 Role

UI Design
Visual Identity
Motion Design

✐ Tools

Figma
Illustrator
TouchDesigner

⏱︎ Duration

12 weeks

𖠋 Team

1 Designer
3 Developers

Background

An interdisciplinary collaboration between design, technology, and performance art

Our team was paired with EKUA, a local Rochester, NY musician, to co-create an interactive experience in support of her latest project, To Get To The Other Side.

After an initial introduction to EKUA’s artistic practice, we developed three potential concepts inspired by her values, our technical skill sets, and the project timeline. Our task was to design an experience that would harmoniously marry EKUA’s music with audience interaction.

Following several collaborative meetings, we decided to pursue a mixed-reality live performance that utilized projections to map audience customized, dynamic patterns—illuminating both the artist’s body and the surrounding environment in sync with the music.

Client Background

Who is EKUA?

Natalia 'EKUA' France is a Ghanaian-American artist whose work exists at the intersection of fashion, visual art, beauty, dance, and music. Her practice is influenced by her cultural heritage, spirituality, and contemporary expression.

EKUA’s music blends Afrobeat, R&B, soul, and pop; she is inspired by Bob Marley, Lauryn Hill, Tems, Rihanna, and many others. Through her music, she encourages listeners to feel deeply and heal courageously.

Comparative Analysis

How can a live performance include interaction with the audience?

From progress tracking, to cataloguing, to local borrowing; there are many fantastic digital tools on the market. But which ones are the most effective—and which ones could be most helpful for a younger audience?

What are the meat and potatoes of the most successful reading applications?
What are the bells and whistles of the most successful reading applications?

Good Reads

Goodreads is a book cataloguing application that helps users find new books with additional social modalities.

Features

Discovery Page

Book Cataloguing

Community Reviews

Filtered Search Options

Takeaways

Discovery features create a highly personal experience for each user

Users can easily keep track of what they read

good reads screens

Libby

Libby is an application that allows users to borrow ebooks, audiobooks, and magazines from their local public library using a library card.

Features

Online Borrowing

Book Cataloguing

Filtered Search Options

Built-in Reader

Takeaways

Creates connection with local library making borrowing more accessible

Shelf feature allows users to view loans, holds, checkout timeline, and notices

libby screens

Goals

Center the music

Although creating an interactive experience was our priority, we wanted to ensure that it never overshadowed the music or the performance itself. It was very important to us that the music remained the focus, rather than becoming a background element.

Create meaningful interaction

Audience interaction shouldn’t feel gimmicky; it should create meaningful points of engagement. Every aspect of the interaction should be enjoyable, engaging, and fun.

Connect audience and artist

The performance experience should spark curiosity and excitement for EKUA’s music and new project.

Project Management

Creating an efficient work pipeline for our team

I served as the team lead for this project, collaborating with team members to define the key tasks required to bring our interactive performance concept to life. I designed the user interface and visual design, planned event user experience, created animated TouchDesign presets, and acted as the primary liaison between our team and the artist.

Two developers focused on web development and server integration, while another developer built body-tracking modules in TouchDesigner. The following outlines the main tasks our team focused on throughout the project.

Interactive coloring app

Develop a web-based application that users can easily access on the day of the performance.

Static and moving visual assets

Create animated visuals for the live performance and design branded promotional material.

TouchDesigner integration

Create a streamlined pipeline that animates customized user input and projects it live onto the performer.

Event logistics

Plan all event logistics including equipment needs, production schedule, and user experience.

User Flow

A user experience centered around three functional pillars

The prevailing commonalities among the most useful reading applications ultimately boil down to three main categories: cataloging/documenting reads, exploring new material, and examining personal progress.

The primary user flow was designed around these three pillars. Below is an explanation of each navigation tab in the user interface, as well as a simplified work flow detailing the main interaction points for users.

Login

The shelf page will allow users to see books they have checked out, or put on hold at their local library.

List Selection

The discover page will include several personalized recommendation sections allowing users to explore new books.

Cart Home

The profile page will provide an overview of the users preferences and personal information.

login work flow

list selection work flow

cart home work flow

Design

Sketches

When designing the main screens with key functionality in mind, it became apparent that because of Book Worm's many features, it would be necessary to inform new users what the app can do. Along with wire framing the main screens, I explored a set of orientation pages.

redesign sketch ideation

Primary screen components

When designing the main screens with key functionality in mind, it became apparent that because of Book Worm's many features, it would be necessary to inform new users what the app can do. Along with wire framing the main screens, I explored a set of orientation pages.

wegmans go cart redesign initial wireframes

The digital cart

Below is the final implementation of the prototyped user interface with the visual style.

wegmans go cart digital cart module wireframes

wegmans go cart list module wireframes

wegmans go cart full interface wireframes

Style Guide

Book Worm's style is vibrant, colorful, round, and dynamic. Because Book Worm is an app created to engage younger audiences, the visual branding needs to maintain interest, feel personal, while supporting app functionality.

Branded illustration also became an important part of the style as it allows the interface to communicate and react in a way that feels more approachable.

wegmans go redesigned style guide

Final Comps

A simple interface coupled with a fun and friendly stylistic voice

Below is the final implementation of the prototyped user interface with the visual style.

book worm final comp screens

book worm final comp orientation screens

Conclusion

Lighthearted Fun

Users should be able to laugh at themselves and others. Physical game shows are often fun to watch because of how absurd and easy the challenges seem. Prioritizing playfulness instead of challenge will also help to ease more frustrating difficulties.

Experiential Novelty

The experience should offer a new way of understanding historical game shows, while staying true to their themes. Our concept of separating two players physically created some interesting opportunities to create a non-traditional digital barrier.

Demographic Versatility

Guests of all ages/heights should be able to physically interact with the experience. Physical game shows can be physically intense and fast paced so we wanted to ensure our game show didn't require users to exert significant physical effort to perform well and have fun.