Omni Apps - Designing for Apps That Can See, Hear, and Speak

Omnimodal AI models like OpenAI’s GPT-4 allow designers to build apps that can see, hear, and speak. In this hands-on workshop, we explore the challenges, opportunities, and responsibilities of working with frontier AI.

Using the context of a meal planning app, you’ll turn a recipe page into a UI, make a smart shopping list, and be guided through cooking by our assistant, Omni. You’ll come away with a thorough understanding of the inputs and outputs and a workflow for continued personal experimentation with Omnimodal AI. No coding is required.

Participants please bring along: A Laptop, with chrome browser installed. Headphones.