It is estimated that anywhere from 60-90% of our human-to-human communication is non-verbal. Beyond the words we choose, everything from our tone of voice, facial expressions, eye contact, body posture, and gestures contribute additional layers of meaning to the messages we convey to other people.
When interacting with computers however,. almost all of the ways we communicate involves an active and singular input. We type, click, tap, and swipe. Computers are generally unable to perceive us outside of the specific inputs we choose to provide them.
Today, computers are increasingly able to perceive us ambiently. They can detect our face, where we are looking, and infer our emotions from our facial expressions. They can see our body position, and see if we are calm or in constant motion. How might we design systems and interactions that make use of this awareness? And how might this ability to more deeply communicate with technology affect how humans interact through technology?
The Language Without Words workshop will introduce participants to computer vision, and explore how we might design human-centered applications of this technology through a condensed Design Sprint.
Participant Requirements
- Participants should have one of the following:
- A basic working knowledge of UX Design
- A basic working knowledge of code (HTML/JavaScript)
- Participants must bring a laptop with a camera
Agenda
Part 1 - Immersion + Inspiration (3 hours)
The first half of the day will focus on learning the fundamental workings of these technologies and how we might consider designing for them. In this section we will cover:
- Human Communication: how language extends beyond words
- Introduction + Demos: how computer vision can see our face, body, and emotions
- Use Cases: how others have used this technology
- Ethical Considerations: designing for ambient technology
~~Lunch~~
Part 2 - Design + Prototype (3 hours)
The second half of the day will be focused on designing, sketching, and prototyping applications for ambient interactions. The goal is to outline a project or experiment that you can take forward after the workshop.
- Break into groups
- Brainstorm, sketch, and prototype
- Share + Feedback
- Closing Thoughts
~~ SEAN MULHOLLAND BIO ~~Sean is fascinated by human-computer interaction and how technology affects human to human interaction. Despite hacking hardware and software since childhood he went to art school. His work focuses on combining technology, design, and storytelling into compelling products and experiences.
Currently, Sean works at IDEO as a Design + Team Lead focusing on new ventures, media, and technology. His craft expertise focuses on multimodal experience design, prototyping, and user research using a variety of digital and physical methods. His work on these topics been presented, published, and exhibited on four continents.
Prior to IDEO, his background includes three startups (including one of his own) and three agencies. In startup land he launched an IoT product via a hugely successful crowdfunding campaign, and before that helped build one of the first legal means of marketing software via peer-to-peer networks. On the agency side he has launched new brands, relaunched classic brands, and helped design a movement for a national non-profit that captured international attention.
References:
https://seanmulholland.com/https://labs.ideo.com/author/smulholland/Twitter: @illah
Instagram: @illah
Duration: 6 hours (+breaks)
Target group: a mix of UX, UI designers & programers
Working language: English
Lunch and refreshments will be provided on-site
This workshop
has been supported using public funding by Slovak Arts Council, Visit Košice, and Ministry of Construction of the Slovak Republic.
