Proof of Concept - The Power of Multimedia Experiences
The Power of Multimedia ExperiencesIssue 54: How a practice feels forgotten today, and why it's important
Multimedia...it's a word that immediately transports me back to the 90s—the main decade of my childhood and upbringing. The definition of multimedia is any combination of digitally manipulated text, graphics, sound, animation, and video elements. This sounds rudimentary today, but at the time it was revolutionary. I struggled with learning based on how schools taught. I honestly found it so boring. Reading, writing, and math were subjects I had to put a lot of effort into to do well in them. Basically, I was bad at the “important” subjects. However, when it came to visual learning or learning by doing, I excelled at it—classes such as art. In addition to art, the other venue for this type of learning was the computers we had at home. My father invested in technology knowing it would be a big part of how my brother and I would live in the future. One day, Dad brought home a desktop computer that would put the ENIAC to shame; a Gateway 2000 386 PC. It was the first computer we had that included a CD drive. In addition to the new fancy computer that came in a cow-patterned bow, we upgraded to Windows 95, an operating system with so much power we didn't know what to do with it. We also got an interactive encyclopedia called Encarta 95 on CD-ROM. An encyclopedia, on a CD? You mean, no more hauling those Britanicca books? I became obsessed with multimedia. It was like learning while playing a video game. At any chance I could, I'd boot up Encarta and experience the world through reading, clicking on images that would come to life, and play video or music. The second memorable multimedia experience came in 1994 in the form of a video game on the Sega CD: Jurassic Park. It was a point-and-click adventure game based on the 1993 blockbuster film As you play the game, you can access terminals where full-motion video (FMV) would play during parts of the game; allowing you to research and learn about the different dinosaurs you encounter on the island. Here’s one of the videos you’d encounter. There is a great mini-documentary about the making of the video game. They built a cross-disciplinary studio in Redwood City to create multimedia games, and Jurassic Park was their first title. (Fun game: count how many times they say “multimedia”) Multimedia in designThe practice of Multimedia influenced the type of designer I’d become in my career. As an individual contributor, I was often asked to explore and prototype experiences on core systems or new products. I would focus on high function and fidelity, and I don’t mean fidelity in terms of pixels but creating an experience that feels real by bringing in sound, animation, video, and software to tell the customer's story. Linda Dong, a former Apple designer (now back at Apple!) once shared how she used iAd Producer to build prototypes. This is one of the best examples of taking multiple types of media and combining them into a cohesive user experience prototype. Multimedia experiences are essentially storytelling at the most realistic fidelity possible. Multimedia and remote workspacesAdrián Mato, designer at GitHub tweeted about interactive playgrounds and their possibility, which made me reminisce about multimedia. I am loving how interactive playgrounds are becoming more common in tutorials. It makes learning accessible, meaningful, and more entertaining 😌 There are alternative ways to learn aside from step-by-step videos and documentation. One of my favorite interactive tutorials was Apple’s Swift Playgrounds; something I used when learning the new programming language that aspired to replace Objective-C. Multimedia learning creates new possibilities of how remote teams can work as well. If you talk to any remote design team, I bet the two challenges that come up are communication and collaboration (including our own team). Design is such a collaborative practice and it takes effort to do it well remotely. To be honest, I’m still not sure if any team has cracked the code on this yet. Instead of heaps of documents, applying multimedia to documents can create a new level of interactivity. Some examples that come to mind:
I think interactivity between synchronous and asynchronous is a larger challenge than the hybrid office/remote problem. Combine software tools to push multimedia practicesI’m not proclaiming that Multimedia is back, or went away. We took it for granted and lost sight of its power. As software became more powerful, it seemed like there was a shift for bulky tools that tried to encompass the full suite of the walled garden instead of smaller utilities that did certain things well. There's an opportunity for a resurgence of multimedia with our modern tools. As you consider different ways to tell stories and foster interactivity, consider combining the tools you use. Here’s an example of a prototype I built for a startup with iAd producer Try it: create a simple multimedia experienceMultimedia experiences are simple to get started with. It’s literally using multiple types of media in one experience. Here are a few examples of what you can build to experiment:
I'm excited about the possibilities of multimedia learning and experiences being a key focus again. Hype Links
Design OpportunitiesEnjoy this newsletter? Please consider sharing it with friends, or subscribing if you haven’t already. I appreciate it! Sincerely, DH |
Older messages
How I Make Content For This Newsletter
Sunday, August 15, 2021
Issue 53: BTS on the making of Proof of Concept
Computing Experience: The Other CX
Sunday, August 8, 2021
Issue 52: What if we treated computers like our customers?
How Technical Constraints Inspired a Video Game Developer Create a New Genre
Sunday, July 25, 2021
Proof of Concept Issue 50
Proof of Concept #49
Sunday, July 18, 2021
Talks That Shaped My Philosophies
WTF is a Product Designer?
Sunday, July 11, 2021
Issue 48: Unpacking a generalized title in the context of tech and software
You Might Also Like
Pierce & Ward’s Secret Sources, Business Advice You Can’t Afford to Miss, and More
Friday, April 19, 2024
View in your browser | Update your preferences ADPro “Minimalism is not my strong suit.” So says Emma Roberts, the muse behind AD's May cover story. (Celebrities—they're just like us!)
World Press Photo Contest, Speedometer 3.0, Anchor Position, Sliding Frame, Meta Llama 3
Friday, April 19, 2024
The 5 best design links, every day. Curated by a selection of great editors. Email not displaying properly? View browser version. Sidebar April 19 2024 The World Press Photo Contest Documents War,
Car UX, DevTools Tips, CSS Patterns, iOS404, Internet Cables
Thursday, April 18, 2024
The 5 best design links, every day. Curated by a selection of great editors. Email not displaying properly? View browser version. Sidebar April 18 2024 Steering the future: a new vision for car UX
Big Tents, Pistachio Palettes, and Other Late-Breaking Milan Discoveries
Wednesday, April 17, 2024
View in your browser | Update your preferences We've had a remodel! From now on, you'll be hearing from AD PRO in your inbox twice a week—once with a deep dive into trends to watch and subjects
163 / Dieter Rams inspired Framer components, America's national parks and more free resources…
Wednesday, April 17, 2024
Product Disrupt Logo Product Disrupt Half-Monthly Apr 2024 • Part 1 View in browser Welcome to Issue 163! I'm comfortable talking to a human on camera, but talking at the camera, not so much. The
Logo System, BCWA Identity, War Robots, 84—24, 19th-Century Atlas
Wednesday, April 17, 2024
The 5 best design links, every day. Curated by a selection of great editors. Email not displaying properly? View browser version. Sidebar April 17 2024 Logo System: Explore 400+ logo designs logosystem
Emma Roberts's Home: AD100 Firm Pierce & Ward Share Their Secret Sources
Tuesday, April 16, 2024
Plus, the best exterior house colors View in your browser | Update your preferences Architectural Digest AD PRO Logo exterior of two residential buildings painted with blue trim with a brick patio and
#452: Design Workflow
Tuesday, April 16, 2024
How to choose the right idea, navigate difficult conversations and communicate design. Issue #452 • Apr 16, 2024 • View in the browser Smashing Newsletter Iyi akşamlar Smashing Friends, Design workflow
Mario & Pareto, faces.js, Sleep vs Blog, Dark Mode, DOM Folding
Tuesday, April 16, 2024
The 5 best design links, every day. Curated by a selection of great editors. Email not displaying properly? View browser version. Sidebar April 16 2024 Mario meets Pareto mayerowitz.io Discover how to
Gap, Teenagers, Artistic Intelligence, Should Designers Code, CSS in RSCs
Tuesday, April 16, 2024
The 5 best design links, every day. Curated by a selection of great editors. Email not displaying properly? View browser version. Sidebar April 15 2024 Gap is the new Margin frontendmasters.com In 2020