Google

Loading all those gorgeous pixels

Google: Smarter
File Format

As a lead designer at Pilot Lab, I helped Google conceptualise an approach to multi-modal data capture that enables better recognition of context, meaning, and purpose via machine learning. A range of user scenarios explored how that can result in a richer representation of the world as well as a more intuitive and useful interaction with information across Google’s ecosystem.

Connecting
the dots

Capturing visual, audio and other information is a laborious and limited process. Individual data sources describe only a fraction of the real world. This makes it difficult to infer their context, meaning, and purpose, which is a crucial function of AI-enabled technologies.

My team conceptualised an approach that sees data capture as a fluid process, continuously integrating multiple sources to draw a richer, more cohesive image of the world. This new concept - dubbed SuperFormat - gives AI a better chance to recognise context and respond to a person's intentions and needs with greater accuracy.

Mapping out data flow and integration

Incorporating multiple sources of data and content at the moment of capture - and beyond - provides a fuller picture of the user's environment.

Finding meaningful
application

One of the project goals was not only to formulate a viable concept, but also to demonstrate its practical value. This involved identifying and addressing common friction points related to data capture and specific use cases defined by a rich spectrum of social, physical, economical and personal factors. Rapid ideation, prototyping and production resulted in 3 stories that demonstrate the value and potential of the concept.

Optimising user journey

By removing any decision-making, interaction, or navigation delays defined by the current file format or interface limitation, the new approach enables users to immediately act upon inspiration to capture that data.

Scenario framework

Systemised user attributes were used to generate plausible and valuable use cases.

UX mechanics

The envisioned UX model involved unobtrusive, minimal interactions and immediate access to content and actions.

Share memories
of time spent together

Content from multiple sources and devices is blended and enhanced with AI-driven features that enable friends to experience different aspects of the same event.

Feel closer together
when far apart

Quick capture, greater contextual awareness, and AI embellishments layered into the same file make asynchronous communication seamless, engaging, and fun.

Collate, collaborate
& create wherever
you are

Leveraging Google’s ecosystem across devices and products empowers features that unleash collaboration and create a more organic overall experience.

New perspectives

It was very exciting to learn that the work has been rallying people across Google's teams - including Google Photos - and preparing the ground for a new wave of innovation.