Generative UX

Generative UX

This is the third in my five part series on “What does design have to do with Gen AI driven data integrations?”

Generative AI + UI = Generative UX

Imagine a product where the menus, toolbars, and settings are content rather than framework. It should be easy to do: For over 25 years we have been using browser based apps for email, collaboration, documents and spreadsheets to enterprise SaaS solutions. The “interfaces” for all these products are already “content”, delivered in the same way this article is displayed in a browser alongside the tools someone determined you needed.?

If you treat the user interface not as a fixed set of controls, menus, toolbars, but as a fluid set of operations that can contract or expand based on the user’s actions, GenAI could use intent, subject, context, and behavior to dynamically generate a set of operations organized and tailored to both skill level and working style of the individual. We have begun seeing this already with Salesforce’s Generative Canvas, dynamically adapting to the individual user based on their role and task. But this is just the beginning.

This could prove invaluable to addressing the complexities within all enterprise applications; SAP, Workday, Oracle, etc. with their thousands of commands, actions, and comprehensive workflows, optimized to accommodate every scenario across an organization, not the specific tasks an individual is expected to complete. The result is clicking through extra screens, navigating expansive directories, scrolling through long forms, just to find those few fields that need their attention.

Adaptive GenUI products would no longer be constrained by the thinking of a product team in Silicon Valley, they would be generated based on the emerging needs and objectives of the individuals using them in the moment–making them far more inclusive and accessible. GenUI will redefine what it means to design products, allowing the design to be based on the interplay between the user and the collective capabilities of the product's underlying system. In many ways it will be more akin to a relationship; going beyond just rote, surface-level interactions it will rely on a deeper dialogue between the user and the product.?

This is more than a simple reimagining of progressive disclosure, it gets to the root of a real problem. Back in 2013, Evernote's CEO, Phil Libin, said their users typically only use 5% of their product’s features, but the problem is that it’s a different 5% for each user. These “5% users” are not unique to Evernote: The latest version of Excel has 486 distinct functions, PowerPoint, 200+ menu commands, Illustrator over 300, and more than 80 tools. Figma is just as overwhelming. And don’t even think about the SAP or Oracle enterprise suites with their dozens of business applications, each with hundreds of functions and features.?

Applied to Adaptive User Experiences, GenAI could be used to:?

  • Generative Disclosure: Progressive Disclosure has long been used to help manage user’s learning curves. To reduce the cognitive load and let users focus on their tasks, generating controls, along with any necessary explanatory information, when and where they are needed. Enabling a more hands-on approach, with AI’s support users would be able to learn by doing without the burden of needing to develop a complex “mind palace” for an information architecture they will never fully use.?
  • Task Analytics: GenAI can track the collective behavior of users, identifying patterns that accelerate task completion. Based on this data, GenAI can offer the optimal set of functions, tools, shortcuts, and best practices helping users complete their work efficiently and accurately.
  • Virtual Coach: offering real-time assistance through a conversational interface, users can ask questions or seek clarification while working, and the AI provides immediate responses, mimicking the experience of a human tutor.?
  • Generated Procedures: step-by-step instructions, based on the user's intent and context, assembling key features and setting up workflows, guiding them through each step, ensuring they have access to the full functionality and tools needed for their specific task.?
  • Compound Controls: GenAI can concatenate a sequence of interactions into single commands or even automate repetitive tasks on behalf of the user. Partnering with users to build personalized interactions based on routines or best practices, GenAI can pull together data from various sources and deliver the weekly status report, or quarterly forecasts.?

Such a system would truly be human-centered, given the experience is defined by the individual users’ needs, allowing them to focus on their objectives, decluttering their interaction and letting them focus on completing their activity. Coupled with recommendations from personalized learning users could find new ways to express themselves,? to problem solve, and to have the? confidence to be creative.?

Sarah Soha

Design x AI | Founder | Prev. at ASML

4 个月

For automating workflows I use Claude+ appscript. It’s free and doesn’t cost like Make or Zapier.

回复
David Berigny

Building / improving people-centric products / services they love across industries (Fintech, Health, AgTech, Govt & more!). Research → Co-creation → Delightful Experiences

4 个月

With voice interactions too—things like pace, tone, and volume become useful signals, to make interactions feel more responsive and nuanced in an AI product. Gives designers more interactive factors design for too. Add in non-invasive biometrics like heart rate from a smartwatch, and even more potential to make the experience of the product, more sensitive, user-friendly, and so will likely get even more widely adopted.

Achim Schlaugies

Shaping Digital Transformation - CEO & National Expert UPA - Usability Academy & GoDigitalXL- Usability & UX & AI KI Training & Consulting - CPUX Certification - UX Medical IEC62366 - AZAV & ISO 9001 certified

4 个月

Very interesting. We had a similar idea for User Interfaces for people who suffered under a stroke. Regaining human capabilities and accordingly adapting the interface … could be something to dig deeper ??

回复
Silvio Almeida

Senior UX/UI Designer

4 个月

Thanks for sharing this amazing perspective about GenAI with us, Matthew Holloway!

回复
Jakob Nielsen

Usability Pioneer | UXtigers.com | ex ????????

4 个月

Great analysis. I agree with all your points, but I was particularly happy to see the "AI as Coach" metaphor applied (I wrote about the 4 metaphors for working with AI here: https://www.uxtigers.com/post/4-metaphors-work-with-ai ). We could finally fulfill the ideal of just-in-time training and help with this integration of AI coaching and GenerativeUI. One more thing I have not seen discussed, and which I am not sure is realistic, is the ability for the application's AI to collaborate with the user's personal agent AI so that the UI would be even more individualized based on that user's observed behavior in other applications.

要查看或添加评论,请登录

Matthew Holloway的更多文章

  • 14 questions Design Leaders need ask about GenAI

    14 questions Design Leaders need ask about GenAI

    As we begin what I am sure will be a very interesting year, one filled with socio-economic, environmental…

    1 条评论
  • Bypassing the “Hype Cycle”

    Bypassing the “Hype Cycle”

    People don’t buy technology, they buy what the technology enables them to do. It’s a testament of human optimism that…

    1 条评论
  • Cognitive Architecture

    Cognitive Architecture

    Cognitive Architecture While I find attempts to anthropomorphize AI highly problematic, Cognitive Architecture is a…

    1 条评论
  • The Agentic Enterprise

    The Agentic Enterprise

    The term Agentic Enterprise refers to organizations using AI-driven agents to autonomously perform tasks, including…

    2 条评论
  • GenAI + Design = Personalized Learning

    GenAI + Design = Personalized Learning

    Here is the second in my five part series on “What does design have to do with GenAI driven data integrations?” In this…

    1 条评论
  • Design + GenAI = Richer User Insights

    Design + GenAI = Richer User Insights

    A couple weeks ago I asked, “What does design have to do with GenAI driven data integrations?” I shared five reasons…

    4 条评论
  • Don’t worry, I am not mad at you…

    Don’t worry, I am not mad at you…

    Design distills business requirements and customer needs, synthesizing them with technical capabilities and…

    5 条评论
  • McKinsey, please.

    McKinsey, please.

    To be honest, I rarely pay attention to reports from McKinsey but having spent the last decade thinking about design…

    2 条评论
  • Dear interviewer...

    Dear interviewer...

    I have spent most of my career as the interviewer not the interviewee. My recent mentoring work with young designers…

    2 条评论
  • Organizational Design of Design Organizations

    Organizational Design of Design Organizations

    Of late, much has been written regarding the organizational design of design organizations (can I just say, I love…

    4 条评论

社区洞察

其他会员也浏览了