Wait for it ... process flow charts are really data flows?
Process Flow of a Lead to Account Match

Wait for it ... process flow charts are really data flows?

Flow charts are straightforward. To define a business process, draw a box for the next thing that needs to happen, create a specialized shape when there is a decision, and annotate the lines to let the reader know what’s happening. What could be easier? I suppose you could invent a workflow that consisted of sentences or that just watched you work and suggested an optimal flow.

But flow charts hide the most important piece of a process. They don’t explain in detail what’s happening to the underlying data and define how to resolve conflicts.

The main reason for this is visual complexity. Think about the start point of a process: you need the reader to understand when it starts and to identify that they are in the process. By definition a process needs one entry point. The best way tot do this in a visual display is to pick an entry point that is undeniable. For example, the figure above shows “New Lead”.

In a typical sales process,?New Lead?means “the first time we’ve encountered a person showing intent to purchase or convert.” The lead could be created from a form fill, attendance at an event, or a person starting a conversation. The starting point for handling that lead is pretty straightforward: they’ve raised their hand. After this happens, the go to market motion springs into action, considering what should be done next, how long it should take, and who needs to take the action.

When creating a process diagram,?most people stop here. They use the process abstraction for a flow chart to generally say what needs to happen and when, and the overall disposition of the result. For example, the chart above details the deduping of a lead (perhaps on email address and name), the matching of that lead to an existing contact and appending data, and perhaps the creation of a new account and contact if qualification criteria is met.

But how does all of that actually happen? Flow creators stop with a pretty picture because they expect other owners (with more knowledge of the data) to fill in the details of how to connect systems. They use the picture of the flow to help stakeholders in other departments understand what’s going on with their intent. And they want the system to reinforce their intent so that metrics, playbooks, and outcomes will be congruent with the flow chart.

Flows hide information by design

Flows don’t tell the whole story. They are a simplification of the data flows that are going on to achieve the results of a flow chart. If you take the lead-to-account matching flow described above and show the the multiple data flows that result, you have a different picture. When a process flow executes as changes in data among objects, there are many other things going on.

We want to describe the process as a series of simultaneous data flows because data flows…

  • bring us closer to the actual data changes that happen across systems to enforce process
  • happen as a result of changes, including the changes invoked by this process
  • enable us to see when process flows overlap and potentially conflict with each other

Data flows let you drill down through the abstraction of the flow chart and use the actual data relationships and to demonstrate the changes that cause data to update across related objects to the current data flow. Because we model the simultaneous changes going on, it’s possible to understand the impact of the process flow and when and how it will be applied to the end state of the data.

The same process described as a data flow

How do we move from talking about process flows to talking about data flows?

For our example of lead to account matching, it’s not that much different than the original flow. The main difference is the chain of events that results from the original decision.

When we create the lead, the following happens:

  1. We look up the lead, see if we have a duplicate based on criteria, and merge if the criteria is met based on the rule for all leads
  2. If there is no duplicate contact, we look for an existing contact, and if we find one append data based on the rules for all contacts
  3. If there is no duplicate contact, we start a lookup for an existing company and attach the new contact if found
  4. If no company found, we check the criteria for all companies and check whether we need to create a new company
  5. If that criteria is met, we create a new company, create a new contact, and associate that contact with the company
  6. If not, we put that lead in a longer-term nurture flow

What’s happening? Each decision point in the flow chart corresponds to action in a continuous data flow like this one:

The Lead to Account process shown in simultaneous “swim lanes” of a data flow
The Lead to Account process shown in simultaneous “swim lanes” of a data flow

The swim lanes in the diagram above represent three simultaneous processes (and there are more executing at the field level for each of these objects, but you get the idea). Every cycle, each of the object data flows detect changes. When they see a change they execute actions in their pipeline by comparing the values to previously known values.

The basic flow we started with doesn’t show this complexity and tell you what’s really going on. To create the instructions for the input and output of the workflow, you need to define:

  • the actual data changes?-?what data moves from one object to another
  • resulting creates or deletes?-?how to create fields, combine information, and resolve conflicts
  • entry and exit points?-?defining the triggers to start and end data changes

Defining the data flows gives you the true picture of the movement for data inside your system. When is this really valuable? When you add the second flow that touches the same object. Flow charts fail to note any potential conflicts, while data flows are expressly designed to define and resolve these issues.

What’s the takeaway??When you’re building a process, go beyond the basic boxes and arrows and create data flows to demonstrate desired data changes, the way you will resolve those changes, and note the data field triggers that start and end a process. Data flows future-proof your organization for integration and help you diagnose issues faster.

Abhay Mene

Leadership in Data, Analytics and AI for Digital Transformation | Lifelong Learner

1 年

Nicely written! This article makes a lot of sense. Completely agree with the central idea of integrating data capture with process steps. However, we need both - a process flow that resonates with a general audience to ensure common understanding of current state (which should not be assumed) and also because not all are concerned with data, and another one as outlined in this article to explain how data is collected and transformed. #processengineering #dataanalytics #datadiscovery #workflows

Sarah Silva

Experienced Business Analyst | Human-first | Certified Business Process Management Professional | Six Sigma Green Belt | Customer Advocate | Wonder Woman

2 年

I love building processes flows for my stakeholders using a human- first approach and watch their eyes light up. People, process, technology and data should be captured in the workflow. The best ones tell a story.

J.T. Sweeney

Solutions Leader @ Docusign -- Putting AI pen to Enterprise paper

2 年

There's approximately 6 things I can really recollect/still use from college, but understanding how to create ERDs, multi-level Process Flows, and data swimlane charts is a big one. This post is a phenomenal example of how important it is to know your audience and what they need in a process flow ??

要查看或添加评论,请登录

Greg Meyer的更多文章

  • "The API of Me" in the age of AI

    "The API of Me" in the age of AI

    Our computing ability intersects with our own personal dataset to create new and differentiated solutions with AI at…

    2 条评论
  • Create a pacing graph with Google Sheets

    Create a pacing graph with Google Sheets

    As an operator, how many times do you get asked: “how are we doing this month vs last month? (Or vs. some previous…

  • In support of "boring" software

    In support of "boring" software

    I am an unabashed technology fan and an early adopter of new things. As a kid, I loved (and still love) science fiction…

  • 5 ways to make your low-code automation more effective

    5 ways to make your low-code automation more effective

    When I started my first software job, I remember thinking two things: I am definitely not the smartest person in the…

    2 条评论
  • Turning daily improvements into milestones

    Turning daily improvements into milestones

    You’ve seen the statistic. 1% improvements daily for a year yield a 37x return.

    2 条评论
  • Building Diagrams with Computers

    Building Diagrams with Computers

    Ethan Mollick writes about AI that “the only way to figure out how useful AI might be is to use it.” This is not…

    2 条评论
  • Redefining the Customer Journey

    Redefining the Customer Journey

    Have you ever played RevOps detective? ??? The story goes something like this. There’s a closed-won (or a closed-loss)…

  • Going from 0-1 in Data Operations

    Going from 0-1 in Data Operations

    Imagine you are starting a new venture and need to describe all the data tasks that need to happen to get you from…

  • An ode to console.log()

    An ode to console.log()

    Some of the first programs I ever wrote on a computer used PRINT to echo a line to the screen. Using BASIC, I filled…

    1 条评论
  • Great performance demands mental preparation

    Great performance demands mental preparation

    The coach will see you now When I was younger I wanted to be a professional baseball player. Professional baseball…

    2 条评论

社区洞察

其他会员也浏览了