Value Stream Mapping (VSM) is a powerful tool for organizations looking to improve their efficiency and customer satisfaction by identifying and eliminating waste in their processes. It is a visual representation of the flow of materials and information required to bring a product or service from ideation to business value. VSM helps teams to identify and eliminate bottlenecks in their processes.
This article is the first in a series in which I will go over how to apply VSM for your digital product, with some examples.
Take any business where time is money in a true sense, for example, trading stocks and options. Imagine building a trading platform where latency is measured in milliseconds and nanoseconds. When working within such tight constraints, you need to consider everything from the API language and technology of choice, to every algorithm you are running, the operating system where the API will be running, the location of the server(s), length of the fiber optic cables, etc. In such an environment, how do you find waste? Applying VSM lessons at a different scale would help you find and eliminate waste (or memory leaks) just like in physical products.
Local optimizations that might make sense to one team sometimes don’t create systemic improvements. Sometimes, the current process exists because the highest-paid person in the room feels strongly that it’s the right thing to do, the HiPPO (Highest Paid Person’s Opinion) Process. In these scenarios the order comes from the “top” and teams might feel it’s “above their pay grade” to question it. The orders often come with a drop dead date attached to them and the teams need to deliver or else… often without considering the team’s skills and other priorities.
Rushing to pick something and get started without the understanding gained by VSM sessions could lead to disappointment, a failed mission, money and time loss, loss of trust in management, burnout, layoffs, etc. Instead of the HiPPO pathology, spend a couple of days laying out the high-level VSM of a product family or the process you need to improve on. If you are new to the team, just ask the team members about the product they are building:
- What data do you consume?
- Where is the data you are consuming originating from?
- Which team(s) are you dependent on?
- What data do you produce?
- Who consumes your data?
- Which team(s) depend on you?
The process of VSM begins by mapping the current state of the value stream, which includes all activities required to design, produce, and deliver a product or service. It is important to understand the current state in order to identify areas where waste is present. Take the trading platform for example. At a high level, you need to:
- Read the market data
- Enable alerting so that the user can set up customized alerts on a ticker, etc.
- Analyze incoming market data against user alerts
- Create and send user notifications
- Enable users to place a trade
Let’s say you want to improve or change your Notifications service. In this case, start from the Notification service. Find the services that provide data to Notification as well as those that are dependent on it. For example:
- Alerting service
- Notification service itself:
Once the current state is understood, teams can identify areas where waste is present, such as excess inventory, unnecessary steps, or delays. Once these areas of waste have been identified, the next step is to create a future state map that eliminates the waste thereby improving the flow of materials and information. By implementing the future state, organizations can reduce lead times, increase efficiency, and improve overall customer satisfaction.
When building a VSM for products in which latency is paramount, such as our trading system:
- Start by logging and benchmarking
- Use visualization tools i.e. Datadog, Grafana, Prometheus, etc. to observe the data at every stage of the process
- Verify that the metrics are correct
- Understand what’s the norm, what falls into the 99 and 99.99 percentile
- Diversify: this could be considering how the data change:
- During a special time of the year
- Time of the day
- Certain location
- News events
- Look for patterns
You might think the steps above take more than just a few days and you are right, but you can get started in 2-3 sprints. If you don’t have this information, you won’t be able to have evidence of where the waste is happening. It’s going to be a long journey from inception to a culture of continuous learning. Start now, start small. Do you know the dependencies of something you or your team own? Do you know who is a consumer of your assets? Start there, then ask adjacent teams to do the same.
Implementing VSM can be challenging, but the benefits are well worth it. By identifying and eliminating waste in your processes, you can reduce lead times, increase efficiency, and improve overall customer and stakeholders’ satisfaction. Value Stream Mapping is not a one-time process. Feedback loops and responding to data are important to keep a product up-to-date. Once you have the first VSM created, make it easy for the team to maintain it. The best way for this is to assign a person to always take the responsibility to ensure the map reflects accurate, up-to-date information.
In Part II of this series, I’ll cover a value stream map for a trading platform.