Can Decision Systems Help Us Make Better Decisions?

October 5th, 2007

I started writing this as a response to a comment from James Taylor, author of Smart Enough Systems, on Snap Decision Making in Blink, but realized that it was getting long enough to be a post in it’s own right. Here is the comment from James:

One of the interesting areas I found when I reviewed Blink was that of how to apply these conclusions to automated decisions. How can one combine rules and analytics to make decisions more effectively. The importance of continuous learning or adaptive control is key as is the right balance of analytic insight and rule-based decisioning.

The concept of automation to circumvent decision making errors is interesting, but I don’t think it has arrived yet. It is a solution to a problem (from the companies perspective) of having to make repeated decisions in a given situation. Dealing with unsatisfied customers is a typical example. Do we refund, replace, ignore or send a letter of apology? The answer can be systematically determined based on several variables to find the maximum customer satisfaction for the lowest cost.The problem is that these systems remain inflexible. While reducing the cost of having a person decide what to do, they lose out on the subtle nuances that real people, with their years of experience interacting with other humans, can capitalize on.

It’s not a processing power problem, it’s a sensory problem. Any human has years of experience reading body, voice, and other situational cues that a computer faced with the same decision won’t have. We haven’t figured out quite yet how to give that same complexity to a decision algorithm.

Worse, customers hate them.

But can decision systems be used to correct biases and adjust for our mental shortcuts? Perhaps, but only if three things are true:

  1. Decision makers in the country use them.
  2. They are trained to explicitly avoid the same biases we encounter.
  3. They have access to the same information that the decision maker does.

2 is fairly easy. We develop an algorithm that involves explicitly calculating the value of each choice instead of taking the mental shortcuts that we use.

But 1 and 3 are much more difficult. I would wager that quite a bit of the success of a company is determined by the small and seemingly insignificant interactions and decisions. Are employees going to use the decision system for every small choice? It’s impossible and would probably be very detrimental. You can use it to make larger strategic and organizational decisions, but even then it’s more of an assistance to an executive, who takes the results of the decision system as one of many pieces of information and makes a decision from there.

Even if we could solve the problem of having a decision system process and weight all the subtle cues a human receives during the decision making process, we would still need to figure out a way to translate cues into data points and determine what each cue means. We don’t have to do this explicitly, but the decision system needs to know the cues and know what they mean. It also has to be able to pick up on new cues that develop as culture shifts. Adaptive learning may get us there eventually, but we aren’t there yet.

-zot

Support The Decision Strategist.

Popularity: 22%

Vote for this post on: These icons link to social bookmarking sites where readers can share and discover new web pages. Digg del.icio.us Furl Reddit StumbleUpon Technorati DZone

6 Responses to “Can Decision Systems Help Us Make Better Decisions?”

  1. Dave Dixon Says:

    I think there are some ways one could push the use of decision systems into the lower management levels. One is by making it easier to provide information. That’s partly technological, and partly training.

    The other is by making decision models an effective tool for communication. There’s at least two aspects to this. The first is having a common goal function. If two stakeholders have different goals, then they won’t be able to understand why the choices are being made by the other.

    The other key is making clear the interaction between information and optimal strategy. That means you need a consistent method for expressing the relationship between information and the goal.

    Here’s a blog post that discusses some of these issues:

    http://blog.provisdom.com/?p=7

  2. zot Says:

    Yes! I’ve had some ideas along these lines. The social aspect of decision making is very interesting. The other aspect from the employees point of view is how do i know that management is going to fairly represent my input? I know that I would be tempted to override what the decision system says if my gut feeling says differently. This could create problems with buy in from employees.

    In fact, this happened at work last week. We voted on carpet color, and picked one that most upper management didn’t like. They went with the popular choice, but they were stuck with a choice that they feel is not as good as it could be.

  3. Dave Dixon Says:

    I don’t think you ever should have to override the decision system. If the model strategy does not agree with your gut, you should find out why. Sometimes the model info is wrong, sometimes your get is wrong, and most often both need some adjustment.

    That’s why transparency is so important (several posts on this topic at our blog). If you can’t see what info goes in the model and understand how it impacts the decisions, you can never trust the model results. If you (and other employees) can see the information as well as test how changes to that information change the strategy, buy-in is much easier to achieve.

    We had a situation like this recently. Employees of a client were asked to rate the chances of success of a project. Significant time was wasted quibbling over percentage points. We were able to use a model of the project strategy to show that everybody’s input was essentially the same, in that it didn’t change the strategy. Emphasis was effectively shifted from personal goals (”I want to be right”) to the common goal of the company (”Do project strategy which maximizes shareholder value”).

  4. James Taylor Says:

    I blogged a response over on my ebizQ blog that I hope you will enjoy.
    JT

  5. Data. Knowledge. Wisdom. » Blog Archive » Can Decision Systems Help Us Make Better Decisions? Says:

    [...] at the Decision Strategist blog made an interesting post asking the question “Can Decision Systems Help Us Make Better Decisions?&#822…. Nick discussed several points, mostly centered around the idea that machines are relatively poor [...]

  6. Dave Dixon Says:

    I blogged further on the discussion at http://blog.provisdom.com/?p=18.

Leave a Reply