The Future Of Data and Analysis
Monday, October 29th, 2007Technology is really about information, and our ability to interact and store information has been making some major changes for the past several decades.
Those of us who are researchers have been blessed in the past several years with an explosion of available information for examining nearly every topic we want to look at.
But at the same time, there has been a shift away from objective analysis toward studies completed by organizations with a vested interest in the outcome.
This has resulted, as noted at Overcoming Bias, in a crisis of faith in the use of statistics. No one believes any numbers that are released because they figure that the people who did the analysis have a hidden agenda. This is the most demoralizing aspect of being an analyst.
The problem is essentially that the analysis process is still closed. We don’t trust the numbers because we don’t know the process that went into obtaining them. Until the process of analysis is opened to a public that can understand and take part in a dialog about the methods, we can continue to write analytical work off as a waste of money and resources because someone else will always have a study saying the opposite.
We need the democratization of data analysis.
And I have high hopes for the future. One of my ideas has been to create an online data warehouse and analysis website, and a few groups such as Swivel and Many Eyes are doing just that.
The services are still fledgling, but in a fairly short time I think we’ll see the ability to perform analysis via the web, and to upload and share data. Hopefully this will result in the standardization of data sets and eliminate the monkey work of downloading a text file and formating it in excel.
I cry when I think how many people have done the very same thing with the very same data.
For a time there will be a lot of confusion, attacks, and some really bad work, but ultimately a community of devoted analysts performing essentially open and peer reviewed work will develop. Because it’s been through trial by fire from all sides of the issue, it will be the most objective approach to messy data analysis that we have ever obtained.
The new analytical hotshots will be the people who have weight with communities at Swivel and Many Eyes and others and are known for doing quality work. These people will engage in very public analysis and will be extremely valuable to everyone wanting analysis that can be seen as objective.
Hopefully that means that shoddy and lazy work will slip to the sides and we can regain confidence in numbers that we see.
I guess it could go the other way. That people don’t want objective analysis and we’ll shun those whose results we can’t know ahead of time. We’ll see even more extreme partisanship.
But that way lies certain death.
-zot, pretending to be a futurist.
Support The Decision Strategist.Popularity: 26%







