The Hidden Biases in Big Data
Harvard Business Review |
This looks to be the year that we reach peak big data hype. From wildly popular big data conferences (opens in new tab) to columns in major newspapers (opens in new tab), the business and science worlds are focused on how large datasets can give insight on previously intractable challenges. The hype becomes problematic when it leads to what I call “data fundamentalism,” the notion that correlation always indicates causation, and that massive data sets and predictive analytics always reflect objective truth. Former Wired editor-in-chief Chris Anderson embraced this idea (opens in new tab) in his comment, “with enough data, the numbers speak for themselves.” But can big data really deliver on that promise? Can numbers actually speak for themselves?