This is one area where I think Twitter is actually smart. Instead of analyzing the firehose, they sell the firehose to dozens of competing companies who pay for the privilege of mining it. Twitter gets monopoly profits and we get a market of competing analyses.