What does Mixpanel think about adding statistical significance where appropriate? Take the Fbconnect and nonFbconnect users vs song engagement in the video. The chap in the video was fairly certain there was no significant increase, but visually it looks as if there in fact was have a slight, but significant difference between the two patterns of engagement. Impossible to tell without some sort of statistical analysis. There are probably lots of cases like these if your offering is fundamentally sound.
If I was the guy that championed and implemented FBConnect in my app and one of my co-founders thought that based on that graph there was no significant difference I'd be pretty pissed off.
What a bamboozlingly humongous number! So I tried to figure out what it might mean in concrete terms. Assuming an "action" is some tuple of (32bit timestamp, 32bit customer_id, 32bit user_id, 32bit action_type_id, and say, 64bits for some custom value associated with the action)..
If I was the guy that championed and implemented FBConnect in my app and one of my co-founders thought that based on that graph there was no significant difference I'd be pretty pissed off.