Google's way to crowdsourcing.

I spend too much time in the evenings judging ADC2. My motivation is simple: I was a participant in ADC1 and it's interesting what kind of apps have ppl developed now for ADC2, and I know few ppl who submitted apps for ADC2.

Google had invented a nice way to prevent judging fraud. I think there are a bit less then 2000 apps, like on ADC1. The judging application just picks apps to judge randomly! No other complex measures! But with large database of entries it works.

It takes at least 5 minutes to judge an application on average. So judging all apps would take around 200 work hours or 5 work weeks. And they tell that judging app stays online for about 2 weeks. 200 hours is too much time for a malicious judge to rate his own up 20 stars and competitor apps 4 stars more then once. And there is still a small chance that the application will not appear even after 200 hours :). But there is also a noticable chance (related to birthday paradox) that the application will appear twice during this 200 hours :)

So great job done Google!