44 messages in com.googlegroups.android-challenge[android-challenge] Re: 1,788 entries
FromSent OnAttachments
jalopy17 Apr 2008 23:00 
Muthu Ramadoss17 Apr 2008 23:05 
freeanderson17 Apr 2008 23:41 
jim.renkel18 Apr 2008 05:09 
Peli18 Apr 2008 05:10 
tomgibara18 Apr 2008 05:14 
vetch18 Apr 2008 06:03 
Peli18 Apr 2008 06:16 
viktor18 Apr 2008 06:41 
ddm18 Apr 2008 06:42 
wataru18 Apr 2008 07:12 
Alex Pisarev18 Apr 2008 07:14 
Living Sword18 Apr 2008 07:38 
Dan Morrill18 Apr 2008 08:08 
Dan Morrill18 Apr 2008 08:14 
David Moffett18 Apr 2008 08:15 
viktor18 Apr 2008 08:28 
efon...@gmail.com18 Apr 2008 08:54 
Peli18 Apr 2008 08:55 
Izard18 Apr 2008 08:59 
Peli18 Apr 2008 09:07 
efon...@gmail.com18 Apr 2008 09:52 
Incognito18 Apr 2008 10:03 
Incognito18 Apr 2008 10:36 
Peli18 Apr 2008 10:49 
Hielko18 Apr 2008 10:54 
Peli18 Apr 2008 11:01 
Peli18 Apr 2008 11:04 
Incognito18 Apr 2008 11:11 
Incognito18 Apr 2008 11:13 
Incognito18 Apr 2008 11:17 
efon...@gmail.com18 Apr 2008 11:22 
Cow Bay18 Apr 2008 11:28 
David Moffett18 Apr 2008 11:51 
Greg_G18 Apr 2008 12:06 
Cow Bay18 Apr 2008 12:07 
Cow Bay18 Apr 2008 12:13 
Cow Bay18 Apr 2008 12:23 
jalopy18 Apr 2008 12:51 
Alex Pisarev18 Apr 2008 12:51 
efon...@gmail.com18 Apr 2008 14:12 
Anil18 Apr 2008 15:27 
Dan Morrill19 Apr 2008 15:09 
efon...@gmail.com19 Apr 2008 16:18 
Subject:[android-challenge] Re: 1,788 entries
From:Anil (anil@gmail.com)
Date:04/18/2008 03:27:04 PM
List:com.googlegroups.android-challenge

On Apr 18, 10:14 am, "Dan Morrill" <morr@google.com> wrote:

This is correct. We're providing rather detailed judging guidelines intended to help judges calibrate their scores. We also plan to post-process the results looking for outliers (such as cases where one judge gave a score that varies significantly from the others') to help make sure the results are fair.

Panel size will be at least 3, depending on how many judges we have; currently the panel size is expected to be 4.

- Dan

On Fri, Apr 18, 2008 at 7:38 AM, Living Sword <livi@gmail.com> wrote:

i dont think apps will be judged relatively. Each app will have its own scores based on the 4 criteria. Then apps with highest scores will move on.

On Apr 18, 6:42 pm, viktor <vikt@gmail.com> wrote:

I hope that each submission will be valuated by a panel of judges, not an individual judge:http://code.google.com/android/adc_judging.html

To be objective, a panel must consist of at least 3 judges.

Let's assume that each of 100 judges receives 17.8 submissions. A judge will score an app relatively to other apps in the same "bucket". In most cases, this will lead to one app from a bucket that makes into the first 100. Apps are randomly packed into buckets. This may result in "strong" (several good apps) and "weak" (no good apps) buckets. A second app in a strong bucket can be significantly better than the best app in a weak bucket. But this second app may not make the first 100 if buckets are reviewed by individual judges because cross-bucket judging will not be executed.

So, larger buckets lead to fairer judging.

Dan Morrill, please let us know the size of a bucket when you have a free moment.

- Show quoted text -