39 messages in com.googlegroups.android-challenge[android-challenge] Re: Update on pro...
FromSent OnAttachments
Justin (Google Employee)14 May 2008 16:08 
Hielko14 May 2008 16:09 
Finn Kennedy14 May 2008 16:16 
Michael Johnston14 May 2008 16:31 
javqui14 May 2008 16:57 
PowerGUI14 May 2008 17:03 
Free Tibet14 May 2008 17:29 
javqui14 May 2008 18:37 
GodsMoon14 May 2008 19:49 
Yassine14 May 2008 21:59 
A&&Whole14 May 2008 23:26 
hitsu_g15 May 2008 00:09 
Ram15 May 2008 00:28 
Nixarn15 May 2008 01:18 
vetch15 May 2008 02:11 
george_c15 May 2008 02:27 
plusminus15 May 2008 03:23 
ryank15 May 2008 05:57 
gtandon15 May 2008 07:29 
ConAim15 May 2008 08:01 
Rui Martins15 May 2008 08:15 
jazz15 May 2008 08:23 
Rui Martins15 May 2008 08:26 
ajd15 May 2008 08:39 
Cow Bay15 May 2008 08:42 
ajd15 May 2008 08:54 
Cow Bay15 May 2008 08:54 
dr12315 May 2008 08:57 
Cow Bay15 May 2008 09:16 
Cow Bay15 May 2008 09:46 
ajd15 May 2008 10:41 
Colin Cochran15 May 2008 15:09 
Colin Cochran15 May 2008 15:12 
vinay15 May 2008 16:07 
blues15 May 2008 17:43 
hitsu_g15 May 2008 22:15 
eswar15 May 2008 22:58 
vetch16 May 2008 00:44 
efon...@gmail.com16 May 2008 03:45 
Subject:[android-challenge] Re: Update on providing Challenge scores and rankings
From:javqui (blic@gmail.com)
Date:05/14/2008 06:37:55 PM
List:com.googlegroups.android-challenge

Dear Justin

As humbleness suggestion, will be useful get a quartile rank for each judging criteria. Some participants get more rank in one criteria and less in other one. This suggestion will help us to optimized resources distribution for ADCII.

Thank you

Javier Quintana

On May 14, 7:31 pm, Michael Johnston <kine@gmail.com> wrote:

"Many applications received average scores that are within 0.1% of each other because of the number of submissions.  This means that providing an individual score to each participant does not provide meaningful information on the relative ranking of that submission."

This is interesting, and I agree, but it kind of casts doubt on the meaningfulness of the scoring system in general.  Nonetheless, the update and forthcoming release of quartile rankings are much appreciated.  Thanks.

On May 14, 4:08 pm, "Justin (Google Employee)" <j.@google.com> wrote:

Many people have been asking about receiving either their individual scores or a complete list of scores. We've discussed this extensively and have decided to release each submission's quartile rank through individual emails within the next few weeks.

Why quartile rankings? Well, we feel they provide more meaningful information about relative application rankings than just raw scores. We designed the judging process to identify 50 applications with the highest scores out of a large pool of excellent submissions. Many applications received average scores that are within 0.1% of each other because of the number of submissions. This means that providing an individual score to each participant does not provide meaningful information on the relative ranking of that submission.

Another request has been for textual feedback from judges. However, judges only provided scores for each application; they did not provide notes or any other comments.

That being said, the number of great applications far exceeds the top 50! We had many judges actually ask for contact information for developers from the entire pool of applications—and we're forwarding that information on to the judges for developers who opted-in.

We're excited by the massive response to the challenge and we can't wait to see more great applications for Android.

Regards, Jstin & the Android Developer Challenge Team @ Google- Hide quoted text -

- Show quoted text -