How entries are judged?
The internationally influential jury panel composed of established scholars, prominent press members, creative design professionals and experienced entrepreneurs votes all entries. Each entry is given a score between 0 to 100 by each jury member voting on them, jury members are also allowed to cast negative votes for issues relating to entry guidelines or intellectual property rights. Before final score calculation, raw evaluation scores are weighted based on evaluation criteria, the expertise of jury members, and classification of jury members to arrive at weighted scores. For each category, standard deviation is calculated and gauss error function is used during conversion of the calculated normal distribution to approximated cumulative standard normal distribution within range of 0 to 100. Award status depends on the calculated z-score as long as the threshold for minimum raw score requirement for each category is met.
When does Judging Take Place?
There are multiple judging periods, entries that were nominated until the late entry deadline are judged between March 7 and March 15, the most majority of entries are judged between this period therefore this is the date when we expect jury members to be voting. Furthermore, there are two extension periods called Last Entry and Omega Entry. Last entry nominations are judged between April 1 to 7. Omega Entries are judged between April 8 to 15, however during these periods, not all categories are judged any most jury members will actually not be required to vote. Furthermore, it is possible for some participants to requests Express Evaluation and when this happens only the relevant jury members are contacted.
Preliminary Scores
The Jury members who are evaluating your entries, do not see your preliminary scores when voting; this is to ensure that entries are voted fairly without anchoring effects. Therefore, it is possible to have a higher or lower award status when compared to your your initialPreliminary score. To ensure your entry is judged on par with all other entries, we recommend you make use of the presentation guidelines as well as the advanced submission optimizer.
Voting System
Each design is voted several times with three different Jury, and votes of Focus Group, Academic and Professional Jury members are weighted at the end to finalize the score.
Focus Group & Press |
Score Weight |
#Questions |
Global Weight |
Design |
30 |
6 |
35% |
Functionality |
15 |
3 |
15% |
Usability |
10 |
2 |
35% |
Ergonomics |
10 |
2 |
15% |
Engineering |
10 |
2 |
15% |
Presentation |
5 |
1 |
50% |
Innovation |
5 |
1 |
15% |
Technology |
5 |
1 |
15% |
Fun Details |
5 |
1 |
50% |
Market Value |
5 |
1 |
25% |
Specific |
5 |
1 |
15% |
Academic &
Entrepreneurs |
Score Weight |
#Questions |
Global Weight |
Design |
30 |
6 |
50% |
Functionality |
15 |
3 |
35% |
Usability |
10 |
2 |
15% |
Ergonomics |
10 |
2 |
50% |
Engineering |
10 |
2 |
50% |
Presentation |
5 |
1 |
35% |
Innovation |
5 |
1 |
50% |
Technology |
5 |
1 |
35% |
Fun Details |
5 |
1 |
15% |
Market Value |
5 |
1 |
25% |
Specific |
5 |
1 |
35% |
Design
Professionals |
Score Weight |
#Questions |
Global Weight |
Design |
30 |
6 |
35% |
Functionality |
15 |
3 |
50% |
Usability |
10 |
2 |
50% |
Ergonomics |
10 |
2 |
35% |
Engineering |
10 |
2 |
35% |
Presentation |
5 |
1 |
15% |
Innovation |
5 |
1 |
35% |
Technology |
5 |
1 |
50% |
Fun Details |
5 |
1 |
35% |
Market Value |
5 |
1 |
50% |
Specific |
5 |
1 |
50% |
|