THE AWARD
CATEGORIES
REGISTRATION
SUBMIT YOUR WORK
ENTRY INSTRUCTIONS
TERMS & CONDITIONS
PUBLICATIONS
DATES & FEES
METHODOLOGY
CONTACT
WINNERS
PRESS ROOM
GET INVOLVED
DESIGN PRIZE
DESIGN STORE
 
THE AWARD | JURY | CATEGORIES | REGISTRATION | PRESS | WINNERS | PUBLICATIONS | ENTRY INSTRUCTIONS

FAQ Entry #504

Home > Support > Frequently Asked Questions > 504

This is a respond to a previously asked question about the A' Design Award and Competition. The full list of frequently asked questions can be accessed here.

#504: For the very same design, with the very same images, and within the very same competition category, I got totally two different preliminary scores when I submitted from different accounts. How and why this happen?

This happens rarely in cases when your design is most likely voted by different preliminary jurors and different people have different ideas, and in rare cases, a person could have a different idea in a different time, or even the same day; psychological studies have shown that, even a lunch break, or time of the day, could have a significant effect on decision mechanisms. Under normal conditions, each design is randomly assigned to a specific preliminary jury member, we usually prefer to have the same jury member to check the same work whenever you update it, this provides a level of consistency; i.e. your design would initially be assigned to a random preliminary jury member, and get a score, and later if you made an improvement to your design, the same preliminary jury member, who gave you the first score, would could check it once again and provide you with an update, however in some cases, the same jury member is not available so your work might get voted by another jury member, likewise, and especially if you created another account and submitted the very same design, this very same design will most likely be assigned to a totally different jury member, a different person, with different preferences, different taste, in this case, the preliminary score you get could be significantly different (could be lower or higher or maybe it could be the same) from the score you get from another jury member. Why? Because different jurors have different opinions on how good a design is, and some jurors assign higher scores always, while some jurors assign lowest scores always; this is due to personal biases; some people are picky, and others are more liking. In any case, if you receive contradictory scores, you might take the average of such scores, as a point of consideration. In the end, you should remember that the preliminary scores are not binding, furthermore the preliminary scores will not be visible to the grand jury during voting, and your preliminary score will not have any effect on your design evaluation or ranking; only the grand jury votes and scores will be relevant. Indeed, we eliminate individual biases, such as the one you experienced (different preliminary scores from different people) during grand jury voting; we do not consider the absolute scores of individuals; the preliminary score is an absolute score assigned by one individual, but the final jury ranking is based on relative scores of many individuals, final score and voting is based on standard deviations of individuals; let us explain this further; if your design is voted by a jury member (juror A), who on average gave everyone a 2 out of 10; and then gave your work a score of 3 (absolute score is 3), that 3 score is actually positive vote (relatively), you get good score from juror A, even though it seems low in absolute terms, it is relatively high for the juror A herself; on the other hand, if your design is voted by another jury member (juror B), who on gave average everyone an 8 out of 10, a 7 (absolute score) by that jury member B, is a negative vote (relatively), a vote of 7 by Juror B is negative in relative terms. If only absolute scores were considered, your design would not be fairly judged, in the final voting, we consider relative scores. That's why a big jury is important, having a big jury helps us eliminate personal biases, and focus on real preferences. Please do not fixate on the preliminary juror's scores so much, they can be biased and we remove such bias during grand jury voting by considering relative meanings of scores instead of absolute numbers. For further details please check methodology section.

Keywords: preliminary score, score issue, preliminary check, deviation in preliminary score, preliminary score difference, difference in preliminary score, preliminary checks, preliminary evaluation.


The following questions could be related:

If you did not find your answer, please feel free to check the faq pages for more questions and answers. You will also want to check our webpage for details; thanks to our transparency policy, we document and publish everything.

 
design award logo

BENEFITS
THE DESIGN PRIZE
WINNERS SERVICES
PR CAMPAIGN
PRESS RELEASE
MEDIA CAMPAIGNS
AWARD TROPHY
AWARD CERTIFICATE
AWARD WINNER LOGO
PRIME DESIGN MARK
BUY & SELL DESIGN
DESIGN BUSINESS NETWORK
AWARD SUPPLEMENT

METHODOLOGY
DESIGN AWARD JURY
PRELIMINARY SCORE
VOTING SYSTEM
EVALUATION CRITERIA
METHODOLOGY
BENEFITS FOR WINNERS
PRIVACY POLICY
ELIGIBILITY
FEEDBACK
WINNERS' MANUAL
PROOF OF CREATION
WINNER KIT CONTENTS
FAIR JUDGING
AWARD YEARBOOK
AWARD GALA NIGHT
AWARD EXHIBITION

MAKING AN ENTRY
ENTRY INSTRUCTIONS
REGISTRATION
ALL CATEGORIES

FEES & DATES
FURTHER FEES POLICY
MAKING A PAYMENT
PAYMENT METHODS
DATES & FEES

TRENDS & REPORTS
DESIGN TRENDS
DESIGNER REPORTS
DESIGNER PROFILES
DESIGN INTERVIEWS

ABOUT
THE AWARD
AWARD IN NUMBERS
HOMEPAGE
AWARD WINNING DESIGNS
DESIGNER OF THE YEAR
MUSEUM OF DESIGN
PRIME CLUBS
SITEMAP
RESOURCE

RANKINGS
DESIGNER RANKINGS
WORLD DESIGN RANKINGS
DESIGN CLASSIFICATIONS
POPULAR DESIGNERS

CORPORATE
GET INVOLVED
SPONSOR AN AWARD
BENEFITS FOR SPONSORS

PRESS
DOWNLOADS
PRESS-KITS
PRESS PORTAL
LIST OF WINNERS
PUBLICATIONS
RANKINGS
CALL FOR ENTRIES
RESULTS ANNOUNCEMENT

CONTACT US
CONTACT US
GET SUPPORT

Follow us : Twitter Twitter | Twitter Facebook | Twitter Google+.
Share |