THE AWARD
CATEGORIES
REGISTRATION
SUBMIT YOUR WORK
ENTRY INSTRUCTIONS
TERMS & CONDITIONS
PUBLICATIONS
DATES & FEES
METHODOLOGY
CONTACT
WINNERS
PRESS ROOM
GET INVOLVED
DESIGN PRIZE
DESIGN STORE
 
THE AWARD | JURY | CATEGORIES | REGISTRATION | PRESS | WINNERS | PUBLICATIONS | ENTRY INSTRUCTIONS

Positive Presentation Bias

Home > Methodology > Evaluation Criteria > Positive Presentation Bias
This article explains how we deal with the "Positive Presentation Bias" phenomenon. Simply put, the positive presentation bias is an error in judgment of the jurors who vote higher for better presented designs.

Reducing Presentation Biases
The Positive Presentation Bias was discovered due to the statistical inconsistency in the jury scores of design submissions in the A’ Design Award & Competition: Normally, entries in A’ Design Award & Competition are voted against multiple evaluation criterion, one of the such criteria is the “Presentation Quality” with a relatively low weight on it. However, when a sample of 500 design submissions were analyzed in detail and re-voted analytically, it was discovered that jury members tend to give higher scores to designs whose visual representations were made better, regardless of the intrinsic properties of the design.

To remove the Positive Presentation Bias, A’ Design Award & Competition implemented several tools and approaches: 1. Uniform Submission System, 2. Uniform Jury Presentation System, 3. Preliminary Score and Feedbacks for Presentation, 4. Detailed Presentation Guidelines Book with Hints and Suggestions, 5. Submission Optimizer Software. 6. Showcasing Prior Winner Works, 7. Voting Guidelines for Jury Members.

The purpose of all the tools is to push the presentation quality of entries to a uniform, high level such that when jury members would vote on the submissions, the presentation of the entries would be less relevant because they would all be good, and therefore submissions could be judged more on their intrinsic qualities; thus the Positive Presentation Bias could be removed or reduced.

 
design award logo

BENEFITS
THE DESIGN PRIZE
WINNERS SERVICES
PR CAMPAIGN
PRESS RELEASE
MEDIA CAMPAIGNS
AWARD TROPHY
AWARD CERTIFICATE
AWARD WINNER LOGO
PRIME DESIGN MARK
BUY & SELL DESIGN
DESIGN BUSINESS NETWORK
AWARD SUPPLEMENT

METHODOLOGY
DESIGN AWARD JURY
PRELIMINARY SCORE
VOTING SYSTEM
EVALUATION CRITERIA
METHODOLOGY
BENEFITS FOR WINNERS
PRIVACY POLICY
ELIGIBILITY
FEEDBACK
WINNERS' MANUAL
PROOF OF CREATION
WINNER KIT CONTENTS
FAIR JUDGING
AWARD YEARBOOK
AWARD GALA NIGHT
AWARD EXHIBITION

MAKING AN ENTRY
ENTRY INSTRUCTIONS
REGISTRATION
ALL CATEGORIES

FEES & DATES
FURTHER FEES POLICY
MAKING A PAYMENT
PAYMENT METHODS
DATES & FEES

TRENDS & REPORTS
DESIGN TRENDS
DESIGNER REPORTS
DESIGNER PROFILES
DESIGN INTERVIEWS

ABOUT
THE AWARD
AWARD IN NUMBERS
HOMEPAGE
AWARD WINNING DESIGNS
DESIGNER OF THE YEAR
MUSEUM OF DESIGN
PRIME CLUBS
SITEMAP
RESOURCE

RANKINGS
DESIGNER RANKINGS
WORLD DESIGN RANKINGS
DESIGN CLASSIFICATIONS
POPULAR DESIGNERS

CORPORATE
GET INVOLVED
SPONSOR AN AWARD
BENEFITS FOR SPONSORS

PRESS
DOWNLOADS
PRESS-KITS
PRESS PORTAL
LIST OF WINNERS
PUBLICATIONS
RANKINGS
CALL FOR ENTRIES
RESULTS ANNOUNCEMENT

CONTACT US
CONTACT US
GET SUPPORT

Follow us : Twitter Twitter | Twitter Facebook | Twitter Google+.
Share |