Skip to content
Have an account?
Login
or
Register
  • About
    • People
    • Fellows
    • Tastings
    • In the News
    • Awards
      • Christophe Baron Prize
      • AAWE Scholarships
      • AAWE Awards of Merits
    • Downloads
    • Contacts & Copyright
  • Journal
    • Online Journal Member Access
    • Online Journal Library Access
    • Editors
    • JWE – All Issues
    • Submission Guidelines
  • Working Papers
  • Meetings
    • 2023 Stellenbosch
    • 2022 Tbilisi
    • 2019 Vienna
    • 2018 Ithaca
    • 2017 Padua
    • 2016 Bordeaux
    • 2015 Mendoza
    • 2014 Walla Walla
    • 2013 Stellenbosch
    • 2012 Princeton
    • 2011 Bolzano
    • 2010 Davis
    • 2009 Reims
    • 2008 Portland
    • 2007 Trier
  • Membership
Menu
  • About
    • People
    • Fellows
    • Tastings
    • In the News
    • Awards
      • Christophe Baron Prize
      • AAWE Scholarships
      • AAWE Awards of Merits
    • Downloads
    • Contacts & Copyright
  • Journal
    • Online Journal Member Access
    • Online Journal Library Access
    • Editors
    • JWE – All Issues
    • Submission Guidelines
  • Working Papers
  • Meetings
    • 2023 Stellenbosch
    • 2022 Tbilisi
    • 2019 Vienna
    • 2018 Ithaca
    • 2017 Padua
    • 2016 Bordeaux
    • 2015 Mendoza
    • 2014 Walla Walla
    • 2013 Stellenbosch
    • 2012 Princeton
    • 2011 Bolzano
    • 2010 Davis
    • 2009 Reims
    • 2008 Portland
    • 2007 Trier
  • Membership
DONATE
  • Data
  • Jobs & Programs
  • Data
  • Jobs & Programs
Home
»
JWE-Articles
»
Journal of Wine Economics Volume 15 | 2020 | No. 4 | Selected Proceedings
»
Rate the Raters: A Note on Wine Judge Consistency

Rate the Raters: A Note on Wine Judge Consistency

Jeffrey Bodington
JEL Clasification: A10, C00, C10, C12, D12
Pages: 363-369
Abstract

Much literature shows that the ratings assigned by wine judges are uncertain, some authors have proposed that judges be tested, and a few wine competitions do test judges. However, no literature or competition has yet proposed a test or rating for judges based on realistic competition conditions. This article uses coefficients of multiple correlation to rate each of 54 judges who assigned ratings to 2,811 wines entered in a commercial competition. Results show that there is a strong and positive correlation between the ratings assigned by most judges to most wines. However, those correlations also show that the ratings assigned by approximately 10% of judges are indistinguishable from random assignments. Using correlations to rate the raters, a program is underway to monitor those judges and variations in competition protocol that may affect their ratings.

Subscribe to our Email List

You can cancel your subscription at any time.
SUBSCRIBE HERE

Contact

AAWE
Economics Department
New York University
19 W. 4th Street, 6FL
New York, NY 10012, U.S.A.
Tel: (212) 992-8083
Fax: (212) 995-4186
E-Mail: karl.storchmann@nyu.edu

AAWE

Journal

Working Papers as a List

Membership

Videos

LINKS

Fifthsense

JWE at Cambridge University Press

Liquid Assets

Stuart Pigott

Privacy & Cookies Policy

Privacy Policy

Cookies Policy

Twitter Facebook-f Youtube

© AAWE 2021 - All rights reserved