In this paper we estimate how a variety of subjective measures of quality taken from the pub- lished opinions of several experts on Italian wines (Barolo and Barbaresco) are determined by the weather conditions during the relevant season, in order to assess their reliability. Since these measures of quality are only ordinal, we estimate their determinants using an ordered probit model. The method provides measures of the determinants of vintage quality ratings and suggestions on the reliability of each expert.