This study investigates the extent to which individuals see themselves as being handicapped by a hearing disability. Self-reports were obtained with the Amsterdam Inventory for Auditory Disability and Handicap which distinguishes five basic disabilities: intelligibility in noise, intelligibility in quiet, localization of sounds, distinction of sounds and detection of sounds. Responses of 239 hearing-impaired people with varying types of hearing loss have been examined. The occurrence of the five disabilities in the population as well as the self-reported limiting and annoying effect per disability has been examined. This study shows that the handicapping effects of the disabilities do not have equal weights. Handicap resulting from the inability to understand speech in noise is most strongly felt. This paper argues that the type of disability jointly determines the severity of a person's handicap.