Using biennial data from the Health and Retirement Study, we estimate age-dependent health dynamics and survival probabilities at annual frequency conditional on race, sex, self-reported health and other covariates. The estimates can be used to calculate heterogeneous life expectancies in the population. We show that the racial life expectancy gap remains large, even conditional on health, socioeconomic and marital status. Due to racial differences in health dynamics and mortality, married black men on average can expect to receive $6,400 (or 8%) less in Social Security benefits in present value terms. Using a rich life cycle model, we estimate that this corresponds to a welfare loss of about 4%, whereas black married women’s welfare loss is primarily driven not by their own shorter life expectancy but the shorter life expectancy of their husbands.