A highlight mask is generated for an image to identify one or more highlights in the image. One or more highlight classifiers are determined for the one or more highlights in the image. One or more highlight gains are applied with the highlight mask to luminance amplitudes of pixels in the one or more highlights in the image to generate a scaled image. The one or more highlight gains for the one or more highlights are determined based at least in part on the one or more highlight classifiers determined for the one or more highlights.
