An automatic object image follow-up device includes a setting circuit for shiftably setting a follow-up field; an extracting circuit for extracting a feature of an object in relation to the follow-up field; a store for storing the extracted feature; a detecting circuit for detecting a relative shift between the object and the device on the basis of the feature of the object extracted by the extracting circuit and the feature stored by the store; and a shifting circuit for shifting the follow-up field following up the object according to the relative shift.