Systems, devices and methods for performing low memory access candidate-based decoder-side motion vector determination (DMVD) are described. The number of candidate motion vectors (MVs) searched may be confined by limiting the range of pixels associated with candidate MVs to a pre-defined window. Reference windows may then be loaded into memory only once for both DMVD and motion compensation (MC) processing. Reference window size may be adapted to different PU sizes. Further, various schemes are described for determining reference window positions.