A motion prediction or compensation method in video encoding, comprises acquiring a collection of candidate motion vectors; conducting a refined search for the optimal motion vector on the basis of the information about the collection of candidate motion vectors; performing motion prediction or compensation using the motion vector obtained from the refined search. Encoding functions are enhanced, and reasonable complexity is maintained.