A block encoder comprises first block generating means for constituting a three-dimensional large-size block, and a plurality of second block generating means for dividing the large size block into small size blocks. The small size blocks of two dimensions and three dimensions are changed over adaptively in dependence on image information.
