A method and system for providing adaptive media optimization are described. Aspects of the invention modify video encoding and network transmission settings to optimize the user viewing experience. The system and method sample video content (102) to determine various content features (502) of the video. The system and method use the identified content features in conjunction with network statistics to modify (510) encoding settings and network transmission options to ensure a minimum of interruption in the transmitted video. Previously generated lookup tables (122) ensure efficient mapping of video content and network conditions to encoding and transmission settings.