Semantic Awareness for Automatic Image Interpretation

Abstract

Finding relations between image semantics and image characteristics is a problem of long standing in computer vision, image analysis or related fields. Classic research in these fields is intended for applications that go from the image domain to the semantic domain such as face recognition or scene understanding. This thesis explores methods and applications that go the opposite direction, i.e. use existing semantic information to infer knowledge and actions in the image domain. We build a large scale statistical framework to relate image characteristics to semantic expressions for millions of images and thousands of keywords. We apply the framework to semantic image enehancement and automatic color naming.