Shape-centered Representations: from Features to Applications (Mpi Series in Biological Cybernetics)

Computer vision aims to teach machines and algorithms to 'see' with the ultimate goal of creating 'intelligent' applications and devices that can provide assistance to humans in a wide array of scenarios. This thesis presents an investigation of computer vision on three layers: low-level features, mid-level representations and high-level applications. Each of the layers depends on the previous ones while also generating constraints and requirements for them. At the application layer human-machine interfaces come into play and link the human perception to computer vision. By studying all layers we can gain a much deeper insight into the interplay of different methods, than by examining an isolated problem. Furthermore, we are able to factor constraints imposed by different layers and the users into the design of the algorithms, instead of optimizing a single method based purely on algorithmic performance measures. After a brief introduction in Chapter 1, Chapter 2 addresses the feature layer and describes our novel shape-centered interest points that play a vital role throughout this thesis. These interest points are formed at location of high local symmetry as opposed to corner interest points which occur along the outline of shapes. Experiments show that they are very robust with respect to common natural image transformations, such as scaling, rotation and the introduction of noise and clutter. Based on these features Chapter 3 presents two strategies to build robust mid-level image representations. First, a novel feature grouping method is introduced. The scheme offers a powerful way to combine the advantages of shape-centered interest points, namely robustness and a tight connection to a unique shape, and corner-based interest points, namely strong descriptors. Furthermore, Chapter 3 introduces a novel set of medial feature superpixels, that represent a feed-forward way to divide the image into small, visually-ho