Timezone: »

 
Spotlight
Learning Visual Attributes
Vittorio Ferrari · Andrew Zisserman

Wed Dec 05 03:20 PM -- 03:30 PM (PST) @
in Spotlights »

We present a probabilistic generative model of visual attributes, together with an efficient learning algorithm. Attributes are visual qualities of objects, such as red',striped', or `spotted'. The model sees attributes as patterns of image segments, repeatedly sharing some characteristic properties. These can be any combination of appearance, shape, or the layout of segments within the pattern. Moreover, attributes with general appearance are taken into account, such as the pattern of alternation of {\em any} two colors which is characteristic for stripes. To enable learning from unsegmented training images, the model is learnt discriminatively, by optimizing a likelihood ratio. As demonstrated in the experimental evaluation, our model can learn in a weakly supervised setting and encompasses a broad range of attributes. We show that attributes can be learnt starting from a text query to Google image search, and can then be used to recognize the attribute and determine its spatial extent in novel real-world images.

Author Information

Vittorio Ferrari (University of Edinburgh)
Andrew Zisserman (DeepMind & University of Oxford)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors