Tutorials on the Shape modelling toolbox

From BanghamLab
Revision as of 18:25, 20 February 2012 by AndrewBangham (talk | contribs)
Jump to navigation Jump to search

Back to AAMToolbox Documentation

The models shown in these tutorials illustrate features of the AAMToolbox software. They are not designed to understand the shape and appearance modelling which is better done from the published literature for example.
Viewing these pages. Some versions of Firefox and Explorer do not create satisfactory prints even though you can view the pages with no problems. Chrome does appear to produce good printouts.

Fives ways to use AAMToolbox

1) Analysing shapes. i.e. the arrangement of points around a shape

2) Viewing the data in shape space. i.e. approximating the data with two principle components

3) Comparing shapes from samples of different groups for example, comparing faces from different cartoon characters

4) Analysing shape and appearance. In addition to the points around a shape, analyse the appearance (grey scale or colour) within the shape.

5) Analysing 3D shapes

How to use these tutorials. First download and install the AAMToolbox. A zip file containing the project (PRJ_CartoonFaces) is available here. Download and unzip into a directory. Then, from Matlab, change directory into the project and launch the AAMToolbox

cd PRJ_CartoonFaces
AAMToolbox 

This project contains as set of faces that have been analysed using 2D shape models

1 How to analyse 2D shapes using the Graphical User Interface

The process of analysing a set of images is:-

  1. Create a new project. AAMToolbox project names are automatically prefaced with PRJ_. They have a particular directory structure and the images to be analysed need to be copied into the subdirectory called Cropped. It is best if they are all the same size.
  2. Create a point model template. Points are placed around the object of interest, i.e. around a face or leaf. The set of points constitute the point model. Every image will be marked up in the same way.
  3. To digitise each image, move the points to the corresponding positions in each image in turn. The positions must correspond to the same material points in each image, i.e. the tip of the leaf, the corner of an eye, or halfway along a line between the two ends of the mouth.
  4. Generate the shape model using principal component analysis (PCA)
  5. View the result by varying each important component in turn. We call this walking the shape model. This movie shows a walk.
  6. Simplify an image point model using principle components.
<wikiflv width="300" height="300" logo="false" loop="true" background="white">CartoonPC1.flv|CartoonPC1.png</wikiflv>

Mean shape (points) joined by lines. The movie shows deviations from the mean by varying the principle component.

2 Viewing the results in Shape-Space

  1. PCA allows us to view the statistical model from a new angle: Shape Space. This movie shows a trajectory through shape space.
<wikiflv width="300" height="300" logo="false" loop="true" background="white">CartoonPC2.flv|PC2_cartoon_2.png</wikiflv>

3 Comparing shapes from samples of different groups'

  1. View the result by varying each important component in turn. We call this walking the shape model. This movie shows a walk.
<wikiflv width="300" height="300" logo="false" loop="true" background="white">ShapeVectorWalkShowShape-21-Jun-2011-14-28-24 VD.flv|ShapeVectorWalkShowShape-21-Jun-2011-14-28-24 VD_First.png</wikiflv>

1 B