Digital Image Processing COL 783
Due Date : October 9, 2023
Assignment 2: Facial Expression Transfer and Face Swapping
Part A: Facial Expression Transfer
This part of the assignment deals with transfer of facial
expression from one facial image to another as discuused in the class.
You are requireed to implement different modules of as detailed in writeup .
The part with using Barycentric Coordinates may be done as discussed in the class. The salient points are as under.
- Global resizing of images I1 (Source- Neutral) and I3 (Source - with Expression) be done with respect to I2 (Target - Neutral). This can be done by considering 4 points of correspondence.
- Let P1, P2 and P3 are the corresponding points in the images I1, I2 and I3 respectively. After re-sizing P1 may goto P1' and P3 may goto P3'.
- Displace point P2 with the (diff vector P3' and P1') to obtain P4. Do this all the control points (the corrresponding points) in I2.
- The step above will provide the modified points to generate I4. Generate I4 by conisdering pixels within each triangle of the whole triangulation.
Part B: Face Swapping as
discussed in the class.
This part of the assignment deals with
swapping of faces. This is an adaptation of face warping. This requires you to consider the following.
- Consider only the face part of the image which would be swapped. You can limit the triangulation to the boundary of the face (excluding hair, neck, etc.)
- Perform algobal alignment for the pose.
- Color adjustment to the respective sources
- Smoothing for the boundary