🔥 Baselines

Tracking

⚽ Mimic the Actor’s facial expression

• Receive a gray-scale 2D image from the FFY cams in real-time
• Model takes in 2D images and predicts control expression values for facial expression

Retargeting

⚽ Calibrate for natural and pretty facial expression

• Model takes in Tracking model’s output and predicts calibrated control expression values for facial expression retargeting

🧠 Brainstorming

• Contrastive learning
• Pretext task
• 2D → Facial expression feature를 잘 뽑을 수 있는 방향으로 접근
• Input size (512,512)
• Conv feature는 texture < shape에 대한 feature를 뽑았으면 좋겠음
• Retargeting

2D image to Mesh

Smoothing