Video Playback and Filter - How are you feeling? (Process Log)

Rough Sketch

Video Attached: First Experimentation using CLM Tracker in P5js to build the filter

Playback feature: Will be controlled by user's facial expression: 

• When the user grin, a "happy juice" will appear
• When the user frowns, a "sad juice" will appear
• When the user's mouth makes an "O" shape and raise their eyebrows, a "special juice" will appear

Entry Four: Coding Structure

Extension used: CLM Tracker, Emotion Classifier

Sources

Emotion Classifier: 

https://github.com/emotion-js/emotion 

https://github.com/egoist/vue-emotion

Notes 

Video Attached: Trial Video Filter 

Try the filter! 

click here

However, instead of predicting "Which Disney Character are you?" it will maintain the second idea, of identifying emotion. The new video filter will be "predicting" the user's emotion. Each emotion represented by a kawaii beverage and not just the "Yakult" juice.

CODE SUMMARY IN A NUTSHELL

There are four main part in organising the code for this project: 

1. Set the Capture camera - this allows the program to access the user's camera (With permission)

2. Set up face tracker, To be able to incorperte face filter that moves in respect to a facial structure. 

3. Load all the "Aesthetic" variables - this includes all the images that will contribute to making the video filter look put together and on theme.

4. mousePressed() function - allows the user to stop and rewind the video in order to suffice the playback program criteria. 

Video Attached: FINAL Trial Video Filter and Controlled (Playback) Element

Try the Filter!

click here