• Elvin Ou

Use Machine Learning to animate in Unity

Updated: Oct 23, 2019


I wanted to explore how ml4 would be able to communicate with other programs like Unity. After doing some research on what value doodle classifier sends out and what type of value unity OSC would receive, I made a very simple communication between them.


1. The process first started with creating image targets and the related class/ value that I need the doodle classifier to classify and communicate.

2. Then I created the scenery that I wanted for this communication in sketchUp.

3. From there I added samples and trained those image targets in Doodle Classifier

4. Eventually I had to use/change/create some code for the values to be applied in Unity while it was playing to create correspondent animation.