Machine learning is capable of doing some amazing things. However, the state of the art tends to be limited to academic and large corporate institutions. What would happen if artists, filmmakers, and the creative community had access to cutting edge technology without the heavy investment in research and development.

The Verge looks into just that.

Say you’re an animator on a budget who wants to turn a video of a human actor into a 3D model. Instead of hiring expensive motion capture equipment, you could use Runway to apply a neural network called “PosetNet” to your footage, creating wireframe models of your actor that can then be exported for animation.

tt ads