Even if the teeth are showing, it is normally the fixed upper teeth and not the lower jaw teeth that are visible. The problem of producing accurate lip sync is directly jaw-related, and compounded by the occlusion of the teeth in most performances. Using Deep Learning Convolution Neural Networks (CNN), Faceware’s improved jaw positioning tech gives users a faster and more accurate lip-sync to digital characters in real-time. Faceware can work on a webcam or a head mounted cameraĪt the core of the new Faceware innovations is ML which is used to dramatically improve lip-sync, by solving much more effectively the problem of the actor’s jaw position. Live facial solving is an important and different problem from a standard offline production and one that is well suited to using Machine Learning (ML). The Studio producer assumes one camera and can work from a webcam or a head-mounted camera rig (HMC). It is directly intended to be used for Live applications, but in the future, this technology will be expanded and blended with the non-real time traditional Faceware Pipeline tools. The product currently lives alongside the non-live Faceware pipeline built on Faceware’s Analyzer and ReTargeter. Artists are also given the tools to tune and tailor the animation to an actor’s unique performance and build additional logic with Motion Effects. The data can be streamed to Faceware-supported plugins for Unreal Engine (UE4), Unity, MotionBuilder and soon Autodesk Maya. The new Studio real-time streaming workflow allows quick calibration, tracking, and animation of anyone’s face in real-time by harnessing a new machine learning approach and the latest neural network techniques. The new platform is available immediately to try or purchase.įaceware Studio is new from the ground up and it completely replaces the former Faceware Live Server product. Faceware Technologies, a leading developer of markerless 3D facial motion capture solutions has released Faceware Studio, a new real-time platform for creating high-quality facial animation Live.
0 Comments
Leave a Reply. |