We provide a few extra options and configurations to tinker a bit better with your 3D pet’s mouth. The usefulness of these may depend on your pet and preference, so feel free to experiment with them and see if they work better for you or not.

Mouthing Parameters #

We send for each of the pets 3 extra parameters called “mouthing” alongside the normal mouth blendshapes you set up on vtspog. These parameters are 0-1 parameters that stay active as long as the pet is “reading” some audio. It doesn’t analyze the audio wave in any shape or form, it just checks if audio starts to send a 1, and when audio ends it sends a 0.

The parameters for this are as follows

• mouthing: default pet or just tts pet is talking
• mouthing_ai: ai pet is talking if pet split is enabled.
• mouthing_board: board pet is talking if pet split is enabled.

These parameters are sent both by VMC protocol and OSC protocol for vnyan, making it easy to access either of them in most of the most used 3D programs like Vnyan, Warudo and Vseeface, just remember to link the pets blendshapes/animation to them instead the normal blendshapes.

Static/png mouth shapes #

By default all of the mouth blendshapes are zero-sum, which means they can be all active at the same time. They add up together to 1 or 100 maximum output value which allows for multiple mouth shapes to be present at once without the mouth breaking, for example the model could have a 0.3 A shape and a 0.7 E shape at the same time.

This works fine for most traditional mouths which have either one or the 5 traditional shapes for the vowels, but some pets/models may have different mouth shapes with different planes/meshes or too extreme changes between the two, making combined mouth shapes not a desirable outcome. For those models we added this

Base on your blendshape configurations in vtspog, only one mouthshape will be sent at once. The mouth shape sent will be dependant on the audio an your configuration for the specific blendshape in vtspog, and only the most “likely” shape will be sent leaving all the rest at 0.