VRChat uses blend shapes to detect phonemes via a microphone, and adjust your character mouth to the correct shapes, giving the impression that you character is talking. Let's learn how to do it. 744 votes, 71 comments. 61.3k members in the VRchat community. Welcome to the Metaverse. I've sorta learned unity, but im still trying to learn blender. TafiAvatars helps users develop custom stylized Avatars in VRChat, the most popular VR community and massive virtual reality social platform. Customizable and VR compatible, the TafiAvatars application gives users a way to build, save, and export custom Avatars for VR excursions. Learn more about VRChat. The Horse Male base, for VRCHAT! Created in Blender (2.79), Texturing using Substance painter. $ Bipedal pony (VRChat ready) 7 days ago.
Create and upload a VRChat Avatar with blend shapes visemes
Isn't it great when you talk with somebody online and you see his mouth moving while he talks? It really add ups to the experience, specially in Virtual Reality.
That's what this is about. Creating different shapes so you can see yourself talking when you look at a mirror.
It's the little touches that makes something good to something better.
Let's say you already have your model done, it's also rigged and skinned so its ready to go. But, you want to make some blend shapes because in-game they look neat and funny.
Well, let's make them!
First, we need to know how many blend shapes we need to make. VRChat uses 17 different blend shapes. These are:
It's important to know that these shapes that we are going to make will need to have a very specific name. For example, aa is called vrc.v_aa; ch is called vrc.v_ch; etc..
The only exceptions to this rule are the first 4 of the list. Their names will be vrc.blink_left,vrc.blink_right, etc..
As you can see in the image, there is no '.' in any of the names, and that's because Maya doesn't let you write dots in the names. We will roll with it for the moment.
Duplicate your character and move it to a side. Hide what is not necessary and show what it is.
Use an image of reference to know how to shape the mouth depending on the shape you need.
This gives you a general idea of how I made the different shapes of the mouth depending on the viseme.
You can see that there is not any vrc.blink_right or vrc.lowerlid_right, but I will talk about that later.
Another thing to keep in mind is that even if vrc.v_sil doesn't change the shape whatsoever, you must change something regardless. When we use Blender later, when exporting, if Blender detects that 'sil' it's the same as the base form, it will remove 'sil' from the blend shapes. Move a vert a little bit, one that no one will see, on the back of the mouth, for example.
Now that we have every shape done, we will use the Shape Editor.
Open the Shape Editor in the sculpting tab in Maya. Or going to Deform>Blend Shape.
Now, select one shape that you created and then select the original model. Go to the Shape Editor and click on 'Create Blend Shape'. Repeat this with all the 17 shapes.
Before, I said that I didn't have any blink_right nor lowerlid_right and that's because you dont usually need them. If the character is symmetric, you can duplicate your blink_left, select the new target and in the Shape Editor go to Shapes > Flip Target.
This will create a mirror effect and making the right eye to blink. You should change the name once it's done.
Export and Import
We have every shape ready, so now we will export all the package. Select all the shapes, meshes and bones and go to export.
Be mindful of checking in the box of Animation and making sure that Blend Shapes is activated too, because if it's not, it wont export correctly.
Write the name you want and export it.
Now we will open Blender, where we will change the names of the shapes to the correct one.
Open a new scene and delete the objects that get created all the time. Camera and light too.
Then, import the file we made earlier.
Navigate through the menus to find the Shape Keys sub-menu.
Here you can change the names of all the shapes. Delete the first '_' and replace it with a '.'
The last thing you have to do is to re arrange all the shapes to be in order. The order is the same as the list that I wrote at the beginning.
Once that's done, export as fbx.
You should have your Unity latest stable version already set up. If you don't, check this guide out made by my friend Alejandro Peño where he explain how to set it up.
With the character imported, we will add a new component called VRC_Avatar Descriptor.
We will draw the mesh into the 'Face Mesh' section. All the visemes should appear below there.
Now just click on each section and select the corresponded viseme.
Once it's finished, you can upload the character like you usually do. Again, if you don't know how, you can check this guide:
Blend shapes visemes are a great way to give life to your avatars in VRChat.
I would 100% recommend using them in your future avatars.
Depending on the model it takes around 30 min to an hour to create all the shapes needed, and they look great.
It's a lot of fun making these, so give them a try!
Junior 3D Animator improving every day possible. Videogame and cat enthusiast.
Leave a Reply.
✅ ✅ May 3rd, 2019: Blender / CATS v13.1fixes most of the eye creation, visemes. If you get any Traceback errors during creation. Simply hit it multiple times.
OLD: [⚠️⚠️⚠️WARNING!!!⚠️⚠⚠ ] 4/3/2019 – VRCHAT USERS: DISREGARD 10 MATERIAL WARNING + You now have to MANUALLY apply your Eye Tracking and Visemes in Blender because of the new VRoid v6.0+ update. Retrolink gamecube controller driver. Screencap assist: https://imgur.com/a/RR9Hzzt 💕⬇️⚠️⬇️💕
Traceback error HELP on enabling Cats or VRM Importer can be found in PINS
Learn how to import your VROID character to BLENDER & UNITY at the HIGHEST QUALITY. THIS IS THE FASTEST METHOD AVAILABLE IN 2019. We will be using VRoid Studio, Blender 2.8, Unity 3D.
Need help making your anime model? I’ve made many other helpful tutorials on my channel!
⬇️Download Links for Blender Part⬇️
0) VRoid Download – https://vroid.pixiv.net/download.html
1) Blender 2.8 Beta – https://builder.blender.org/download/
2) VRM Importer – https://github.com/iCyP/VRM_IMPORTER_for_Blender2_8
3) Cats Blender Plugin (Blender 2.8 beta): https://github.com/michaeldegroot/cats-blender-plugin/archive/64ded61a160ec1a781cefed817ab965278ee6343.zip
Blender Vrchat Avatar
⬇️Download Links for Unity 3D Part⬇️
0) Unity 2017.4.15f1 LTS – https://unity3d.com/unity/qa/lts-releases
1) Import VRM into Unity – https://github.com/dwango/UniVRM/releases
2) CubedParadox Shaders for VRM/VRCHAT – https://github.com/cubedparadox/Cubeds-Unity-Shaders
💕DISCORD (18+ Only)💕 : https://discord.gg/VVTtcd2
💕TWITTER💕 : https://twitter.com/Fruitpex
💕PATREON💕 : https://www.patreon.com/fruitpex
(You get nothing except the sanctification of losing money. I appreciate the tips!)
How To Make Vrchat Avatars In Blender
ROYALTY FREE MUSIC FROM:
Music from Jukedeck – create your own at http://jukedeck.com
#Vroid_Studio #Anime #3D