Who is this article relevant to?
This article is for anyone who wants to know how to livestream their Rokoko Studio animations to their Custom Metahumans in Unreal Engine 5
Which plans is this article relevant for?
Plus Pro Enterprise
Important! For any workflow-related issues, please join our Discord server.
You have imported your Custom Metahuman into your Unreal Engine 5 project. Next, you want to live stream your Rokoko Studio data to that character.
A full guide on how to create your Custom Metahuman, import it into a project, and set it up for livestreaming can be found on our Youtube channel
Let's take a look at what we need and how we can set the Custom Metahuman up in steps.
- Rokoko Studio which you can install here
- A custom Metahuman
- Install the Rokoko Studio Plugin in Unreal Engine. More info in Getting Started: Unreal Engine 4.26/4.27/5 Plugin from Epic Marketplace – Rokoko
- Install the Metahuman plugin from the Epic Marketplace
- BoneMaps and Mocap Folders which you can find at the end of this article
- If you have worked with 5.1 in the past, the only thing that changes in later UE versions is the rokoko receiver part. Now, you do not need to add a Rokoko Receiver actor in the viewport. We will enter the IP and port in the Live Link instead.
- This article goes through the setup of a Male Metahuman. If you are using a Female Metahuman, please use the following files instead. They already exist in the project along with the male respective files.
(f stands for female)
- f_med_nrw_animbp_C and
- f_med_nrw_animbp assets
Follow the steps carefully. Missing a step or a detail will result in the setup not working. Let's start!
- Download the zip files attached at the end of the article.
- Extract the zipped folder in C:\MyDocuments\Unreal Projects\ProjectName\Content.
Your path may be named differently, but the final Content folder inside your Project will be the same.
- Open your Unreal Engine 5 project.
- Open, compile, and save both the "Rokoko_MetaHuman_T_Pose" and the "Metahuman BoneMap" file in the BoneMaps Folder we added before applying any actions (important!)
- Open your Metahuman Blueprint. It is usually located in All->Content->Metahumans->MetahumanName named as BP_Metahuman
Click on the "LODsync" and change the "ForcedLOD" to 0 in the "Details" Panel on the right.
Click on the “Body” on the top-left and double-click the “Skeletal Mesh Asset” box in the "Details" Panel. This should open the Skeletal Mesh of the Metahuman.
A window will open. Take note of its name. In this case, it's m_med_nrw_body. If you are using a female Metahuman, it will be different and it will have an"f" in its name. We will need to choose the correct one as shown in the next step. We will need to edit this file.
Click the dots on the side of this "Blueprint" button and select the correct file. In this case, it's "m_med_nrw_body"
A window directly to the "AnimGraph" will open. If it does not, double-click the "AnimGraph" on the lower left.
Right-click in the viewport and add the "Rokoko Body Pose" node.
If you don't get Rokoko Body pose or any other "Rokoko" node/component, check that the Rokoko Plugin is active in the Edit > Plugins menu from the main menu.
- Connect it to the two existing nodes on each side and the "Local To Component" and "Component To Local" nodes will appear.
Drag a pin from “Rokoko Actor Name” or right-click on it and select “Promote to variable”.
Drag a pin from “Retarget Asset” or right-click on it and select “Promote to variable”, as well.
- Compile, and save
Click on the “Rokoko Body Pose” node and in Default Value, select the “Metahuman_BoneMap” asset that was included in the BoneMaps folder, and hit Apply.
Note: “Rokoko Actor Name“ should be set as None.
- Compile, then save. If you get any errors after compiling, check point 4 above.
- Click on the “Control Rig” node and in Default Value, select the “Rokoko_MetaHuman_T_Pose” asset that was included in the BoneMaps folder.
Compile, save, and exit the Animation Blueprint. If you get any errors after compiling, check point 4 above.
Back to the Metahuman Blueprint, click on the “Body” on the top left and make sure that the Metahuman uses the "m_med_nrw_animbp" Animation Blueprint. This is because our Metahuman has the Male Body as explained earlier.
Drag the body into the Event Graph:
Drag a pin and select “Get Anim Instance”
Drag a pin and select “Cast to” and the Animation Blueprint you modified in previous steps.
Set the “Rokoko Actor Name” as the Actor Name inside Studio and connect the wires to the nodes.
Compile and save.
Drag the “BP_Metahuman” into the scene.
Omit this step if you are using UE 5.2
Find the Rokoko Receiver Actor and drag it into the scene, by clicking on the top “Quickly add to the project”.
In Studio, click on Livestream and on the cogwheel next to the Unreal icon.
The port should be enabled and the same as the Rokoko Receiver port inside Unreal.
Click on Activate next to the Unreal icon inside Studio.
Back in Unreal, select Windows -> Virtual Production -> Live Link.
Click on Source -> Rokoko Studio Source -> Studio
You should see the following:
If you are using UE 5.2 you will need to type the IP and port found in the Rokoko Studio plugin window. In our case, it's 127.0.0.1:14045, then click "Studio" as shown by the arrow.This basically replaces the need for the Rokoko Receiver in Step 27. If you have already added it, there is nothing wrong and you can continue.
For Face Capture, click on the Metahuman inside the editor
Then, select the Face data in “ARKit Face Subj” in the Details panel.
Tick the “Use ARKit Face”.
For the body, the live link data should remain as None. Don't tick the box either.
You should see the movement from inside Rokoko Studio forwarded to your Metahuman in Unreal Engine 5.