Livestream to Custom Characters in Blender

Who is this article relevant to?

This article is for anyone who wants to know how to livestream their Rokoko Studio animations to their custom characters in Blender

Which plans is this article relevant for?

Plus Pro Enterprise

Important! For any workflow-related issues, please join our Discord server.

 

Requirements

Install the Rokoko Studio Blender plugin. Instructions for doing this can be found here

Useful

A useful video can be found attached at the end of this article. It shows the whole process in a faster manner.

Process

  1. In Studio, click on Livestream and on the cogwheel next to the Blender icon.

    1.PNG

    The port should be enabled and the same as the Rokoko Receiver port inside Blender.

    2.PNG
    3.PNG

  2. Click on "Start Receiver" to start the livestream.

    Blender_start_receiver.png
     
  3. After starting the receiver, select the armature (skeleton of your custom character that you imported in Blender) that you want to animate. Open the Object category and then open the “Rokoko Studio Live Setup” panel.

    In the actor field select the Smartsuit (Actor Profile name) that you want to use for this armature.

    1.PNG
     
  4. Fill all bone fields by pressing “Auto Detect” and check if all bones are correctly filled in and fill in missing bones.

    Blender_auto_detect.png
     
  5. Ensure that the selected armature is in T-Pose and then press “Set as T-Pose”.

    Blender_TPose.png
     
  6. Your armature should be animated by the live data.

     

    Blender_naimated_live_data.gif

  7. After starting the receiver select the mesh (the body of the character you imported in Blender) that you want to animate, open the Object category and then open the “Rokoko Studio Live Setup” panel.
    2.PNG

     

  8. In the “Face” field select the face data (Actor Profile) that you want to use for this mesh.
  9. Fill all shapekey fields by pressing “Auto Detect” and check if all shapekeys are correctly filled in and fill in missing shapekeys.

    Blender_autoDetect.png
     
  10. Your mesh should now be animated by the face data.

     

    Blender_face_animated.gif

     



    Optional for better livestream perofmance: In order to improve animation performance enable “Hide Meshes during Play” in the receiver panel.

    Blender_face_perf.gif

    (Meshes that are animated by face data from Rokoko Studio will not be hidden by this setting)

    Blender_Hidemeshes.png

    If you experience any lag when using the plugin, close the window that shows key frames (in the timeline). Blender will run much smoother as the panel takes a lot of resources.

 

Articles in this section

Knowledge base