Livestream to Cinema 4D

Rokoko Studio settings

• Go to the Livestreaming tab and click on cog wheel button.
• Confirm the forwarding IP and port and check-box Include Connection.
• Then Check-box next to the Cinema 4D logo

Install the Rokoko plugin

• Extract the rokoko-studio-live-cinema4d.zip file to your desired location

• Open Cinema 4D go to Edit > Preferences > Plugins

  

• Click on Add Folder, select the folder where you extracted the plugin to, and click Select Folder.

Cinema 4D settings

• Open the plugin by going to Extensions > Rokoko Studio Live. (You may need to restart your project to see the Rokoko Studio Live option)

• Go to the Connection tab and make sure that the port is the same as the streaming port in Rokoko Studio. Then click Connect.

Rokoko Studio is now connected and you will see the actor profile connected as well.

Prepare your character rig

• Import your character by dragging the file into the viewport. 

• Make sure the character is in a T-Pose. Also, make sure to place it in the world's origin.

   

  Note: It is advised to have the hip joint parented to another object. While this may be an arbitrary object, either a Null object or another joint object is recommended. This will serve as the root of the character.

   

• For Smartgloves, make sure to pose your characters hands like the image below. This will provide you with the most accurate retargeting of the data.

• On the right side of your scene, locate your character's root bone and assign a Rokoko Tag to it. Our root bone is named Hips

• Select the new tag, to see its parameters in the Attribute Manager, and take a look at the "Mapping" tab.
• Click Auto-Detect Rig and make sure that the bones are mapped correctly and fix any issues, that may have occurred. To assign a new bone simply drag the joint from your skeleton and onto one of the slots.

• After checking that all the bones are correctly assigned and that the posing of the character is correct, click the Set as T-Pose button.

  

• Finally choose the motion data to be used for this character (either in the Tag's "Properties" tab in Attribute Manager or using the "Tags" tab in Rokoko Manager). Change the Stream/Clips to "Studio Connection" if you want to stream the data.

You are now ready to play motion data with this character, which can then be saved into clips or baked into keyframes.

Prepare the face capture

Note: The Face Capture is set up to work automatically with faces that using the standard Apple AR kit blendshapes.

This is basically the same workflow as preparing a character rig for Rokoko Studio Live (described above).

• For Faces: Apply a Rokoko Tag to the face mesh (the object that carries the PoseMorph tag) and then follow above workflow.

  

  Differences in workflow:

  • Obviously a face needs no T-Pose
  • The button is labeled "Auto Detect Poses"

  • Unfortunately Poses can not be dragged from a PoseMorph tag into the Mapping table. Instead one has to enter the Pose names manually.

    

• For Props: Apply a Rokoko Tag to a prop object

  Differences in workflow:

  • Props have no T-Pose nor any mapping tables
  • Therefore the process boils down to assigning the tag and choosing the data.

Start Player

• To start live streaming, open the plugin by going to Extensions > Rokoko Studio Live.

• Click Player > Start Player

If everything is done correctly, you will see both the body and the face of your character move.

GitHub Wiki

For an in-depth look at what the different functions does in the plugin head over to our GitHub Wiki for more. (Some images may be outdated, but the same process should still apply)

https://github.com/Rokoko/rokoko-studio-live-cinema4d/wiki/Rokoko-Studio-Live-Plugin-for-Cinema