Text-to-Motion in Rokoko Studio Preview

Overview

The new Text-to-Motion feature allows you to create animation clips simply by typing what you want to see — no mocap suit required. This tool is currently in experimental state, available in Rokoko Studio Preview for users on Plus and Pro plans.

Text-to-Motion is ideal for quickly generating background character motion, filler animations, or experimental ideas without needing a capture setup.

Prerequisites

Before using Text-to-Motion, make sure you have:

1. An active Plus or Pro Rokoko plan (Studio Preview access required).
2. Installed Rokoko Studio Preview.
3. At least one existing scene created in Rokoko Studio — the feature can only be used inside an existing scene.

Opening Text-to-Motion

1. Open Rokoko Studio Preview and enter an existing scene.
2. At the bottom of the clip list, click Add Text-to-Motion Clip.
   
3. A popup window will appear with the input field and usage tips.
   
   

Generating Motion from Text

1. In the text box, type your prompt. Its better to start with a guiding phrase like "a person..." and keep your description simple.
   • Example: “A person is walking forward”
2. Choose the animation length (1 to 5 sec).
3. Click the blue arrow icon to generate your clip.
4. The AI will create a new motion preview. If you're unhappy with the result, click Retry to regenerate using the same prompt.

Tips for prompts:

• Static or simple motions (e.g., “A person sitting,” “A person waving”) usually perform best.
• Try rephrasing or adding adverbs for variations (e.g., “A person dancing slowly”).
• Experiment with different durations.

Adding to Scene

1. Once you’re happy with the generated motion, click Add to Scene (green plus(+) button).
2. The motion appears as a new clip titled with the text that generated it.
3. Click on the three dots to rename or remove the clip from the scene.

Note: Generated clips will not be synced back to the scene in Studio proper, they will only be accessible in Studio Preview. Also re-importing the scene in Preview will replace the saved file and therefore the generated clips will be lost.

Looping and Smoothing Clips

To make your generated animations seamless:

1. Select the clip from the clip list.
2. Create a loop by adding a loop segment in the timeline.
3. Enable Apply Magic Loop and the additional options from the side panel.
4. Preview the loop and modify its in-and-out to make it as seamless as possible.
5. Use a transition time between 0.5–1.0 seconds for best results.

Note: The smoothing tool is not optimized for text too motion clips in this release and may create unwanted artifacts on text too motion generated clips especially if they are looped. Use it cautiously for now.

Example: Creating a “Walking Orc” Animation

1. Enter a prompt: “A person is walking slowly like an orc.”
2. Generate several results using the Retry button — each try produces a variant.
3. Choose a take with a clean stride and add it to your scene.
4. Trim your in/out points for one full footstep cycle.
5. Enable Apply Loop Magic with a 0.5-second transition.

Your orc walk cycle can now be exported and imported into other programs!

Exporting to Unreal or Blender

1. Right-click on the loop segment and select Export.
2. Choose a skeleton (default is Newton - Unreal compatible).
   
   
3. Export as .FBX.
4. In Unreal Engine, import the FBX under Import to Current Folder.
5. Select your skeletal mesh and confirm Import Animation = On.

Once imported, the loop will play seamlessly — perfect for use in NPCs or background characters.

Best Use Cases

Although Text-to-Motion is still experimental, it is particularly helpful for:

• Background or crowd animation
• Idle movements (dancing, walking, sitting)
• Filling scenes when mocap gear isn’t available

You can mix these AI-generated motions with recorded mocap data to develop complete animated scenes.

Feedback and Next Steps

Text-to-Motion is still under active development.
Your feedback helps improve it — please share your thoughts on:

• Discord: discord.gg/XumuGXZ7hs
• Help Chat: www.rokoko.com

Have fun experimenting with AI-generated mocap!