Get ready for Headcam!

Summer is here and so is the latest and greatest update for Rokoko Studio. This update has focused on a lot of under-the-hood and quality-of-life improvements, not the least to get everything in place for our new Headcam and the related Android Face Capture app.

Amongst the highlights is a general overhaul of our integration with Unreal Engine, both in terms of livestreaming and exporting, for a much better and seamless experience, and a revamped installation and update flow for Studio. There's also a Transform section now in the Details panel, visual tooltips for Actor Profile measurements, the ability to quick-cycle visibility states from the outliner and much more.

We hope you enjoy and as always, remember to share your thoughts and impressions

• Discord (general feedback, issues, etc.)
• Productboard (feature requests and upvoting)

Update 3 (August 29, 2024)

Fixed issues

Export

• Fixed an issue where all animations were missing when exporting a trimmed clip
• Fixed an issue that caused exports to not work properly in iClone
• Implemented a better fix for the 90 degree rotation on the X axis that should work more consistently

Face Capture

• When closing down Rokoko Studio with the Face Capture app connected and running, the app will now return to the "Ready to connect" state.
• Fixed an issue where facial animation data wouldn't shown in Rokoko Studio, if the Face Capture app had crashed while being connected.
• Fixed an issue where closing and re-opening the Face Capture app quickly while being connected to Rokoko Studio would break the facial animation data stream, if the app was re-opened before Studio had "lost" connection to it.

Update 2 (August 27, 2024)

Improvements

• New Smartgloves firmware v2.3.1 (improves Coil Pro performance)
• Re-added the ability to access the Firmware tab for Rokoko devices that are loaded with errors, and to enable firmware re-install for some error types.
• Adjusted some Rokoko device error messages.

Fixed issues

• Fixed an issue with exported clip, where the exported meshes had a 90 degree rotation on the X axis, causing several compatibility issues with other applications.
• Fixed an issue where all Actors and Characters in the scene would appear in Clip View after exiting Actor Profile edit, even if they are not in the currently viewed clip.
• Error message is now shown if local user data and settings fail to load while starting Rokoko Studio, while also resetting the data to default to allow Studio to load properly.

Update 1 (August 13, 2024)

Fixed issues

• Fixed an issue that incorrectly produced an error when plugging in a Coil Pro via USB, causing the firmware tab to be unavailable.
• Fixed an issue when livestreaming hands, where the thumb would be "crooked" on the most of the livestreaming targets.
• Fixed an issue when exporting using the UE4 or UE5 skeleton presets that would cause a 90 degree rotation when importing into Unreal Engine.
• Fixed an issue causing the Actor to be mostly be hidden in the 3D scene, when changing the Actor Profile colors.

New features

General

• We've revamped the installation and updating flow so that Rokoko Studio is now properly installed in a non-user-specific folder. This is particularly relevant if you are using Studio in a setup where user-data is deleted daily, as it now only deletes user-specific data, and not the whole Studio installation.
  • This is also an initial step towards making Studio updates optional, so you can choose when and if you want to update. More on that soon...

Coil Pro

• Treadmill filter is now available when using a Coil Pro with a Smartsuit Pro-driven Actor
• You can now adjust the Coil Pro "distance to floor" with the 3D gizmo tool, if the custom "distance to floor" option is enabled.
• There's a new option and setting to "Re-initialize Coil Pro" for a given Actor; this is by default done automatically at the beginning of a Calibration, but this can be disabled in Studio settings. You can also manually trigger it from the Actor's context menu under "Calibrate".

Face Capture

• For the "Sync Eyes" filter, we've also added a threshold value that can determine at what point the eye values should no longer be synced, if they're too different (e.g. when closing one eye and not the other)
• If you use "Camera Follow" on an Actor that is only paired to a Face Capture device and/or only has the Face mesh visible, the camera will zoom-in and follow the face specifically.

Scene

• When you have a folder selected when recording, the clip is automatically added to that folder.
• We've added keyboard shortcuts that sets the trim start or end value to the current playback position in the timeline.
• You can now adjust exact position and scale values (when available) using the new Transform section in the Details panel.

Export

• You can now choose Export Option Presets, with an initial one added for Unreal Engine 5. More to come in the future, incl. the ability to add custom presets.
• We've added two new advanced export options to help improve native compatibility when exporting for Unreal Engine:
  • Root node naming: Allows you to define how the root node(s) in the exported file(s) to be named.
  • Export mesh as scene root: Moves all mesh nodes to root of the scene for the exported file.

Livestreaming

• New streaming targets have been added for Unreal Engine 5.4+ and Unreal Editor for Fortnite
  • Unreal Engine 5.4 utilizes a new livestreaming protocol that will work with our upcoming release of the Unreal plugin, providing a much simpler setup and integration of livestreaming. The new plugin version will soon be released on Github and on the Unreal Engine Marketplace.
  • Unreal Editor for Fortnite (UEFN) will be available in a future release of UEFN, dependent on alignment with Epic Games.
  • The new protocol used, JSON v4, can also be selected as a data format using the Custom streaming target.

Improvements

Devices

• The Device Manager popup is now unified for both the USB- and WiFi-connected version of the device, so you don't need to switch between two different views.
• If you've connected a Rokoko device via USB and it's not WiFi-connected yet, a notification toaster will ask you to configure the WiFi setup.

Coil Pro

• When calibrating a Coil Pro connected Actor, we now do a full re-initialization of all the underlying algorithms to ensure a proper "reset" of the data stream. This will result in you always having to e.g. "Move your hands" when doing calibration.

Face Capture

• We've given Newton's face a makeover, so that your facial expressions are now better and more clearly displayed than ever before!
• We've adjusted, polished and cleaned up the Face filters.

Accessibility

• When hovering any of the optional Actor Profile measurements, an tooltip image will now show you exactly how to measure this element of your Actor.
• We've started adding some "onboarding boxes" to various parts of the UI. You can easily dismiss them, or choose to hide any Onboarding information and UI via Studio Settings.
• Decimal-value input fields now support both . and , as decimal separators, regardless of your region.

Scene

• All clips and folders are now visible in "Clip View", allowing you to quickly jump between clips.
• Actors and Characters can now quickly have their visibility state changed by clicking the visibility icon in the Scene Outliner, cycling through the different states.
• When selecting a scene element in the outline or 3D view, some info on the selection is shown in the Details panel.
• We've added some handy buttons in the Details panel to quickly expand or collapse all sections.
• A deeplink to the Studio Settings popup has been added to the scene toolbar, linking directly to the specific settings for the Scene view.

Fixed issues

• Fixed several Export-related issues that created problems when importing into Unreal Engine 5.
• Fixed an issue where changing the name of a Rokoko device did not properly update the name throughout the UI.
• Fixed an issue where changing the name of some Smartsuit Pro II's wasn't properly saved and would be reset upon power-cycling.

New known issues

• Exports that include the Newton's mesh have some skinning issues.

See Rokoko Studio - Known Issues for an overview of all known issues, and Coil Pro - Known Issues for those specifically related to Coil Pro.