Create ticket
Welcome
Login  Sign up

Getting Started: Streaming to Blender

Requirements

Rokoko Studio plus or above subscription

In order to stream to Blender, you need to have installed the Blender plugin. Instructions for doing this can be found here

Video Tutorial - Live Streaming to Blender 2.8

This video guides you on how to setup real-time streaming of full performance capture, Face and Body, from Rokoko Studio on to your custom characters in the Blender 2.8.


Getting Started

Rokoko Studio settings

Enabling Rokoko Studio Live

Go to settings and click on Studio Live in the dropdown menu

Configuring the data Stream

Before you can begin streaming data you need to configure the receiver information. Start by clicking the cogwheel  in the top right corner, which will flip the box around.

Adding a receiver

Add one receiver by clicking the plus button, which applies one receiver to the list. At this stage you can modify the IP address and Port number.  


Click the arrow down  button to configure VP (Virtual Production) Port.

Enable and disable receiver

Each individual receiver can be enabled and disabled by toggling the switch  

Enabling the data stream

Enable the data stream by clicking on box. The green outline indicates that the data stream is enabled, click again to disable. (In order to enable a data stream, at least one receiver must be enabled.

Blender settings

Receiving the Data

In the 3D View press N or the the little arrow on the right side

Select the “Rokoko” tab

Set the field “Port” to the value that you set in Rokoko Studio

Press “Start Receiver” to start receiving data from Rokoko Studio

Streaming Character data

After starting the receiver select the armature that you want to animate. Open the Object category and then open the “Rokoko Studio Live Setup” panel

In the actor field select the Smartsuit that you want to use for this armature

Fill all bone fields by pressing “Auto Detect” and check if all bones are correctly filled in and fill in missing bones

Ensure that the selected armature is in T-Pose and then press “Set as T-Pose”

Your armature should be animated by the live data

Optional: In order to improve animation performance enable “Hide Meshes during Play” in the receiver panel.

(Meshes that are animated by face data from Rokoko Studio will not be hidden by this setting)

If you experience any lag when using the plugin, close the window that shows key frames (in the timeline). Blender will run much smoother as the panel takes a lot of resources.

Streaming Face data

After starting the receiver select the mesh that you want to animate, open the Object category and then open the “Rokoko Studio Live Setup” panel

In the “Face” field select the face data that you want to use for this mesh

 

Fill all shapekey fields by pressing “Auto Detect” and check if all shapekeys are correctly filled in and fill in missing shapekeys.

Your mesh should now be animated by the face data.

Streaming Virtual Production data

After starting the receiver select the object that you want to animate

Open the Object category and then open the “Rokoko Studio Live Setup” 

 In the “Tracker or Prop” field select the tracker or prop data that you want to use for this object.

When you have selected your prop. You can also turn on "Use Custom Scale" and change the Scale, to make sure everything fits your Blender project.

Your object should now be animated by the tracker or prop data.

In the Receiver panel you can set the “Scene Scale” to scale the live position data to fit your project.

Video Tutorial: Adding Rokoko Studio Motion Library assets to your character in Blender

More information on the Motion Library can be found here.

Did you find it helpful? Yes No

Send feedback
Sorry we couldn't be helpful. Help us improve this article with your feedback.