Below is a step-by-step guide for users who want to learn how to setup and use Face Capture inside of Rokoko Studio.




1. Requirements


1.1 Required Rokoko Studio Subscriptions

  1. Primary Plan: Plus, Pro or Enterprise
  2. Add-on plan: Face-tracking (IOS)

1.2 Required hardware

  1. Iphone X-series or 11-series with TrueDepth Camera
  2. Rokoko Phone Mount (Optional)

1.3 Required software (App)

  1. Rokoko Remote for IOS, download here.


2. Setting up Face capture


  1. Launch Rokoko Studio
    • NOTE: Make sure that your phone is connected to the same network as the computer running Studio
  2. Launch the Rokoko Remote app on your Iphone X (or newer)
    • If you haven't downloaded it, you can do so here
  3. Click the ‘Rokoko Remote‘ button at the top right of Studio
  4. Under "Available devices" you should see the name of your phone
  5. To the right of your phone name in Studio, click the ‘Connect‘ button
  6. On your phone, a ‘Connect to Studio‘ window will appear asking if you accept connecting to your computer
    • Tap the ‘Accept‘ button to connect your phone to Studio
  7. Once you tap ‘Accept‘, the screen should show you that your phone is now connected to Studio
  8. Tap the slider button to enable ‘Facial capture‘ on your phone
    • When you tap the slider button, a promt will appear asking if you would like "Rokoko Remote" to 
      access the camera on your phone
    • Tap ‘OK
  9. To disconnect Face Capture, you can:
    • Click the ‘Disconnect‘ button inside of Studio
    • Tap the slider button inside of Rokoko Remote to disable it
    • Close out of Rokoko Remote

Rokoko Remote 



3. Rokoko Remote UI


  • The Red circular button is the record button. It allows you to start and stop recordings within Studio
  • The button to the left of the red circle is the ‘Straight Pose‘ button. When you have a suit live in Studio, this button enables the straight pose countdown.
  • The slider button to the right of the red circle is the enable ‘Facial capture ‘ button. When it is green that means Facial capture is enabled, when it is black that means Facial capture is disabled
  • The button with the face on the right of the app screen allows you to toggle between "Mesh only" view and "Mesh and camera" view
  • The button at the top right of Rokoko Remote app is your settings. You can view Connection details, About Rokoko Remote and Help and support here


4. Record and Export Face Capture Data


  • Before proceeding, make sure to assign your face capture scene object to an Actor Profile
    • Drag and drop the Face Capture icon listed under ‘Unpair inputs‘ on top of an Actor Profile listed under ‘Scene object
    • NOTE: If you need to unpair a scene object, hover your cursor over the arrow connecting the scene object to the actor profile and click the ‘X  button
  • Either in Studio or Rokoko Remote, press the Red circle to start recording
    • Press this button again to stop recording
  • Once you finish recording, the Take will be saved and be displayed on the left panel
    • NOTE: All Takes that contain Facial Capture data will have a face icon to the right of it
  • Double-click the Take to open it and playback the recorded animation
  • On the playback controls panel, from the left to right you can:
    • Adjust the playback speed of the animation
    • Go to start frame
    • Go one frame back / Hold shift and click this to go 10 frames back
    • Stop playback
    • Start / Stop Recording
    • Play animation
    • Go one frame forward / Hold shift and click this to go 10 frames forward
    • Go to end frame
    • Toggle playback Looping