About Dlib Face Landmark Detector

Overview

https://assetstore.unity.com/packages/tools/integration/dlib-facelandmark-detector-64314

Support Platforms

 

Dlib FaceLandmark Detector

EditorPreview
Windows
Mac
Linux
Android
iOS

WindowsStoreApp8.1

WindowsPhone8.1

Windows10 UWP

WebGL (asm.js/webassembly)

*1

Lumin (Magic Leap)

ChromeOS

*1 Supports Unity5.3 or later

Setup Guide

Example Project Assets

CV VTuber Example

https://assetstore.unity.com/packages/templates/tutorials/cv-vtuber-example-118186

CVVTuberExample(Computer Vision Virtual YouTuber Example) is an example project of controlling 3D humanoid model (“Unity-chan!” Model) using WebCamTexture. You can control the head orientation and the facial expression of the 3D humanoid model using WebCamTexture only.

The execution of this asset is required “OpenCV for Unity” and “Dlib FaceLandmark Detector”.

FaceMask Example

https://assetstore.unity.com/packages/templates/tutorials/facemask-example-79999

This asset is an example project that maps face mask to the detected faces in an image using “OpenCV for Unity” and “Dlib FaceLandmark Detector”.

FAQ

General

Support Web platform?

Since the Unity Web Player does not support the native plugin, “Dlib FaceLandmark Detector” does not support “WebPlayer Platform”.

A WebGL platform was added as an alternative. (Unity 5.3 or higher)

Support Windows10 UWP?

Yes. The asset supports the UWP platform.

What is the minimum file composition required for the assets to work?

You do not necessarily have to import all the files for the asset to work. If you do not need to try the example scenes, the minimum file composition required is as follows:

Offer a free version?

We aren’t able to offer a free trial version of DlibFaceLandmarkDetector Asset at this time.

Setup

“DllNotFoundException: dlibfaceLandmarkdetector” is displayed on the console when run the example scene.

Plugin does not seem to be loaded correctly. Please check the setup procedure.

“Level ‘Texture2DExample’ (-1) could not be loaded because it has not been added to the build settings.” is displayed on the console when run the example scene.

Please add all of “***.unity” scenes into the “Assets/DlibFaceLandmarkDetector/Examples” folder to [Build Settings] – [Scene In Build].

In Texture2DExample, red rectangle is not displayed around a face.

Please move the “DlibFaceLandmarkDetector/StreamingAssets/” folder to “Assets/” folder.

Dlib

How can I train object detector?

Please refer to this page.

train_objectdetector

How can I train shape predictor?

Please refer to this page.

train_shapepredictor

The size of the “sp_human_face_68.dat” is too large.

Please use the “sp_human_face_68_for_mobile.dat”. (the “sp_human_face_68_for_mobile.dat” is less accurate than the “sp_human_face_68.dat”, but it is a smaller size.)

The index of face landmark points that can be obtained using the sp_human_face_XX.dat.

How to a way to catch native Dlib’s errors code?

In order to display the native Dlib’s error code, please enclose the code in Utils.setDebugMode(true) and Utils.setDebugMode(false).

Utils.setDebugMode(true); ------------ Utils.setDebugMode(false);