CRI LipSync is a lip-sync middleware uses deep learning voice analysis technology to automatically generates natural mouth patterns from voice data.During conversations between in-game characters, it generates natural mouth movements that match the dialogue.

Advantage

1. Automatic generation of natural mouth patterns

1. Automatic generation of natural mouth patterns

CRI LipSync analyzes the waveform of the voice and automatically outputs the optimal mouth shape. It is also possible to determine pronunciation parameters, such as tongue position and the opening and closing of the mouth for bilabial sounds.
2. Supports both 2D and 3D models

2. Supports both 2D and 3D models

The generated mouth patterns are output in a format that is easy to use with various character models. It supports both 2D and 3D, enabling a richer gaming experience for a wide range of uses and genres.
3. Language-independent

3. Language-independent

It can generate mouth patterns in any language. There is no need to prepare dictionary data for each language in advance. This greatly improves the efficiency when developing titles that will be released worldwide in multiple languages.

4. Supports a wide range of voice timbres

It can analyze lines from a wide variety of voices, regardless of age, gender, or voice quality. It can generate mouth patterns corresponding to any voice type, regardless of pitch.

Key Features

LipSync Library
LipSync Tools

This Windows tool analyzes audio files in advance and outputs lip-sync patterns as text. It also supports editing within CG tools and conversion to proprietary game formats.

CRIWARE users can use it free of charge from development start through release and beyond.

Audio analysis using a dedicated tool

Audio analysis using a dedicated tool
A dedicated command line tool analyzes audio data and outputs mouth patterns.

External tool integration

External tool integration
The mouth pattern is output in text format, so it can be edited using CG tools, etc.

Multi-platform support

Multi-platform support
Compatible with smartphones, PlayStation®5, Xbox Series X/S, Nintendo Switch™, PlayStation®4, Xbox One, and PC.

Analyzes singing data

Analyzes singing data
CRI LipSync not only supports normal conversations but also singing voice analysis.
Demo movie
LipSync V 

Product specifications and cost

LipSync Library
LipSync Tools

This Windows tool analyzes audio files in advance and outputs lip-sync patterns as text. It also supports editing within CG tools and conversion to proprietary game formats.

CRIWARE users can use it free of charge from development start through release and beyond.

Provided SDKWindows command line tools
(samples, documentation)
Supported Game EnginesNot supported
(Standalone tools)
Supported PlatformsiOS, Android
PlayStation®4, PlayStation®5
Nintendo Switch™, Nintendo Switch™ 2
Xbox One, Xbox Series X, Xbox Series S
Windows
ほか
Price (excluding tax)[CRIWARE user]
Available for free
[Non-CRIWARE users]
For the development period, the initial fee is 600,000 yen/6 months, and can be extended for 100,000 yen/month thereafter.

OS support policy

Price List

If the options below do not apply to your project, please contact us.

LipSync Tools Price list
LipSync V

Installation

The installation flow and fee structure shown here are intended for use in games.
If you wish to use it for other content, please contact us.

LipSync Library
LipSync Tools

Use pre-analyzed mouth patterns.

STEP1 Trial application

Please apply for a trial from the inquiry form.
* This offer is only available to corporate customers.

STEP2 Trial

You can try out the full version according to the license period (*). Free technical support is available during the trial period.

* The license period is until the end of title development for ADX users, and 2 weeks for non-ADX users.

STEP3 Implementation

Please contact our sales representative and submit your acceptance letter. We will enter into a license agreement.
Depending on the contract, you will be charged 600,000 yen (excluding tax, for the development period) for the first 6 months.

*ADX users can use the service free of charge during the title development period.

STEP4 Development

Development will be conducted using LipSync Tools.

STEP5 License extension

If you wish to use the service for more than six months, you will need to extend the license. Please contact our sales staff. After the extension, you will be charged a usage fee of 100,000 yen/month (excluding tax).

STEP6 Title release

After the title is released, there is no need to report sales figures, etc.

STEP7 After the title release

If you want to use LipSync Tools to add voices, etc., you will need to sign a new contract. Please contact our sales representative.*People who use CRIWARE will also be charged.​ ​

* From January 2024, if you are using CRIWARE, you will be able to use LipSync Tools free of charge even after the title is released.
LipSync V 

Topics

CEDEC2019

The session videos and presentation materials for CRI's sponsored session "Make characters more attractive! Lip sync middleware for games," which was attended by a large number of visitors at CEDEC 2019, are now available.

Session Video

Download the presentation materials

"Make your characters more attractive! Lip sync middleware for games"

Trial Application

Please use the inquiry form to let us know your desired product, platform, engine, etc.
For inquiries regarding contracts and fees, please use the form below.

Trial application / inquiry