CRI LipSync is a lip-sync middleware uses deep learning voice analysis technology to
automatically generates natural mouth patterns from voice data.
During conversations between in-game characters, it generates natural mouth movements that match the dialogue.
Advantage
1. Automatic generation of natural mouth patterns
CRI LipSync analyzes the waveform of the voice and automatically outputs the optimal mouth shape. It is also possible to determine pronunciation parameters, such as tongue position and the opening and closing of the mouth for bilabial sounds.
2. Supports both 2D and 3D models
The generated mouth patterns are output in a format that is easy to use with various character models. It supports both 2D and 3D, enabling a richer gaming experience for a wide range of uses and genres.
3. Language-independent
It can generate mouth patterns in any language. There is no need to prepare dictionary data for each language in advance. This greatly improves the efficiency when developing titles that will be released worldwide in multiple languages.
4. Supports a wide range of voice timbres
It can analyze lines from a wide variety of voices, regardless of age, gender, or voice quality. It can generate mouth patterns corresponding to any voice type, regardless of pitch.
Key Features
Allows for more efficient development
CRI LipSync makes development more efficient as there is no need to create assets manually in advance.
Supports various game engines
CRI LipSync can be used for development in Unity and Unreal Engine 4 environments.
Multi-platform support
スマートフォン、PlayStation®5、Xbox Series X/S、Nintendo Switch™、PlayStation®4、Xbox One、PC上で動作します。
Interfaces with ADX
When working in conjunction with our audio middleware "CRI ADX®", mouth patterns can be easily obtained from audio playback.
Analyzes singing data
CRI LipSync not only supports normal conversations but also singing voice analysis.
Open demo videoAudio analysis using a dedicated tool
A dedicated command line tool analyzes audio data and outputs mouth patterns.
External tool integration
The mouth pattern is output in text format, so it can be edited using CG tools, etc.
Multi-platform support
スマートフォン、PlayStation®5、Xbox Series X/S、Nintendo Switch™、PlayStation®4、Xbox One、PC上で動作します。
Analyzes singing data
CRI LipSync not only supports normal conversations but also singing voice analysis.
Open demo videoProduct specifications and cost
| For Gaming | Non-game virtual characters, video production, etc. | ||
|---|---|---|---|
| LipSync Library Real-time Analysis | LipSync Tools Pre-Analysis | LipSync V Pre-analysis and real-time analysis of microphone input audio | |
| overview | Interfaces with the audio middleware "CRI ADX®" to instantly output mouth patterns from input voice | Analyzes audio files and outputs mouth patterns in a text format. Supports editing on CG tools and conversion to game-specific formats |
|
| Provided SDK | Included in CRIWARE SDK (libraries, samples, documentation) |
Windows command line tools (samples, documentation) |
LipSync V (real-time library) Windows command line tools (samples, documentation) |
| Supported Game Engines |
|
Not supported (For standalone tools) |
Unity |
| Supported Platforms |
|
|
|
| Price (excluding tax) |
[ADX User] |
[CRIWARE user] [Non-CRIWARE users] |
[Event plan] [Subscription Plan] |
Price List
If the options below do not apply to your project, please contact us.
Installation
The installation flow and fee structure shown here are intended for use in games.
If you wish to use it for other content, please contact us.
STEP 1 Trial application
Please apply for a trial from the inquiry form. *This offer is only available to ADX users and corporate customers.
STEP 2 Trial
You can try the LipSync library for free.
Free technical support is available during the trial period.
STEP 3Implementation
Please contact our sales staff and submit your project's information.
*No license fees will be charged.
STEP 1 Trial application
Please apply for a trial from the inquiry form. *This offer is only available to corporate customers.
STEP 2 Trial
You can try out the full version according to the license period (※). Free technical support is available during the trial period. ※The license period is until the end of title development for ADX users, and 2 weeks for non-ADX users.
STEP 3Implementation
Please contact our sales representative and submit your acceptance letter. We will enter into a license agreement.
Depending on the contract, you will be charged 600,000 yen (excluding tax, for the development period) for the first 6 months. *ADX users can use the service free of charge during the title development period.
STEP 4 Development
You can use LipSync Tools according to the license period.
STEP5License extension
If you wish to use the service for more than six months, you will need to extend the license. Please contact our sales staff. After the extension, you will be charged a usage fee of 100,000 yen/month (excluding tax).
STEP6 Title release
After the title is released, there is no need to report sales figures, etc.
STEP7 After the title release
If you want to use LipSync Tools to add voices, etc., you will need to sign a new contract. Please contact our sales representative. *People who use CRIWARE will also be charged. *From January 2024, if you are using CRIWARE, you will be able to use LipSync Tools free of charge even after the title is released.
Topics
CEDEC2019 (in Japanese)
The session videos and presentation materials for CRI's sponsored session "Make characters more attractive! Lip sync middleware for games," which was attended by a large number of visitors at CEDEC 2019, are now available.
Session video
![[CEDEC2019] Make your characters more attractive! Lip sync middleware for games](https://game.criware.jp/wp-content/uploads/2025/01/cedec2019_thumb.png)
Download the presentation materials
Trial Application
Please use the inquiry form to let us know your desired product, platform, engine, etc.
For inquiries regarding contracts and fees, please use the form below.
