Layla v5.6.0 has been published!
- Layla
- 5 days ago
- 2 min read
I am excited to announce the support for Live2D models in Layla!
Bring your characters to life with animated characters that respond to input in real-time.
Here's a few videos on how those characters look!
For more information how this works, read here: https://www.layla-network.ai/post/how-to-import-live2d-models-in-layla
Live2D models respond to your input in real-time; try shaking your phone to see how your character reacts!
Additionally, your models are lip-synced to output audio. Normal characters play their talking animations when sound starts, lip sync goes a step further: their lips only move if there is corresponding output audio played through your speaker, which means their lips will stop moving if there are pauses during talking, giving a much more natural feel (only activated if your model supports it, most models DON'T, the only few free ones I found that supports it are linked below).
Voice Chat has been updated
The Voice Chat mini-app has been updated to v2. It uses the latest Kroko-ASR model for offline speech-to-text. It is fast, efficient, and lightweight; perfect for mobile use.
Combined with animated models, it will really bring your characters to life!
Full changelog
New features:
Layla supports Live2D models! Take your characters to the next level with customisable animated models!
smooth animations
responds to your phone (shake your phone to see how your character reacts!)
links expressions with Layla's sentiment system to change animations based on your conversations
lip sync with output audio
Demos:
voice chat with Niziiro: https://youtube.com/shorts/AuImK7wKmqs
chat with Anya from Spy x Family! https://youtube.com/shorts/dzLQ_QHUQl8
how to link expressions to sentiments: https://youtube.com/shorts/yEAGmVitX4I
demo of a random character: https://youtube.com/shorts/NilScswXX5A
Improvements:
added a few user requested QNN Stable Diffusion models
added support for Kroko ASR (speech-to-text model, this is now the default STT model in Layla)
ability to configure KV Cache quantisation settings in Advanced Settings
set "show nsfw" option now hides any characters tagged with nsfw
added French, Portuguese, and Spanish UI translations
Bug fixes:
fixed bug where the correct number of characters in Roleplay was not showing
fixed bug where chat images cannot be expanded when tapped on
fixed bug where slightly moving your finger during hold-to-speak mode stops Layla from listening
fixed bug where sometimes phone native voices are not being shown or not working in text-to-speech