kyutai.org/aura - AURA is a 1.3B speech-to-video generative model that runs in real time on a single H100 GPU at 576px resolution.
AI & ML interests
Our mission is to build and democratize artificial general intelligence through open science
Recent Activity
Papers
AURA: AUdio-dRiven streaming Avatar
MuScriptor: An Open Model for Multi-Instrument Music Transcription
Organization Card
Kyutai [kjutaɪ] - Open Science AI Lab
This is the organization of Kyutai, an Open Science AI lab based in Paris, France and created in November 2023.
On this page, we release our model weights and datasets. Please check our website for a list of projects, publications and demos of our models.
- Website: kyutai.org
- Github: github.com/kyutai-labs
spaces 6
Running
Agents
4
CASA Gallery
🏠
Video Gallery for CASA: Cross-Attention over Self-Attention
Running
15
Hibiki Zero Samples
🏆
Demo samples of the speech translation model Hibiki-Zero.
Running
6
CALM Samples
🤗
Running
1
Unmute Samples
💻
Examples of conversations with Unmute (unmute.sh)
Running
56
Hibiki Samples
🤗
Translate spoken audio instantly into another language
models 97
kyutai/AURA-1.3B-Teacher-TalkVerse
Image-to-Video • Updated • 1
kyutai/AURA-5B
Image-to-Video • Updated • 4
kyutai/AURA-1.3B
Image-to-Video • Updated • 7
kyutai/pocket-tts-without-voice-cloning
Updated • 11.8k • 45
kyutai/pocket-tts
Updated • 1.45k • 1.91k
kyutai/reki-2b
Robotics • 2B • Updated • 128 • 8
kyutai/reki-2b-robocasa365
Robotics • 2B • Updated • 151 • 1
kyutai/reki-2b-robotwin-cleanrand
Robotics • 2B • Updated • 32 • 1
kyutai/reki-2b-robotwin-clean
Robotics • 2B • Updated • 36 • 1
kyutai/reki-2b-libero
Robotics • 2B • Updated • 318 • 2
datasets 13
kyutai/AURA-Dataset
Viewer • Updated • 30.2k • 1
kyutai/interactivity-alignment-samples
Viewer • Updated • 5.56k • 868 • 10
kyutai/librispeech-enhanced-voice-prompts
Updated • 655 • 1
kyutai/hifitts2-aligned
Viewer • Updated • 11.3M • 324 • 3
kyutai/ARC_finetuning
Preview • Updated • 67 • 1
kyutai/rocket-science
Updated • 654 • 62
kyutai/KairosQA
Viewer • Updated • 7.17k • 213 • 1
kyutai/HaluEvalAudio_1000
Viewer • Updated • 1k • 148 • 1
kyutai/Audio-NTREX-4L
Viewer • Updated • 3.6k • 287 • 6
kyutai/librispeech_test_clean_enhanced
Viewer • Updated • 448 • 152 • 1