Open-source speech recognition toolkit from Alibaba (Tongyi Lab, ModelScope) with streaming, speaker diarization and emotion recognition.

pyannote.audio overview and key facts (October 2026)
Open-source Python toolkit for speaker diarization (who speaks when), maintained by the French company pyannoteAI.
What is pyannote.audio?
pyannote.audio is an open-source Python toolkit that identifies who speaks when in a recording, used as the speaker diarization layer in many transcription pipelines and maintained by pyannoteAI in France.
The toolkit provides neural building blocks for voice activity detection, speaker change detection, overlapped speech detection and speaker embeddings. The open community-1 pipeline runs locally after accepting its conditions on Hugging Face. pyannoteAI also sells premium precision models through a cloud API and for deployment in your own infrastructure, which it describes as faster and more accurate. The website reports more than one billion downloads of the open-source framework. The GitHub API showed about 10,600 stars and a push on September 24, 2026.
pyannote.audio AI features and use cases
- Labels speakers in recordingsThe diarization pipeline splits audio into segments and assigns each to a speaker. Combined with a transcription model, minutes and interview transcripts show who said what.
- Detects overlapping speechOverlap detection finds passages where several people talk at once. Transcripts of lively meetings become more accurate, and reviewers see where to listen again.
- Adapts to your own audioThe models can be fine-tuned on your own data, according to the README. Teams with special recording conditions, such as call centers, can improve accuracy.
What sets pyannote.audio apart
- Focused on speaker diarization rather than transcription, and used as a component by other tools such as WhisperX.
- Same interface for the free open pipeline and pyannoteAI's paid precision models, in the cloud or self-hosted.
Where pyannote.audio is strongest
The project is maintained by pyannoteAI; its GitHub organization lists France as its location.
Questions to ask before you buy pyannote.audio
Voice recordings and speaker embeddings are personal data; embeddings can count as biometric data under GDPR, so check the legal basis before identifying people. The open pipeline requires accepting model conditions on Hugging Face. For the paid API, ask pyannoteAI for prices, hosting location and a data processing agreement.
Using pyannote.audio in the EU: GDPR and AI Act
- Data locationNot published by the vendor.
- Data processing agreementNot published by the vendor: ask for one (Art. 28 GDPR).
- EU AI ActCheck whether the AI prepares decisions about people. If not, the high-risk rules usually do not apply. The high-risk obligations apply from December 2, 2027 (Digital Omnibus).
pyannote.audio reviews
No reviews yet. Be the first to share how your team uses it.
Every review shows its verification level. We read each one before it goes live. How we check reviews
Questions about pyannote.audio
Is pyannote.audio free?
The toolkit is MIT licensed and the community-1 pipeline is free after accepting its conditions on Hugging Face. Premium precision models are paid.
Does pyannote.audio transcribe speech?
No, it detects who speaks when. For text you combine it with a transcription model such as Whisper.
Can I run it on my own servers?
Yes. The open pipeline runs locally, and pyannoteAI states that its premium models can also be deployed in your own infrastructure.
pyannote.audio update historyno updates yet
No changes recorded for pyannote.audio yet.
Changes the vendor made and confirmed user reports, each checked against the vendor's own pages. We review every tool monthly.
Alternatives to pyannote.audio
Tools in the same category (Image, video & audio) with the most overlapping markets.
Open speech recognition model from OpenAI under the MIT license for multilingual transcription, translation to English and language ID.
Open-source speech recognition based on Whisper with word-level timestamps and speaker diarization.


