StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.
-
Updated
Jun 27, 2024 - Python
StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.
A fast speech-to-any translation model that supports simultaneous decoding and offers 28× speedup.
Repository containing the open source code of works published at the FBK MT unit.
Paper list of simultaneous translation / streaming translation, including text-to-text machine translation and speech-to-text translation.
Source code for ICLR 2023 spotlight paper "Hidden Markov Transformer for Simultaneous Machine Translation"
Source code for ACL 2023 paper "End-to-End Simultaneous Speech Translation with Differentiable Segmentation"
Official implementation for EMNLP 2023 paper "Non-autoregressive Streaming Transformer for Simultaneous Translation"
Code for the INTERSPEECH 2023 paper "Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models"
Code for EMNLP 2022 main conference paper "Information-Transport-based Policy for Simultaneous Translation"
Source code for our EMNLP 2022 paper "Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translation"
PyTorch toolkit for streaming speech recognition, speech translation and simultaneous translation based on fairseq.
Implementation of the paper "Anticipation-Free Training for Simultaneous Machine Translation"
Code for EMNLP 2021 oral paper "Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy"
Code for ACL 2022 main conference paper "Modeling Dual Read/Write Paths for Simultaneous Machine Translation"
Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"
Add a description, image, and links to the simultaneous-translation topic page so that developers can more easily learn about it.
To associate your repository with the simultaneous-translation topic, visit your repo's landing page and select "manage topics."