Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
UTMOS
anchor
Findings
IC-234
SpeechGPT exhibits poor speech-text alignment (ASR-WER 45.00) and degraded response quality in speech-to-speech interaction
[eval]
IC-235
Salmonn and Qwen2-Audio produce responses containing formatted content and redundant explanations that are unsuitable for speech interaction
[eval]