New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Large Model causing performance degradation? #186

Open

ewwink opened this issue Mar 10, 2024 · 0 comments

ewwink commented Mar 10, 2024

tested with 2x GPU Tesla T4, transcribing 120 seconds voice

whisper-jax GPU

model openai/whisper-large-v3: 6 Gb
2nd run: 12.5 second

faster-whisper GPU

model Large-v3: 3 Gb (CTranslate )
2nd run: 7.7 second

whisper-jax TPU V3 x8

second run: 4 second

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment