It’s an encoder-decoder transformer trained on audio (language?) and transcripti... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

big_toast 10 months ago | parent | context | favorite | on: I think nobody wants AI in Firefox, Mozilla

It’s an encoder-decoder transformer trained on audio (language?) and transcription.

Seems kinda weird for it not to meet the definition in a tautological way even if it’s not the typical sense or doesn’t tend to be used for autoregressive token generation?

uoaei 10 months ago [–]

Is it Transformer-based? If not then it's a different beast architecturally.

Audio models tend to be based more on convolutional layers than Transformers in my experience.

big_toast 10 months ago | [–]

The openai/whisper repo and paper referenced by the model card seem to be saying it's transformer based.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact