ProtT5 model generate

[BSharmi]

Hi there!

Was ProtT5 trained to predict just the masked position or the full sequence? When I use the
generate function with masked sequences I noticed the model returns full sequence. Is it the default behavior for a model trained on mlm task?

thank you very much

[mheinzinger]

Hi :)
yes, you are perfectly on spot: ProtT5 was trained on reconstructing the full sequence. Here is an example: #137 (comment)

[BSharmi]

Thank you!!