Machine Learning

2005 readers

2 users here now

founded 5 years ago

MODERATORS

[email protected]

How to convert a positionally encoded predicted embedding from a decoder to its matching token? (infosec.pub)

submitted 11 months ago by [email protected] to c/[email protected]

0 comments fedilink hide all child comments

When training a transformer on positionally encoded embeddings, should the tgt output embeddings also be positionally encoded? If so, wouldn't the predicted/decoded embeddings also be positionally encoded?

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here