bornach, 18 days ago

@highvizghilliesuit @KathyReid
Just do an internet search on Transformers, "Attention is all you need", GPT, BERT, etc. There are many great tutorials covering different levels of detail. This video is more of an overview:
https://youtu.be/Rx-5AGHNu7M

They do in fact encode the copyrighted work into their neural network weights and biases, and can be prompted to regenerate entire passages of text.
https://www.patronus.ai/blog/introducing-copyright-catcher

But it is all linear algebra under the hood