smach,
@smach@masto.machlis.com avatar

“The general problem of mixing data with commands is at the root of many of our computer security vulnerabilities.” Great explainer by security researcher Bruce Schneier on why large language models may not be a great choice for tasks like processing your emails.
https://cacm.acm.org/opinion/llms-data-control-path-insecurity/

kellogh,
@kellogh@hachyderm.io avatar

@smach yay! i had the same thought a while ago. if you can separate the data & control, you can make it safe

https://timkellogg.me/blog/2024/01/11/application-phishing

kellogh,
@kellogh@hachyderm.io avatar

@smach after writing that, i found out about control vectors, which is sort of close, but the control still goes through the same channel as data https://vgel.me/posts/representation-engineering/#Control_Vectors_v.s._Prompt_Engineering

  • All
  • Subscribed
  • Moderated
  • Favorites
  • LLMs
  • GTA5RPClips
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • ethstaker
  • osvaldo12
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • ngwrru68w68
  • kavyap
  • normalnudes
  • cisconetworking
  • JUstTest
  • InstantRegret
  • khanakhh
  • cubers
  • everett
  • Durango
  • tacticalgear
  • anitta
  • modclub
  • Leos
  • tester
  • megavids
  • provamag3
  • lostlight
  • All magazines