[Academic Paper] Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?

Abstract: Instruction-tuned Large Language Models (LLMs) have achieved breakthrough results, opening countless new possibilities for many practical applications. However, LLMs lack elementary safety features that are established norms in other areas of computer science, such as the separation between instructions and data,...