With all the valid concern around #llm and #genai power and water usage, I thought I'd start a blog series on tiny LLMs. Let's see what they can do on real tasks on very power efficient hardware.
The impact from smaller opensource LLMs like Llama3-8B and Phi-3 could be large. They are not necessarily the best and smartest models but can be easily integrated in software on every device and platform. Also they can be finetuned, improved with RAG to function better for specific tasks and in specific contexts. Exciting times ahead. #opensource#LLM#AI#Llama#Phi
Proving once again what lying bastards they are, #LockBit hit St. Anthony Hospital (Chicago) on December 18 and exfiltrated some patient data. The hospital hasn't confirmed how much yet, and they make no mention of any #encryption of files. LockBit seems to be demanding $800k ransom/extortion to delete the files.
Tell me your #LLM has been trained using cishet data, not vetted for diversity & inclusion, without telling me your LLM has been trained using cishet data & vetted for diversity & inclusion. #Phi#Phi2
On Christmas Eve, Integris Health in Oklahoma was sending emails to patients and issuing notices about an attack by threat actors in November who were allegedly contacting patients directly.
According to their notices, the threat actors did not lock/encrypt anything but did exfiltrate files with #PHI
Affected #PII and #PHI of Clay County residents as well as other Minnesota counties' residents who used Social Services.
Interesting disclosure in terms of sharing investigation details. It doesn't come out and say directly whether they paid or not, but tells people they can request the full investigation details report.
The Perry Johnson & Associates (PJ&A) breach that affected 1.2 million patients of Cook County Health in Illinois also affected millions of Northwell Health patients on Long Island,
PJ&A is a medical transcription service so lots of #PII and #PHI appear to be involved in this one.
The actual breach/exfil occurred months ago. So far, I've not found any attribution, any indication of any extortion/ransom demand, or any group claiming responsibility for this one.
Repeat after me: "Date of discovery" does NOT mean the date you completed any investigation. It is the date on which you first knew or reasonably should have known that you had a breach of unsecured PHI.
It is not a huge breach as breaches go, but Sightpath Medical's breach notification raises a lot of questions about compliance with HIPAA's Breach Notification Rule. I hope #HHSOCR investigates this one.
RiteAid was just one of many victims of the #MOVEit#databreach by #Clop. Now they're being sued by plaintiffs who call them "reckless" and "negligent" for not having encrypted the protected health information.
Imagine if every covered entity or business associate who didn't encrypt #PHI got hacked was sued over a vendor breach.
In this day and age where healthcare entities are under siege, is it somewhat reckless or negligent not to encrypt? And if not, will it ever be generally considered reckless and negligent?
Nice paper, the future is not only for large, compute intensive, large language models, with billions of parameters. People are also working on smaller, more specialised models , using higher quality data. https://arxiv.org/abs/2306.11644 #generativeAI#LLM#Phi
lol, I just stumbled across @TomF's blog post on #Larrabee, Intel's GPU project prior to #ARC.
It's widely parroted that #Intel#Phi is Larrabee without the texture units, but more accurately the Phi chip still has them, they're just unused (there's even DVI pins).
It makes me wonder to what degree they're disabled? Could a low level driver access them, or a modified firmware? 🤔
A proposed settlement of $988,550 has been reached in a class-action lawsuit relating to patient health records being wrongfully accessed by former employees at the Peterborough Regional Health Centre more than a decade ago:
Nokowaya also has some listings I have not seen elsewhere, including a data dump with sensitive info allegedly from Wyoming County Community Health System in New York. They claim to have exfiltrated 150 GB of files.
There is no notice on the health system's site. I have reached out to them and will update when I find out more.