A museum guide is talking to a group about the dinosaur fossils on exhibit.
"This one," he says, "Is 6 million and 2 years old."
"Wow," says a patron, "How do you know the age so accurately?"
"Well," says the guide, "It was 6 million years old when I started here 2 years ago."
From Wikipedia: this is only a 1-sigma result compared to theory using lattice calculations. It would have been 5.1-sigma if the calculation method had not been improved.
Many calculations in the standard model are mathematically intractable with current methods, so improving approximate solutions is not trivial and not surprising that we've found improvements.
"We are about to train models that are 10 times larger than the cutting edge GPT-4 and then 100 times larger than GPT-4. That’s what things look like over the next 18 months."
Apparently Inflection AI have bought 22,000 H100 GPUs. The H100 has approximately 4x the compute for transformers as the A100. GPT4 is rumored to be 10x larger than GPT3. GPT3 takes approximately 34 days to train on 1024 A100 GPUs.
So with 22,000*4/1024=85.9375x more compute, they could easily do 10x GPT4 size in 1-2 months. Getting to 100x the size would be feasible but likely they're banking on the claimed speedup of 3x from FlashAttention-2, which would result in about 6 months of training.
It's crazy that these scales and timelines seem plausible.
This is an essay about the Barbie brand and its relationship to feminism and capitalism through history and the modern day. The Barbie movie is discussed but it's not the primary focus.
I almost put The Fifth Season down after the first chapter, I remember thinking: "This author has a chip on their shoulder". I'm glad I persevered though, and I definitely recommend the series to people as it is quite different. I'd suggest giving it another shot.
Oh certainly, that series took quite a risk on writing style and it's quite divisive.
If you enjoy fantasy, you could try her other series as an alternative. The Inheritance Trilogy is a more standard writing style.
Babylon 5 creator J. Michael Straczynski has revealed that a single executive put Babylon 5 on the back burner... but now they've retired, the "floodgates opened".
As a counterpoint to other comments here, I didn't like Babylon 5. I gave up in the first season on the episode about religions, where each alien race shows a single religion but then humanity shows an enormous number of them.
Showing planets in sci fi as homogenous is a common trope, but such a simplistic take. This resonated poorly with me as I felt the aliens all behaved exactly like humans as well, to the point where you have stand-ins for Jehovah's witnesses. That episode cemented for me the feeling I had when watching. Babylon 5 is racist against aliens.
One developer asked ChatGPT to finish George R.R. Martin's long-stalled book series, A Song of Ice and Fire, upon which the Game of Thrones TV show is based. And the AI did...well, not too bad. But don't expect it to replace Martin anytime soon, either.
Claude 2 would have a much better chance at this because of the longer context window.
Though there are plenty of alternate/theorised/critiqued endings for Game of Thrones online, so current chatbots should have a better shot at doing a good job vs other writers who haven't finished their series in over a decade.
We do not include any examples where the chosen response was unsafe and the other response safe, as we believe safer responses will also be better/preferred by humans.
The paper focuses pretty strongly on safety, to the point where they explicitly throw away human evaluations if the humans don't also value safety above all else. I wonder if they compared the model with/without those responses.
Perfectly Preserved Dinosaur Embryo Found Inside Fossilized Egg (www.iflscience.com)
[Artist: MrCandy] [AI: StableDiffusion 1.5] Accidental Yumi fanart
Real-Time Radiance Field Rendering (huggingface.co)
Achieves SOTA on quality AND on training time AND renders in real-time (60fps+)
Divide & Bind technique for generative image models (sites.google.com)
Greatly improves Stable Diffusion's issues of missing objects and mixing up attributes
Scientists at Fermilab close in on fifth force of nature (www.bbc.co.uk)
cross-posted from: lemmy.zip/post/1293808...
CALM: Conditional Adversarial Latent Models for Directable Virtual Characters (research.nvidia.com)
Siggraph 2023, Nvidia improves on their previous research into controllable, natural movement learnt from unlabelled data. Code and paper available.
'Barbie' Makes Greta Gerwig 1st Female Director with Billion-Dollar Movie (www.tmz.com)
Greta Gerwig is in a league of her own as the first solo female director whose movie has made $1 billion.
OC When you ask someone to check your code
OC The midpoint of the debugging journey
Interview with Inflection AI co-founder and CEO Mustafa Suleyman (www.barrons.com)
"We are about to train models that are 10 times larger than the cutting edge GPT-4 and then 100 times larger than GPT-4. That’s what things look like over the next 18 months."
RT-2: DeepMind robotic research based on PaLM visual language models (www.deepmind.com)
Up to 100% improvement on unseen tasks, environments, and backgrounds
OC Looking at the code for a legacy project
OC The scope creep is coming from inside the house
Universal and Transferable Attacks on Aligned Language Models (llm-attacks.org)
The Plastic Feminism of Barbie - VerilyBitchie [27:17] (www.youtube.com)
Massive galaxy with no dark matter is a cosmic puzzle (www.space.com)
"This result does not fit in with the currently accepted cosmological models, which include dark matter."
Sci-fi you couldn’t get into?
What’s a piece of SF that you just couldn’t get into, even though you feel like you should?...
OC Die with dignity, for goodness sake
OC C, can we have closures?
Babylon 5 Creator Says a Single Warner Bros. Executive Stopped the Show’s Comeback for Close to 20 Years (www.ign.com)
Babylon 5 creator J. Michael Straczynski has revealed that a single executive put Babylon 5 on the back burner... but now they've retired, the "floodgates opened".
Someone Used ChatGPT to Finish the Game of Thrones Book Series - IGN (www.ign.com)
One developer asked ChatGPT to finish George R.R. Martin's long-stalled book series, A Song of Ice and Fire, upon which the Game of Thrones TV show is based. And the AI did...well, not too bad. But don't expect it to replace Martin anytime soon, either.
Introducing Llama 2 - Meta's Next-Generation Commercially Viable Open-Source AI & LLM (paper from 18.07.2023)
cross-posted from: lemmy.world/post/1750098...