A museum guide is talking to a group about the dinosaur fossils on exhibit.
"This one," he says, "Is 6 million and 2 years old."
"Wow," says a patron, "How do you know the age so accurately?"
"Well," says the guide, "It was 6 million years old when I started here 2 years ago."
From Wikipedia: this is only a 1-sigma result compared to theory using lattice calculations. It would have been 5.1-sigma if the calculation method had not been improved.
Many calculations in the standard model are mathematically intractable with current methods, so improving approximate solutions is not trivial and not surprising that we've found improvements.
Apparently Inflection AI have bought 22,000 H100 GPUs. The H100 has approximately 4x the compute for transformers as the A100. GPT4 is rumored to be 10x larger than GPT3. GPT3 takes approximately 34 days to train on 1024 A100 GPUs.
So with 22,000*4/1024=85.9375x more compute, they could easily do 10x GPT4 size in 1-2 months. Getting to 100x the size would be feasible but likely they're banking on the claimed speedup of 3x from FlashAttention-2, which would result in about 6 months of training.
It's crazy that these scales and timelines seem plausible.
This is an essay about the Barbie brand and its relationship to feminism and capitalism through history and the modern day. The Barbie movie is discussed but it's not the primary focus.
Oh certainly, that series took quite a risk on writing style and it's quite divisive.
If you enjoy fantasy, you could try her other series as an alternative. The Inheritance Trilogy is a more standard writing style.
I almost put The Fifth Season down after the first chapter, I remember thinking: "This author has a chip on their shoulder". I'm glad I persevered though, and I definitely recommend the series to people as it is quite different. I'd suggest giving it another shot.
Claude 2 would have a much better chance at this because of the longer context window.
Though there are plenty of alternate/theorised/critiqued endings for Game of Thrones online, so current chatbots should have a better shot at doing a good job vs other writers who haven't finished their series in over a decade.
As a counterpoint to other comments here, I didn't like Babylon 5. I gave up in the first season on the episode about religions, where each alien race shows a single religion but then humanity shows an enormous number of them.
Showing planets in sci fi as homogenous is a common trope, but such a simplistic take. This resonated poorly with me as I felt the aliens all behaved exactly like humans as well, to the point where you have stand-ins for Jehovah's witnesses. That episode cemented for me the feeling I had when watching. Babylon 5 is racist against aliens.
We do not include any examples where the chosen response was unsafe and the other response safe, as we believe safer responses will also be better/preferred by humans.
The paper focuses pretty strongly on safety, to the point where they explicitly throw away human evaluations if the humans don't also value safety above all else. I wonder if they compared the model with/without those responses.
This looks amazing, if true. The paper is claiming state of the art across literally every metric. Even in their ablation study the model outperforms all others.
I'm a bit suspicious that they don't extend their perplexity numbers to the 13B model, or provide the hyper parameters, but they reference it in text and in their scaling table.
Why do you say they have no representation? There are a lot of specific bodies operating in the government, advisory and otherwise, with the sole focus of indigenous affairs. And of course, currently, indigenous Australians are over represented in terms of parliamentarian race (more than 4% if parliamentarians are of indigenous descent).