The temperature scale, I think. You divide the logit output by the temperature before feeding it to the softmax function. Larger (resp. smaller) temperature results in a higher (resp. lower) entropy distribution.
Each row in the figure is a probability distribution over possible outputs (x-axis labels). The more yellow, the more likely (see the colour map on the right). With a small temperature (e.g., last row), all the probability mass is on 42. This is a low entropy distribution because if you sample from it you’ll constantly get 42, so no randomness whatsoever (think entropy as a measure of randomness/chaos). As temperature increases (rows closer to the first/topmost one), 42 is still the most likely output, but the probability mass gets dispersed to other possible outputs too (other outputs get a bit more yellow), resulting in higher entropy distributions. Sampling from such distribution gives you more random outputs (42 would still be frequent, but you’d get 37 or others too occasionally). Hopefully this is clearer.
Someone in another reply uses the word “creativity” to describe the effect of temperature scaling. The more commonly used term in the literature is “diversity”.
This actually sounds like a good proposal. Also, I disagree with the quoted comment. A system solution is miles better than regulation for the simple fact that people WILL break rules, no matter how you teach them not to.
Have you read the “About the film” section at the bottom?
When two young American Jews raised to unconditionally love Israel witness the brutal way Israel treats Palestinians, their lives take sharp left turns.
My employer is planning a new manufacturing plant. I work with some of the people designing it. They currently don’t have any plans to hook up to public transit, though there’s a commuter train station 3 miles away. It takes 20min to bike between them or 40min currently to take a bus. The area it’s in is extremely car...
Your implicit assumption here is that both criticisms and solutions are equally easy (or difficult) to make, which is obviously not true, hence the relative quietness.
How do you propose to get these independent LLMs? If both are trained using similar objectives e.g., masked token prediction, then they won’t be independent.
Also, assuming independent LLMs could be obtained, how do you propose to compute this hallucination probability? Without knowing this probability, you can’t know how many verification LLMs are sufficient for your application, can you?
Can you provide the source of a few of these completely different LLMs?
add even a small amount of change into an LLM […] radically alter the output
You mean perturbing the parameters of the LLM? That’s hardly surprising IMO. And I’m not sure it’s convincing enough to show independence, unless you have a source for this?
You seem very certain on this approach, but you gave no sources so far. Can you back this up with actual research or is this just based on your personal experience with chatgpt4?
Yes definitely. Many of my fellow NLP researchers would disagree with those researchers and philosophers (not sure why we should care about the latter’s opinions on LLMs).
it’s using tokens, which are more like concepts than words
You’re clearly not an expert so please stop spreading misinformation like this.
Many people literally die each year because of car-centric infrastructure, and you’re basically telling us to calm down? No fucking way.
Before cars, there used to be a massive amount of infrastructure for trains and streetcars, not to mention walkable neighbourhood, but they all get demolished for cars. So yes, we do operate like that.
And did I mention that car-centricity kills people each year? So yes, eliminate all cars if we have to. But honestly, I don’t think anyone wants to eliminate all cars, just those we don’t need (which is most of them).
You know the problem already: poor coverage of public transit. Why not advocate for that? It’s much safer than any cars, and we have the tech right now. We can stop killing people right now.
If the operating cost is as low as you said, why do you think these robotaxi companies wouldn’t eventually charge similar fare to normal taxis given that (1) the market can bear such fare now and (2) the reduced operating cost would give them higher profit margins?
Frankly, I’m not convinced yet that the operating cost is that much lower. Covering more areas and operating almost 24 hours a day sound like more fleet and more frequent maintenance to me. Wouldn’t these increase the operating cost, and thus, fare? Not to mention paying the engineers to maintain the software/AI system. I assume engineers are much more expensive than drivers.
I agree with what you said about price fixing and competition. But why do you think multiple robotaxi companies will survive in the (long) future? We know that’s not what happened with Uber/Airbnb that killed their competitors with predatory pricing. How do you know this time it would be different?
Thanks for the detailed cost breakdown. You seem to have thought about this deeply. But I don’t see labour cost (e.g., engineers) in the breakdown. Why did you not include it?
I agree that the battery cost (and thus operating cost) would go down, but again I’m not convinced it would mean lower fare because that’s not what usually happens. I also agree these companies know how much money will be made on self-driving systems, which is exactly why I think they would aim for a monopoly, and the one surviving would charge passengers as high as it can.
In you and your wife’s case, is using a normal taxi 5-6 times not cheaper than the second vehicle cost?
Anyway, from what you wrote, it seems the biggest issue here is cost/fare. In that case, public transit, which we already have and benefits all people (including both the elderly and people with disabilities), would be a better solution than any taxi.
Ask ChatGPT to pick a number between 1 and 100 (jlai.lu)
Amsterdam testing system that can remotely slow e-bikes down (nltimes.nl)
cross-posted from: lemmy.world/post/13081471...
Free online screening of “Israelism” in Australia (kinema.com)
From the event page:...
E-bike riders aren’t wearing helmets — and head trauma cases are through the roof (www.tomsguide.com)
How to argue for making a new plant public transit friendly
My employer is planning a new manufacturing plant. I work with some of the people designing it. They currently don’t have any plans to hook up to public transit, though there’s a commuter train station 3 miles away. It takes 20min to bike between them or 40min currently to take a bus. The area it’s in is extremely car...
Hallucination is Inevitable: An Innate Limitation of Large Language Models (arxiv preprint) (arxiv.org)
Abstract:...
Autonomous murderbot incinerated by SF Chinese New Year street partiers (www.jwz.org)