LLMs are incredibly bad at any math because they just predict the most likely answer, so if you ask them to generate a random number between 1 and 100 it’s most likely to be 47 or 34. Because it’s just picking a selection of numbers that humans commonly use, and those happen to be the most statistically common ones, for some reason.
doesn’t mean that it won’t try, it’ll just be incredibly wrong.
Because it’s just picking a selection of numbers that humans commonly use, and those happen to be the most statistically common ones, for some reason.
The reason is probably dumb, like people picking a common fraction (half or a third) and then fuzzing it a little to make it “more random”. Is the third place number close to but not quite 25 or 75?
LLMs are incredibly bad at any math because they just predict the most likely answer, so if you ask them to generate a random number between 1 and 100 it’s most likely to be 47 or 34. Because it’s just picking a selection of numbers that humans commonly use, and those happen to be the most statistically common ones, for some reason.
doesn’t mean that it won’t try, it’ll just be incredibly wrong.
Son of a bitch, you are right!
I got 42, I was disappointed
I did too. Maybe that one is #3 most common
now the funny thing? Go find a study on the same question among humans. It’s also 47.
That’s how the AI ended up with the same answer. They don’t make up their own answers you know, they’re copying things humans said.
The reason is probably dumb, like people picking a common fraction (half or a third) and then fuzzing it a little to make it “more random”. Is the third place number close to but not quite 25 or 75?