Are you saying that a computer, where everything is based on mathematics, fails in its main function, which is to perform mathematical calculations?
Yes, because if you build a program, where 2+2 is not 4, but "almost 4", or when it can guess your age, based on your age, with 99% success rate, then it can fail in some cases.
Calculating hash functions is a good example, to show, that AIs cannot count things. They treat all numbers in the same way as words. And if you have written sentences, then it doesn't matter, if you write "big" or "enormous", or if you swap some words or sentences. It would still be good. But in math, many things have to be exact, and equal to certain things.
ChatGPT 5.2
"print first five rounds of SHA-1 of the empty message"
SHA-1: da39a3ee5e6b4b0d3255bfef95601890afd80709
Ronda 0: A=1FB498B3 B=67452301 C=7BF36AE2 D=98BADCFE E=10325476
Ronda 1: A=5D43E370 B=1FB498B3 C=59D148C0 D=7BF36AE2 E=98BADCFE
Ronda 2: A=158D2F62 B=5D43E370 C=C7ED262C D=59D148C0 E=7BF36AE2
Ronda 3: A=CDECFB5D B=158D2F62 C=1750F8DC D=C7ED262C E=59D148C0
Ronda 4: A=4953565E B=CDECFB5D C=85634BD8 D=1750F8DC E=C7ED262C
See? Even the zero round is totally wrong, not to mention next ones. In my example, at least the initialization vector is correct.
if it has the necessary information or understands the request made - that's where it will fail the least
But it doesn't "have the necessary information". And it doesn't "understand the request made".
If you type "2+2", then you could write "two plus two", and it would be treated in the same way. For AIs, all numbers are just words, treated in the same way, as all other tokens.
So, people make the same mistake, as they did decades ago. When complex math equations were solved correctly, people assumed, that understanding human emotions, or creating complex images, would be a piece of cake. But it turned out to be extremely difficult. And now, if AI can produce a lot of text, then people assume, that it would be good at math, just because there is a lot of software, that can do all of that, without any AI. But the practice tells otherwise. If you play chess with Stockfish, it will win every time. But if you play chess with ChatGPT, or other AIs, then these models will make a lot of illegal moves, and will not be able to even show you the current state of the board correctly.