You hit so many nails on the head with this article that you are going to need a new hammer.
Try asking someone to define intelligence. They won’t be able to or they will give a non answer for an answer. Next, read them your definition. I interspersed my own interpretation of parts in parentheses. “(Intelligence is) ..made up of probabilistic algorithms (that allow us to)…. make decisions based on our own experience throughout life. (It is) a simple system of probabilities that also includes (the ability to classify things into categories).” Now, ask the person if they think that is an inclusive and accurate definition. Most will no doubt laugh and say you are crazy, it is absurd to think such a simple system could constitute intelligence. Some might think about it deeply, and say that it could be on the right track, but there is definitely more to it. Are there some who would say, that’s it, you got it, that is absolutely intelligence? I doubt it, but maybe one or two do say that. It is only for those one or two people that artificial intelligence should exist, for that is (essentially) what it is. Yet for some reason the same people who would laugh off your (very good btw) definition of intelligence as absurd will look at you with a straight face and tell you about some grand thing AI has done or will soon do. Now that is absurd.
Great piece. Thank you.