Our most effective AI/ML systems are so called “black boxes” – their inner workings cannot be traced and their decisions cannot be explained. Thus, we are building things we do not fully understand. To us, these predictive systems are unpredictable.
The ultimate “black box” is human thought and consciousness. One day we may succeed in creating artificial consciousness but still not be any closer to understanding it. Then, even gods will be captivated by the mystery of consciousness.