I thought these neural network things are basically non algorithmic, beating a numeric soup until it solves problems while leaving the how an open research question.

Neural networks are hyper-algorithmic. Every "neuron" in a neural network is its own algorithm. AI is all algorithms.