AI is just matrix multiplication and every now and then you send it through a squiggly function. That’s it. Everyone saying “oh bUt wHaT iF tHe aRcHiTeCTuRe cHaNgEs” is a midwit it’s 90% matmuls it doesn’t fucking matter we arent getting rid of matmuls… Now that being said memory is a different thing which innovation could destroy. But let’s see.
