Btw this isn’t like to say programming TPUs is hard. It’s really not. We just don’t train engineers who can really optimize code anymore and the ones that do exist have knowledge in x86 or ARM and can’t really adapt to new hardware quickly. If you’re a hardware engineer or an embedded person it’s a lot easier to write kernels for new types of hardware.
