Everyone is going bananas about looped transformers. My thought is it would be really good to keep those weights in sram and avoid fetching from memory if you’re just going to loop over and over again…. If only there was a way to pull that off.
