3 points
Well there is the asus AI Accelerator card but that’s just 8 coral TPUs. I think the real reason why we don’t see large TPUs is because nvidia cards has had tensor cores built into the architect since Volta and with a GPU you don’t have to worry about system memory speed since you have 80Gb of HBM.