Advancements in Artificial Intelligence

Articles

• AI Supercomputers

  Since 2019, AI supercomputers have seen their computational performance grow 2.5x annually, enabling much faster training times for models like GPT-3, but this has come with a sharp increase in hardware costs (1.9x annually), power consumption (over 20x for Colossus compared to 2019's Summit), and a shift towards private sector dominance in computing capacity.