#quadratic-attention

Beyond the Transformer: The New AI Architecture Wars

Is the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem.