https://alexzhang13.github.io/blog/2024/efficient-dl/
A long and wide selection of topics around deep learning, with links and citations for everything.
This post offers a comprehensive and chronological guide to advances in deep learning from the perspective of efficiency: things like clusters, individual hardware, deep learning libraries, compilers — even architectural changes. This post is not a survey paper, and is intended to provide the reader with broader intuition about this field
I’d say it achieves that goal!