Introduction

EleutherAI share a very useful blogpost summarizing important equations about transformer language models, with a primary focus on training cost.