Microsoft LLM Embedding Table and LM Head Sharding System Design Interview Experience

Round 1: LLM Distributed Systems / System Design Discussion The session centered on how to distr