NumPy Top-p Sampling and Multi-Head Attention

Requirements Work in a Google Colab or another notebook-based coding environment while sharing your screen. You will receive starter code; utilities such as softmax might already exist. A test suite will be available, and the objective is to make the tests pass within the 60-minute session. Write top-p, also called nucleus, sampling with NumPy. Write single-head attention with NumPy. Build a NumPy multi-head attention implementation from the single-head version. Favor…