Back to problems

Handwrite Sigmoid, Softmax, and Attention

Algorithm · Amazon · Medium

Implement Sigmoid, Softmax, and Scaled Dot-Product Attention Medium · Math, Machine Learning, Linear Algebra · Company Tags · Hints Implement three core building blocks of modern neural networks from scratch using NumPy. You must handle batching and ensure numerical stability throughout without relying on high-level frameworks (e.g., TensorFlow or PyTorch). Every function must be fully vectorized: rely on broadcasting, np.matmul/einsum, and axis-aware reductions; no explicit…

Checking your access…