Web Crawler with Communication Constraint

Problem Design a web-crawling system made up of 100 bots. A bot must not communicate directly with Lyft's internal infrastructure; every communication must be routed through a primary node. Create a crawler scheduler that coordinates the bots and enforces these communication requirements. The scheduler should expose an interface similar to: Constraints The system contains 100 bots. Bots cannot communicate directly with Lyft's internal infrastructure. Every communication must…