LeetCode Question · Jul 2020 · USA

Designing a distributed web crawler

Data Eng System Design Intern Easy
22 upvotes 6,555 views 5 replies

Question Details

Summary Design a web crawler that fetches every page on en.wikipedia.org exactly 1 time. You have 10,000 servers you can use and you are not allowed to fetch a URL more...

Full Details

🔒

Unlock full leaked content

Full insider details, leaked discussions, and candidate experiences.

Get Premium →

Topics

Binary Search Binary Tree Hash Table Queue Sql Stack System Design Trie