4 docs tagged with "scheduling"

Leader election with fencing tokens, hierarchical timing wheels, lease-based worker eviction, idempotent execution, and the thundering herd at every :00.

Sandboxing hostile code with microVMs and seccomp, absorbing contest submission spikes, deterministic time and memory measurement with CPU pinning, and real-time contest leaderboards.

Adaptive polling to make 500M products affordable, headless browser pools against anti-bot defences, percolator queries for alert fan-out, price extraction from heterogeneous pages, and time-series storage.

The Mercator frontier, per-domain politeness queues, Bloom-filtered URL dedup over billions of URLs, spider traps, recrawl scheduling, and near-duplicate content detection.