Our crawler never sleeps: 26.3M pages indexed, 39.4M domains known, 280K+ new pages every day.

See the open web as we see it: cl0q.com/explore

#OSINT #webcrawl #searchengine #opendata

Our crawler never sleeps: 26.3M pages indexed, 39.4M domains known, 280K+ new pages every day.

See the open web as we see it: cl0q.com/explore

#OSINT #webcrawl #searchengine #opendata

Today's fun fact from our crawl: cl0q knows about 39.9M domains, but has fully indexed 26.2M. The gap between knowing a site and actually reading it is the whole job. We closed 283k pages of it in the last 24 hours. #webcrawl #search

39.6M domains, 150+ languages profiled — but 68.3% of the web speaks English. de 5.8%, zh 4.4%, es 3.7%. The long tail is quieter than you think. Every number is a free JSON endpoint, no key. cl0q.com/explore #OSINT #opendata #webcrawl