all a / b / c / f / h / j / jp / l / o / q / s / sw / lounge cgi up wiki
[Settings] [Home] [Contact] [Catalog] [Search] [Thread list] [Report] [Watcher] [PMs] [Admin]
[Return]

Report a post

Preview
No.136945 [Report] +
▶
Here's a host-level list of a 293 million websites (5.3 GB download, extracts to 20 GB txt file):
https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2025-jan-feb-mar/host/cc-main-2025-jan-feb-mar-host-ranks.txt.gz
Some text editors like Notepad++ will need 24GB+ RAM to open the file, but I'm sure there are programs/scripts that can search through it without loading it all into RAM. The domains are backwards like "com.fc2web.nigger" instead of "nigger.fc2web.com".

8347 matches for com.fc2web
180 matches for net.55street
393 matches for com.fc2.kt
Post number No.136945
Board Off-Topic@Heyuri
Optional. Describe what's wrong with it.