[Settings] [Home] [Contact] [Catalog] [Search] [Thread list] [Report] [Watcher] [PMs] [Admin]
[Return]

Report a post

Preview

from urllib.parse import urlparse
from googlesearch import search

urls = [
# "55street.net",
# "easter.ne.jp",
# "finito-web.com",
# "ojiji.net",
# "zero-yen.com",
"fc2web.com",
# "k-free.net",
# "gooside.com",
# "ktplan.net",
# "kt.fc2.com",
# "zero-city.com",
# "k-server.org",
# "land.to"
]

results = search(f"site:*.{urls[0]}", num_results=10000, unique=True, safe=None, sleep_interval=5, region="ja")

parsed_urls = []
for s in results:
parsed_url = urlparse(s)
domain = f"{parsed_url.scheme}://{parsed_url.netloc}/"
parsed_urls.append(domain)
print(domain, flush=True)

unique_urls = list(set(parsed_urls))

filename = f"{urls[0]}.txt"
with open(filename, 'w') as file:
for url in unique_urls:
file.write(url + '\n')

print(f"saved {filename}")


>>136847
i tried similar with this py but google doesnt have many results.
archive.org cdx api wont return just subdomains either.
Post number No.136918
Board Off-Topic@Heyuri
Optional. Describe what's wrong with it.