Crawling the web to build a list of local news websites?
How can I use Python (or is there a better tool) to crawl the web and generate a thorough list of local news websites by cities and towns with their urls? Would also be good to find other news websites that are not affiliated with any specific city or town as a separate query.