If you’r watching current trends, stack overflow is loosing ground to llms and fast. I feel that if this continues , it will become hard to keep paying the bills , and i hope it never happens but if stackoverflow has to close the books:
-will all this knowledge now be locked behind a llm-paywall or behind the walls of the companies that have trained these llm’s as they prolly have a copy of that data , but we the public dont.
-i was wondering if there is a project or a solution that is being worked on , to preserve this , as i really think , just like it is the case with research papers , this is invaluable , public domain, and defenetly for the benefit of mankind. and it would be a shame and disaster if it were lost. , if nothing exists maybe we should start building a failsafe, but the robots.txt prohibits crawling the tree so if a project was there perhaps the staff could allow its crawler some extra permissions on the site
i tried finding a mirror this site , or download all threads as an archive link on this site.
and/or i tried finding how big everything would be as plaintext(but hyperlinked)-html or as html.
i looked on thewaybackmachine (archive.org) and while it does have many snapshots, those many of them seem linked to the actual site and be gone aswell, and appart from being really slow , no search is possible as they only have the forntend not the backend of the site.
Hoefkens J. is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.