#1 28 Aug 2018 01:24

id1010terror
New Member
Registered: 28 Aug 2018
Posts: 1

Downloading the entire ss64 site for personal offline use

Hello Forum,
I'll be going to a location where my internet connection is likely to go down for unknown periods of time and I would like to have a copy of this site on an external drive (not for hosting only anywhere else).

I've reviewed the sites copywrite page which explicitly states you can copy, share, and remix the pages hosted on SS64, but I wanted to verify whether it would be an issue for me to mirror the entire site using something like HTTrack?

Doing this creates many simultaneous connections, it could potentially strain weaker servers and look like malicious activity. (I'd hate to be Auto-blocked from this site)

My question: Are there any recommended guidelines for performing a site mirror? or better yet are there any current copies of the site already floating around, perhaps a torrent?


Thanks
- Jay

Offline

#2 28 Aug 2018 19:02

Simon Sheppard
Super Administrator
Registered: 27 Aug 2005
Posts: 976
Website

Re: Downloading the entire ss64 site for personal offline use

This shouldnt be a problem if you keep the number of simultaneous connections to about 5. I don't have any automatic IP blocking in place.

There are thousands of pages under the Oracle section, so if you dont need those you might want to exclude /ora/ just to speed things up.

In a typical week there are one or two people who scrape everything in addition to all the usual search bot visits and the server hasnt fallen over yet smile

Thanks for asking.

Offline

Board footer

Powered by FluxBB