Tag: ssl

Dear #1 search engine, please, even for research purposes, do adhere to robots.txt, and even better, don’t use SSL interface to scrap / spider Wikipedia. We have single server for that purpose, and you seem to have somewhat more. On the other hand, you may donate us few nice SSL-proxying appliances. Thank you.