使用請求維護 Web 抓取會話
保持網路抓取會話以保持 cookie 和其他引數是個好主意。此外,由於 requests.Session
將底層 TCP 連線重用於主機,因此可以提高效能 :
import requests
with requests.Session() as session:
# all requests through session now have User-Agent header set
session.headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36'}
# set cookies
session.get('http://httpbin.org/cookies/set?key=value')
# get cookies
response = session.get('http://httpbin.org/cookies')
print(response.text)