程序師世界是廣大編程愛好者互助、分享、學習的平台,程序師世界有你更精彩!
首頁
編程語言
C語言|JAVA編程
Python編程
網頁編程
ASP編程|PHP編程
JSP編程
數據庫知識
MYSQL數據庫|SqlServer數據庫
Oracle數據庫|DB2數據庫
您现在的位置: 程式師世界 >> 編程語言 >  >> 更多編程語言 >> Python

How does a python crawler send a request until the server responds?

編輯:Python

There is a need , Crawl general websites direct requestes.get(url) You can get the response , At present, the problem I encounter is that my target server is very unstable , Sometimes the request will be directly reported 502 Gateway error ( This problem also occurs when the web page is accessed normally ), I got all the addresses I wanted to request , Use an asynchronous method to request one by one , How to make it continue to request after encountering errors , Until the normal data is returned , Instead of not executing the request after encountering an error .


  1. 上一篇文章:
  2. 下一篇文章:
Copyright © 程式師世界 All Rights Reserved