摘要
信息时代,计算机技术等相关信息技术得到了空前发展,而网络信息技术已经成为科技发展过程中非常重要的一部分。网络爬虫技术得到了普及,更多个人用户使用网络爬虫技术在网站中获取信息,对目标网站的运营造成了一定影响。基于此,一些网站采取了相应措施,比如反爬虫技术,防止网络爬虫。笔者分析了网站的一些反爬虫策略,并提出几点见解。
In the information age,computer technology and other related information technologies have been unprecedented development,and network information technology has become a very important part of the development process of science and technology.Web crawler technology has been popularized.More individual users use Web crawler technology to obtain information on the website,which has a certain impact on the operation of the target website.Based on this,some websites have taken corresponding measures,such as anti-crawler technology,to prevent network crawlers.The author analyses some anti-crawler strategies of the website and puts forward some opinions.
作者
刘清
Liu Qing(Dongguan Science & Technology School,Dongguan Guangdong 523470,China)
出处
《信息与电脑》
2019年第3期23-24,共2页
Information & Computer
关键词
网络爬虫
反爬虫
抓取策略
web crawler
anti-crawler
crawling strategy
