发明名称 System and method for dynamically limiting robot access to server data
摘要 A method for automatically limiting access of a client computer to data objects accessed through a server computer dynamically prevents robots or webcrawlers from obtaining too much of the server database and from dramatically reducing server performance. The method includes the steps of receiving a request for a data object, recording a log entry for the request, calculating client request values, and refusing the request if a client request value exceeds one of a set of corresponding predefined maximum request values. Each log entry contains a client identifier, timestamp, and at least one data object identifier for the request. The client request values preferably include a request frequency, which is compared with a predefined maximum request frequency, and a cumulative data request, which is compared with a data access threshold. If the client is refused access, the client identifier is added to a deny list, and future requests from the client are automatically denied. The calculated cumulative data request may be for a single client, or it may be for all clients, in order to detect a robot that is divided among multiple client identifiers. The cumulative data request check may consider the total percentage of server resources being given away, or a pattern in the requests. Also provided is a data protection system containing a log file, a request analyzer, and a dynamically-generated deny list. Requests to the server are intercepted and sent to the data protection system first.
申请公布号 US6662230(B1) 申请公布日期 2003.12.09
申请号 US19990421978 申请日期 1999.10.20
申请人 INTERNATIONAL BUSINESS MACHINES CORPORATION 发明人 EICHSTAEDT MATTHIAS;EMENS MICHAEL LAWRENCE;KRAFT REINER
分类号 G06F21/00;H04L29/06;(IPC1-7):H04L9/00 主分类号 G06F21/00
代理机构 代理人
主权项
地址