Monsters at the gate: When softbots visit web search engines

Bernard J. Jansen*, Amanda S. Spink, Jan Pedersen

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

2 Citations (Scopus)

Abstract

There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60% of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.

Original languageEnglish
Pages620-626
Number of pages7
Publication statusPublished - 2003
Externally publishedYes
EventProceedings of the International Conference on Internet Computing, IC'03 - Las Vegas, NV, United States
Duration: 23 Jun 200326 Jun 2003

Conference

ConferenceProceedings of the International Conference on Internet Computing, IC'03
Country/TerritoryUnited States
CityLas Vegas, NV
Period23/06/0326/06/03

Keywords

  • Agents
  • Softbots
  • Web searching

Fingerprint

Dive into the research topics of 'Monsters at the gate: When softbots visit web search engines'. Together they form a unique fingerprint.

Cite this