A Novel Cooperation and Competition Strategy Among Multi-Agent Crawlers

Authors

  • Yajun Du School of Mathematic and Computer Science, Xihua University, Chengdu
  • Yong Xu School of Mathematic and Computer Science, Xihua University, Chengdu
  • Min Wang School of Mathematic and Computer Science, Xihua University, Chengdu

Keywords:

Multi-agent, focused crawler, collaboration, contract net protocol, JADE

Abstract

Multi-Agent theory which is used for communication and collaboration among focused crawlers has been proved that it can improve the precision of returned result significantly. In this paper, we proposed a new organizational structure of multi-agent for focused crawlers, in which the agents were divided into three categories, namely F-Agent (Facilitator-Agent), As-Agent (Assistance-Agent) and C-Agent (Crawler-Agent). They worked on their own responsibilities and cooperated mutually to complete a common task of web crawling. In our proposed architecture of focused crawlers based on multi-agent system, we emphasized discussing the collaborative process among multiple agents. To control the cooperation among agents, we proposed a negotiation protocol based on the contract net protocol and achieved the collaboration model of focused crawlers based on multi-agent by JADE. At last, the comparative experiment results showed that our focused crawlers had higher precision and efficiency than other crawlers using the algorithms with breadth-first, best-first, etc.

Downloads

Download data is not yet available.

Downloads

Published

2017-02-07

How to Cite

Du, Y., Xu, Y., & Wang, M. (2017). A Novel Cooperation and Competition Strategy Among Multi-Agent Crawlers. Computing and Informatics, 35(5), 1050–1078. Retrieved from http://147.213.75.17/ojs/index.php/cai/article/view/1590

Most read articles by the same author(s)