Evolution of document networks

Proc Natl Acad Sci U S A. 2004 Apr 6;101 Suppl 1(Suppl 1):5261-5. doi: 10.1073/pnas.0307554100. Epub 2004 Jan 27.

Abstract

How does a network of documents grow without centralized control? This question is becoming crucial as we try to explain the emergent scale-free topology of the World Wide Web and use link analysis to identify important information resources. Existing models of growing information networks have focused on the structure of links but neglected the content of nodes. Here I show that the current models fail to reproduce a critical characteristic of information networks, namely the distribution of textual similarity among linked documents. I propose a more realistic model that generates links by using both popularity and content. This model yields remarkably accurate predictions of both degree and similarity distributions in networks of web pages and scientific literature.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Databases, Bibliographic*
  • Documentation*
  • Internet*
  • Models, Statistical
  • National Academy of Sciences, U.S.
  • Nerve Net*
  • Periodicals as Topic
  • Reproducibility of Results
  • United States