uk-2005

If you publish results based on this graph, please quote the references suggested in the dataset page.

This graph has been obtained from a 2005 crawl of the .uk domain performed by UbiCrawler. The crawl was very shallow, and aimed at gathering a large number of hosts, but a small number of pages from each host. Note that before April 2006 the URL order was not exactly lexicographical due to some locale issues (the graph was anyway correct). The current dataset has been correctly permuted so that URLs are ordered lexicographically.

Basic data nodes 39 459 925 arcs 936 364 282 bits/link 1.463 (6.62%) bits/link (transpose) 1.156 (5.23%) average degree 23.729 maximum indegree 1 776 852 maximum outdegree 5 213 dangling nodes 11.17% buckets 8.99% largest component 25 711 307 (65.16%) average distance 15.79 (± 0.026) reachable pairs 64.30% (± 0.624) median distance 18 (50.79%) harmonic diameter 23.19 (± 0.205) Random access (recommended) Filename Size uk-2005.graph 201M uk-2005.properties 4.0K uk-2005-t.graph 140M uk-2005-t.properties 4.0K uk-2005.map 438M uk-2005.smap 438M uk-2005.md5sums 4.0K uk-2005.lmap 1.3G uk-2005.fcl 1.2G uk-2005.urls.gz 309M uk-2005.stats 4.0K uk-2005.indegree 3.4M uk-2005.outdegree 12K uk-2005.scc 151M uk-2005.sccsizes 23M Sequential access (high compression) Filename Size uk-2005-hc.graph 164M uk-2005-hc.properties 4.0K uk-2005-hc-t.graph 130M uk-2005-hc-t.properties 4.0K Natural order (random access) Filename Size uk-2005-nat.graph 264M uk-2005-nat.properties 4.0K uk-2005-nat.fcl 999M uk-2005-nat.urls.gz 294M JGraphT serialized succinct representation Filename Size uk-2005.suxdir 5.2G uk-2005.suxmap 1.3G

Indegree-frequency plot Outdegree-frequency plot Indegree-rank plot (cumulative) Outdegree-rank plot (cumulative) Distance probability mass function Connected-components size distribution Large connected components Distribution of the logarithm of successor gaps Distribution of successor gaps