Hyperlink Graph of the World Wide Web of 2012 (aggregated by pay-level-domain)
| Item Type: | Dataset |
|---|---|
| Title: | Hyperlink Graph of the World Wide Web of 2012 (aggregated by pay-level-domain) |
| Alternative Title: | Hyperlink Graph of the World Wide Web (aggregated by pay-level-domain) extracted from the Common Crawl Dataset 2012 |
| Date: | 12 November 2013 |
| Creator: | Meusel, Robert ; Lehmberg, Oliver ; Bizer, Christian |
| Divisions: | School of Business Informatics and Mathematics > Wirtschaftsinformatik V (Bizer) |
| DDC Classification: |
004 Computer science, internet |
|---|---|
| Keywords: | web graph ; webgraph ; hyperlink graph |
| Abstract: | Knowledge about the general graph structure of this graph is important for designing ranking methods for search engines. To amend the ranking calculated by search engines for different websites, search engine optimization agencies focus on linkage structure for their clients. An extreme appearance of ranking manipulation manifests in spam networks, where pages and websites publishing dubious content try to increase their ratings by setting a massive number of links to other pages and retrieve backlinks. The WDC Hyperlink Graph aggregated by pay-level-domain has been extracted from the Common Crawl 2012 web corpus and covers 43 million pay-level-domains, linked by 623 million connections which have been derived from hyperlinks between the pages contained in the pay-level-domains. |
| URL: | https://madata.bib.uni-mannheim.de/48/ |
|---|---|
| DOI: | https://doi.org/10.7801/48 |
| Availability (Controlled): | Download |
| Availability: | Data is available as download. Index File and Arc files. Please see http://webdatacommons.org/hyperlinkgraph for more information. |
| Publication(s) (MADOC): |
Meusel Robert und Vigna Sebastiano und Lehmberg Oliver und Bizer Christian (2015), The Graph Structure in the Web - Analyzed on Different Aggregation Levels
Lehmberg Oliver und Meusel Robert und Bizer Christian (2014), Graph structure in the Web - aggregated by Pay-Level Domain Meusel Robert und Vigna Sebastiano und Lehmberg Oliver und Bizer Christian (2014), Graph Structure in the Web - Revisited |
| Reference URL (External): |
http://webdatacommons.org/hyperlinkgraph/index.htm...
http://webdatacommons.org/hyperlinkgraph/2012-08/t... http://webdatacommons.org/hyperlinkgraph/2012-08/d... |
| Project: |
Project Title: Web Data Commons - Hyperlink Graph Project Description: Knowledge about the general graph structure of this graph is important for designing ranking methods for search engines. To amend the ranking calculated by search engines for different websites, search engine optimization agencies focus on linkage structure for their clients. An extreme appearance of ranking manipulation manifests in spam networks, where pages and websites publishing dubious content try to increase their ratings by setting a massive number of links to other pages and retrieve backlinks. The WDC Hyperlink Graph has been extracted from the Common Crawl 2012 web corpus and covers 3.5 billion web pages and 128 billion hyperlinks between these pages. To the best of our knowledge, this graph is the largest hyperlink graph that is available to the public outside companies such as Google, Yahoo, and Microsoft. |
| File | Filename / Infos | Link |
|---|---|---|
![[img]](https://madata.bib.uni-mannheim.de/style/images/fileicons/archive.png) |
Archive
Filename: pld-index.gz No License defined |
Download (311MB)
|
|
Archive
Filename: pld-arc.gz No License defined |
Download (2GB)
|
| Depositing User: | Robert Meusel |
|---|---|
| Date Deposited: | 18 Nov 2013 13:57 |
| Last Modified: | 29 Feb 2024 16:10 |
Actions (login required)
 |
View Item |
