About this page

Efficient Crawling Through URL Ordering - Stanford InfoLab Publication Server

https://ilpubs.stanford.edu:8090/347

“In this paper we study in what order a crawler should visit the URLs it has seen, in order to obtain more "important" pages first. Obtaining important pages rapidly can be very useful when a crawler cannot visit the entire Web in a reasonable amount of time. We define several importance metrics...” (from the page’s text)

Topic: Not categorised yet
Quality: Not rated yet
Language: English
Text on page: 1,273 characters
Page size: 14 kB
Answered: OK (200), HTML
Last read: 13 Aug 2025
In our index since: 13 Aug 2025
Safe search: Safe score 1.00 of 1
Links to it: Linked from 1 site

More from ilpubs.stanford.edu:8090

This site's best pages we know: ranked by how many other sites link to them.

All pages from this site ›

Tools for this page

Other sites that can tell you more. Plain links: we don't track where you go.

About the site

Domain owner ICANN registration lookup
Certificates certificate transparency, subdomains
Safety check Safe Browsing status
Trackers The Markup's Blacklight
Is it down? for everyone, or just you

Discussions

Hacker News stories linking here
Reddit posts from this site
Wikipedia articles mentioning the site

For web makers

PageSpeed Lighthouse report
HTML validator W3C
Accessibility WAVE by WebAIM
Security headers

Who links to it

wikipedia.org “efficient crawling through url ordering”

“Not rated yet” and similar notes are shown on purpose: we say what we haven't measured, so the page doesn't look emptier or better than it is.