« Drexler Keynoteauto lang »
05.06.2003

assign

An exciting assignment at work* - the boss says to me "go forth unto the Internet, and find me every weblog you can get your hands on!". It seems we need a large, live collection to prove our search algorithms on. Not exactly a Mt. Everest of data, but something more than the little molehills of documents we've conquered so far. So I have dutifully started crawling the Web, as well as asking for contributions from the many other people who already maintain extensive lists, to try to get an authoritative collection together. One of the immediate goals of the project is to gather reliable, quantitative data on weblogs, both for our own work and for the benefit of others. It seems wasteful to make everyone interested in doing research on social networks and other oddities start a crawl from scratch, so we intend to maintain a large blog database that will be accessible to anyone who wants to do a research project. At the very least it will spare people having to download half the Web over a DSL line. If you can spare the time, pay a visit to the crawl stats page and submit your URL to make sure it's included in our list. That means you, Kottke! The page updates every five minutes with the latest figures from our crawl, as well as some gratuitous and completely unscientific statistics on CMS market share that are bound to get me in some kind of trouble. And if you are one of the Brahmins who already has a large list of blog URLs on hand, consider giving the gift of data! * I work for an entity called NITLE, a non-profit cabal of liberal arts colleges.

« Drexler Keynoteauto lang »

Greatest Hits

The Alameda-Weehawken Burrito Tunnel
The story of America's most awesome infrastructure project.

Argentina on Two Steaks A Day
Eating the happiest cows in the world

Scott and Scurvy
Why did 19th century explorers forget the simple cure for scurvy?

No Evidence of Disease
A cancer story with an unfortunate complication.

Controlled Tango Into Terrain
Trying to learn how to dance in Argentina

Dabblers and Blowhards
Calling out Paul Graham for a silly essay about painting

Attacked By Thugs
Warsaw police hijinks

Dating Without Kundera
Practical alternatives to the Slavic Dave Matthews

A Rocket To Nowhere
A Space Shuttle rant

Best Practices For Time Travelers
The story of John Titor, visitor from the future

100 Years Of Turbulence
The Wright Brothers and the harmful effects of patent law

Every Damn Thing

2020 Mar Apr Jun Aug Sep Oct
2019 May Jun Jul Aug Dec
2018 Oct Nov Dec
2017 Feb Sep
2016 May Oct
2015 May Jul Nov
2014 Jul Aug
2013 Feb Dec
2012 Feb Sep Nov Dec
2011 Aug
2010 Mar May Jun Jul
2009 Jan Feb Mar Apr May Jun Jul Aug Sep
2008 Jan Apr May Aug Nov
2007 Jan Mar Apr May Jul Dec
2006 Feb Mar Apr May Jun Jul Aug Sep Oct Nov
2005 Jan Feb Mar Apr Jul Aug Sep Oct Nov Dec
2004 Jan Feb Mar Apr May Jun Jul Aug Oct Nov Dec
2003 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
2002 May Jun Jul Aug Sep Oct Nov Dec

Your Host

Maciej Cegłowski


Threat

Please ask permission before reprinting full-text posts or I will crush you.