Thursday, March 02, 2006

Deep Web

Our catalog is part of the deep or invisible Web. In an effort to make it more visible I've created a Web page that is just a bibliography with links back to the catalog record for LPI publications. It will be interesting to see if and when these publications get indexed by the search engines. Not as good as an API, or OAI-PMH access but something to expose our work.

Added March 20, 2006. I have made a page on Google that holds the links. Now to test how this works.

3 comments:

Anonymous said...

Good idea, David!

Joanna Fountain

Dave Pattern said...

I hate to be a party-pooper, but if the search engine uses the Robots Exclusion Standard, then it won't index it at all:

http://ia300212.us.archive.org/robots.txt

David said...

Thanks for pointing that out. I'd overlooked checking the robots file. Have to move it elsewhere.