Metadata Extraction

Effective Metadata Extraction from Irregularly Structured Web Content by Baoyao Zhou, Wei Liu, Yu Yang, Weichun Wang Ming Zhang, (HPL-2008-203)

Metadata extraction is one crucial module for domain specific Web content discovery and management, because the accuracy and completeness of the extracted metadata would directly affect the quality of subsequent domain information services. Our Online Course Organization project aims to build an online course portal to serve the course information obtained from the Web. Since most course pages are irregularly structured, most existing approaches are not effective for extracting course metadata. In this paper, we proposed a novel hierarchical clustering approach to generate a web page semantic structure model from the DOM tree, called Logical Structure Model, such that the hidden patterns and knowledge can be revealed and used to facilitate identifying course metadata. The experimental results have shown that our solution can achieve effective metadata extraction

Library Weblogs

Now available, The Liblog Landscape 2007-2008 by Walt Crawford.

Liblogs--blogs written by library people, as opposed to official library blogs--provide some of today's most interesting and useful library literature. This book offers a broad look at English-language liblogs as they are and as they've changed between 2007 and 2008. The book includes more than 600 blogs with detailed analysis of 27 metrics for 2007 and 2008 and changes from 2007 to 2008--and, for 143 of them, 2006 as well. Through tables, charts and text, we explore the liblog landscape.

MODS Tools

The MODS users are collecting examples of tools using MODS. One example is Tellico.

Tellico is a KDE application for organizing your collections. It provides default templates for books, bibliographies, videos, music, video games, coins, stamps, trading cards, comic books, and wines.

Tellico allows you to enter your collection in a catalogue database, saving many different properties like title, author, etc. Two different views of your collection are shown. On the left, your entries are grouped together by any field you like, allowing you to see how many are in each group. On the right, selected fields are shown in column format, allowing you to sort by any field. On the bottom is a customizable HTML view of the current entry. The entry editor is a dialog box where you enter the data.

Cataloging Tools

LibLime has announced the beta test of a suite of cataloging tools, ‡biblios.net.

‡biblios.net is a subscription-based, hosted version of the open-source ‡biblios metadata editor that we released earlier this year. In addition to the editor, ‡biblios.net includes some extended community features such as integrated real-time chat, forums, and private messaging.

‡biblios.net also provides access to the world's largest database of freely-licensed library records. The database will be freely available to ‡biblios.net subscribers and non-subscribers alike via Z39.50, OAI, and direct download.

Furthermore, the database itself will be maintained by ‡biblios.net users similar to the way that Wikipedia's database is maintained by users.

We're now looking for enthusiastic participants to help shape the final production release of ‡biblios.net.

Ways you can help:

• Become a beta tester for the ‡biblios.net platform by filling out the beta tester application form.
• Donate your records to ‡biblios.net. Upload records to http://archive.org, and drop us an email at 'info AT liblime DOT com'
• Get involved in the ‡biblios open-source community: get your copy of ‡biblios and join the development team at http://biblios.org

An aside, wouldn't it make more sense in that first paragraph to link "‡biblios metadata editor" rather than "released earlier this year?" Links are a form of mark-up and clean mark-up matters.

Metadata Matters

Diane Hillmann and Jon Phipps have started a new weblog, Metadata Matters. Based on the names, I'd call this a must read. Subscribed.

Better 404 Pages

Good idea from Dean Frickey writing in A List Apart (the other ALA), A More Useful 404.

Encountering 404 errors is not new. Often, developers provide custom 404 pages to make the experience a little less frustrating. However, for a custom 404 page to be truly useful, it should not only provide relevant information to the user, but should also provide immediate feedback to the developer so that, when possible, the problem can be fixed.

To accomplish this, I developed a custom 404 page that can be adapted to the look and feel of the website it’s used on and uses server-side includes (SSI) to execute a Perl script that determines the cause of the 404 error and takes appropriate action.

Authority Record Access

Why doesn't LC offer Z39.50 access to the authority files? How about their other thesauri, like the Thesaurus For Graphic Materials? Easy access to these files would be useful. Maybe Z39.50 is "so yesterday" and SRU/SRW or an API is the answer. These are rich resources and access would be useful in ways we can't yet imagine. How about other institutions? AAT or the NASA Thesaurus, or... would be useful. This is not only about bibliographic access, but has wider issues in a Semantic Web environment.

[Later] OCLC does provide access via their Terminologies Project, see the comment for full details.

[21 Nov. 2008] Someone sent me a note saying that the Voyager software used does not support Z39.50 access to the authority records. That they are not a separate database and have very little indexing. Do check out the comments for some useful information.

RSS for TOCs

RSS and Scholarly Journal Tables of Contents: the ticTOCs Project, and Good Practice Guidelines for Publishers by Lisa Rogers provides some advise based on experience.

Publishers are using various versions of feeds such as RSS 1.0, RSS 2.0, RSS 0.91 and Atom. RSS 0.91 and RSS 2.0 are very simple XML formats, and typically only contain the fields for title, description and link. However, RSS 1.0 can easily be extended by the use of modules so as to not only deliver the content, but also provide structured metadata. One such module for extended RSS 1.0 is the Publishing Requirements for Industry Standard Metadata (PRISM) module. A variety of publishers such as Nature Publishing Group (6), Inderscience (7) and SAGE (8) are already using PRISM along with Dublin Core Metadata to provide rich metadata in their RSS feeds.

Comment on RDA

Form for comments from the US about RDA.

Koha User Group Meeting

On April 16-17th there will be a Koha innovations and sharing group in Plano Texas (suburb of Dallas/Fort Worth). The 2 day workshop would have lab access and presentation space. There would be a charge to cover lunch both days and other expenses. Any leftover money would be given to the KUDOS users group as seed money. Anticipated cost $100.

Algorithms for Clustering Tags

Clustering Tags in Enterprise and Web Folksonomies by Simpson, Edwin will be published and presented at the International Conference on Weblogs & Social Media, Seattle, March 31st, 2008 (HPL-2008-18 )

Tags lack organizational structure limiting their utility for navigation. We present two clustering algorithms that improve this by organizing tags automatically. We apply the algorithms to two very different datasets, visualize the results and propose future improvements.

RDA Draft

The full draft of RDA is now available for comment. Comments needed.

Indexing Tool

Library catalogs these days are mostly ralational databases and related indexes. LuSql is a tool to create an index from a relational databse.

LuSql is a simple but powerful tool for building Lucene indexes from relational databases. It is a command-line Java application for the construction of a Lucene index from an arbitrary SQL query of a JDBC-accessible SQL database. It allows a user to control a number of parameters, including the SQL query to use, individual indexing/storage/term-vector nature of fields, analyzer, stop word list, and other tuning parameters. In its default mode it uses threading to take advantage of multiple cores.

LuSql can handle complex queries, allows for additional per record sub-queries, and has a plug-in architecture for arbitrary Lucene document manipulation. Its only dependencies are three Apache Commons libraries, the Lucene core itself, and a JDBC driver.

LuSql has been extensively tested, including a large 6+ million full-text & article metadata document collection, producing an 86GB Lucene index.Lots of the Code4Lib folks are working with Lucene indexes.

Lemon8-XML

Adding semantic mark-up to text is something the cataloger in me always finds good. Microformats, XML, or RDF all make searches more precise. Lemon8-XML is a tool to chamge scholarly papers in MS Word or Open Office formats into XML. Sweet idea.

Lemon8-XML is a web-based application designed to make it easier for non-technical editors and authors to convert scholarly papers from typical word-processor editing formats such as MS-Word .DOC and OpenOffice .ODT, into publishing layout formats such as the open, industry-standard NLM Journal Publishing XML format.

To use Lemon8-XML, you don't need to understand XML, all you need is a little time and a general understanding of how scholarly articles are structured. In general, this means a document with:

1. some information about the article and authors at the top
2. usually an abstract
3. several sections, often titled "introduction", "methods", "results", etc.
4. optional figures or tables, either in-text or as appendices
5. a list of references or citations in a standardized format (eg. MLA, APA, etc.)

It is from the Public Knowledge Project.

Preliminary Authority Records

Just what does it take to upgrade a preliminary authority record? I ask because there are some about 25 years old that are still preliminary.

n 83827701
Space Age Astronomy Symposium (1961 : Pasadena, Calif.)

or

n 83827385
Solar Spectrum Symposium (1963 : Rijksuniversiteit te Utrecht)

OpenSearch and unAPI Enrichs the Cataloges

SeeAlso: A Simple Linkserver Protocol by Jakob Voss appears in Ariadne no. 57 (October 2008)

In recent years the principle of Service-oriented Architecture (SOA) has grown increasingly important in digital library systems. More and more core functionalities are becoming available in the form of Web-based, standardised services which can be combined dynamically to operate across a broader environment [1]. Standard APIs for searching (SRU [2] [3], OpenSearch [4]), harvesting and syndication (OAI-OMH [5], ATOM [6]), copying (unAPI [7] [8]), publishing, editing (AtomPub [9], Jangle [10], SRU Update [11]), and more basic library operations, either already exist or are being developed.

The creation of the SeeAlso linkserver protocol was occasioned by the need to enrich title views in library catalogues of the German Common Library Network (GBV) with links to additional information. However, instead of integrating those links into title records and tailoring the presentation to our specific OPAC software, we decided to create a general linkserver Web service.

Omeka 0.10

Omeka 0.10 was released yesterday.

Omeka 0.10b incorporates many of the changes you asked for: an unqualified Dublin Core metadata schema and fully extensible element sets to accommodate interoperability with digital repository software and collections management systems; elegant reworkings of our theme API and plugin API to make add-on development more intuitive and more powerful; a new, even more user friendly look for the administrative interface; and a new and improved Exhibit Builder. While the changes are extensive and represent a next-to-last step forward toward a 1.0 release in early 2009, existing users of Omeka should have little trouble switching to 0.10b. New users should have even less trouble getting started. Meanwhile, visitors to Omeka.org will find a new look, a more intuitive information architecture, easily browsable themes and plugins directories, improved documentation and user support, and new ways to get involved in the Omeka community.

OPML

How (and Why) to Create an OPML File by Marshall Kirkpatrick is only new to me. A PR person looks at the Outline Processor Markup Language.

There’s a billion other reasons to use OPML - just ask yourself in what circumstances you can imagine sending someone else one link or file that contains a collection of dynamic sources on any topic. I know these are the sorts of questions that keep me up at night.

I'm not seeing OPML icons as often as I'd expect. Is this another PICS, a good idea that just never gets adopted?

WorldCat Hackathon

WorldCat Hackathon is the impetus for some tool development. From OCLC comes this notice

We added a few more features in this month's xID deployment, hopefully it could be useful in upcoming WorldCat Hackathon.

• support LCCN query such as: http://xisbn.worldcat.org/webservices/xid/lccn/2004273129?fl=isbn,lccn
• support deleted OCLCNUM (marc 019 field) http://xisbn.worldcat.org/webservices/xid/oclcnum/47139964?method=getMetadata In this case OCLCNUM 47139964 was merged into 33100112, and we use a flag "presentOclcnum" to mark present OCLC numbers.
• xISSN project now supports tab-delimited and CSV dissemination http://xissn.worldcat.org/webservices/xid/issn/0036-8075?method=getEditions&format=csv&fl=issn,form,title http://xissn.worldcat.org/webservices/xid/issn/0036-8075?method=getEditions&format=txt&fl=issn,form,title
  
• start to support php dissemination format in all XID projects http://xisbn.worldcat.org/webservices/xid/isbn/0596002815?method=getEditions&fl=*&format=php

Matienzo, Mark has announced that Python WorldCat Module v0.1.0 is now available.

In preparation for the upcoming WorldCat Hackathon starting this Friday, I've made a few changes to worldcat, my Python module for interacting with OCLC's APIs. Most notably, I've added iterators for SRU and OpenSearch requests, which (like the rest of the module) painfully need documentation.

isbn2marc

William Denton has written a program, isbn2marc, that takes and ISBN and returns a MARC record. It uses Z39.50 and is written in Ruby. Mr. Denton is the person responsible for the FRBR Blog, good stuff.