Code4Lib 2008: Code4Lib Journal

Jonathan Brinley, Edward M. Corrado, and Jodi Schneider talked to us about the Code4Lib Journal, a project that had been talked about for years but never implemented until recently. The moral of this story is stop talking and just do it.

They decided to use an agile development philosophy, which basically means don’t over-engineer complicated rules and procedures your might never need – just work on what you need now and the rest will come.

Blog v. Journal

So, why did they choose to do a Journal instead of a blog? In short they chose a journal because it comes with a bit of a stamp of approval that some people need in order to move up the ladder at their workplace – in particular among those in academia.

Where to start?

Get an ISSN – Code4Lib Journal – 1940-5758. They thought this was going to be a crazy process, but it’s just a one page form with a few questions. I’ve actually applied for a few ISSNs – two for work and one for my blog – which Ed Corrado suggested we all go out and do since it’s so easy – but I can tell you that they will turn you down! and if they don’t – let me know and I’ll try again.

Other details

They decided to have rotating coordinating editors so that not one person was in charge all of the time. They also decided to have a public listserv – – so that everyone can follow along with discussions about the journal.

Articles can be sent in several different formats – right now the editors have worked with almost all of them. They then use WordPress as a publishing tool because it has a flexible templating engine that allows you to make a site not look like a blog and allows for private posts, public posts and public pages. It also comes with stats and other neat plugins that make it the right tool for them to use now – because their agile it may not always be the tool they use.

They’ve gotten their journal listed is DOAJ & Ebsco and it is also being blogged about which is bringing traffic to the site (however – just a note to bloggers for some reason trackbacks aren’t working yet – so post comments on the articles as well). Along those lines, they’d like to see more comments on the journal site – Code4Lib is a community and they want the journal to reflect that.

Overall an interesting talk with some great ideas for publishing a journal online with free tools available on the web.

Technorati Tags: , , ,

Code4Lib 2008: The Internet Archive

What a great way to open a conference like Code4Lib. The first keynote was presented by Brewster Kahle of the Internet Archive.

Brewster started by reminding us that the reason he was there talking to us and the reason he is working on the Internet Archive is because the library metaphor easily translates to the Internet – as librarians we’re paid to give stuff away! We work in a $12 billion a year industry which supports the publishing infrastructure. With the Internet Archive, Brewster is not suggesting that we spend less money – but that we spend it better.

He started with a slide of the Boston Public Library which has “Free to All” carved in stone. Brewster says that what people carve in stone is taken seriously – and so this is a great example of what libraries stand for. Our opportunity now is to go digital. Provide free digital content in addition to the traditional content we have been providing. I loved that he then said that this is not just a time for us to be friendly together as librarians – but to work together as a community and build something that can be offered freely to all!

He went on to say that what happens to libraries is that they burn – they tend to get burned by governments who don’t want them around. The Library of Alexandria is probably best known for not being here anymore. This is why lots of copies keeps stuff safe. Along those lines, the Internet Archive makes sure to store their data in mirror locations – and by providing information to the archive we’re ensuring that our data is also kept safe and available. This idea of large scale swap agreements (us sharing with the Internet Archive, us sharing with other libraries, etc) in different geographical regions finds us some level of preservation.

How it started

The internet archive started by collecting the world wide web – every 2 months taking a snap shot of the web. Brewster showed Yahoo! 10 years ago – ironically a bit of data that even Yahoo! didn’t have – so for their 10 year anniversary they had to ask the Internet Archive for a copy of what their site looked like! He showed us the first version of Code4Lib’s site and exclaimed “Gosh is that geeky!” because it was a simple black text on white background page.

While it may have seemed a bit ambitious to archive the web, the Wayback Machine gets about 500 hits a second. And it turns out that the out of print materials on the web are often just as valuable as the in print information on the web. People are looking for the way things were for historical or cultural research reasons and this tool makes it possible.


The Grateful Dead started a tradition in the 60s of allowing people to record their concerts and share them with others – this tradition of tape trading caught on and lots of bands were doing this. Following in this tradition, the Internet Archive decided to offer unlimited storage and unlimited bandwidth for free to any band who wanted to provide recordings of their concerts to the archive. It’s a bit different than tape trading, but an amazing idea! They are getting 1 or 2 bands a day – around 30,000 concerts now and it’s working! Overall the community is building the best metadata Brewster’s ever seen – beautiful work supported by a community – just what I love to hear!!

This shows that librarians can provide a role other than providing information – they can provide back end storage for information. By giving people like these bands a place to store their music for free, the Internet Archive made it so that concerts are now available online for those in search of them!

Moving Images

1000 movies that are out of copyright are available via the Internet Archive. Interestingly, the things that are popular are movies you can’t get any other way – movies you wouldn’t expect people to be interested in at all – government films, social behavior films like the ones you saw in high school when you had a substitute teacher – they’re fantastically popular. Brewster theorizes, and I tend to agree that people are using these videos as research tools to see what things were like culturally at different times in history.

Brewster is a follower of the “it’s easier to apologize than ask permission” philosophy and it has worked very well for him and the organization. You probably have a closet of video tapes that are just waiting to go online – so put them online and if people ask you to take it down – take it down. One example that most of us have probably seen are the Lego movies. Brewster found this genre of movies fascinating – but he mentions that if it weren’t for the free storage on the archive (pre-YouTube) these movies may never have been so widely spread. He described this as, we as the library supporting a community that had no home before. We’re here to put things of shelves and give things away – so why not put things online and give them away?


The Internet Archive only has 1 week of TV available so far – 9/11 – 9/18/2001. This shows a full picture of what people were watching during that horrible week. (update: I may have misunderstood – as I view the archive site I see more than just this….)

Apparently there is someone in North Carolina out there recording TV non stop on 20 channels in DVD quality. Apparently it costs him about $15 per video hour to digitize and has over 50,000 videos in his archive. You can’t get just one point of view (need multiple channels) news may say it’s fair and balanced – but it’s not – you don’t just want John Stewart as your archive of news :)


Not much because of licensing issues – it’s doable – just not legal yet.


This is where Brewster see the biggest opportunity for traditional libraries to participate. We have in our charge the responsibility to distribute print/books.

We, as librarians, have to work very hard on text. Look at what we did with journals – we handed them to many corporations and now we have to rent them back from them :( if we had never let it happen in the first place we wouldn’t be wondering how to digitize our journals now. The same thing is going on with monographs now – we’re handing them over to corporations – we should be doing this ourselves instead and the Internet Archive wants to help.

There are 26 million books in the Library of Congress – one book is about 1MB that’s 26TB in the Library of Congress. For $60,000 you could have the entire Library of Congress digitized.

Brewster’s goal sounds like a simple one – “one webpage for every book ever published.” What would it take to do this?

First off, we’d have scan a whole heck of a lot of books – and get the catalog data.

The archive has experimented with a few methods, first they worked with the million book project – they shipped their books to India and they learned not to ship their books to India. Brewster recommends that you have the Indians scan the books they like – but keep your books to yourself. Instead they found that for 10 cents a page they could scan their own items in house. They came up with the scanner and have a person turn the pages of the book – they tried the robots but they weren’t great (may be better now). At the University of Toronto this method produces a million pages a month.

So, for the cost of copying a page at Kinkos you can digitize it and add MARC records and share with the world. Most importantly it’s being done by librarians – our of the corporate sphere. We need to demand the right to give our books away – not have our books owned by corporations who will rent the content to us with exceptions tied to it.

Some quotes from Brewster: “Please help support these scanning centers while they’re up and running … take collections that you’ve got and have them digitized and start building services around them.” If we’re going to build one web page for every book, we’re going to have to scan a lot of books. One option of a service you could add is a scan on demand link to your catalog. Have patrons click this link to have a book scanned – same cost as ILL – might as well scan it and put it on the web for anyone to use.

Then you can provide your digital copies via ILL, Brewster states: “I don’t know what loan means in the digital world – but let’s figure it out!” Why wait for someone else to tell us?

Next, let’s scan all the microfilm. Someone came up to Brewster after one of his talks and said – “we’ve done this before – it’s called microfilm.” So why not digitize our microfilm as well? For less than 10 cents a page they can do all microfilm. The Internet Archive is actually doing a large scale microfilm scanning project right now using the Carnegie model. Apparently Carnegie would build your library for you if you promised to stock it with books and materials. So the The Kahle/Austin Foundation will donate a microfilm scanner to your organization for X years if you the library will keep it up and running for X hours a week. This only costs labor and time and no money has to change hands. In the end we’ve digitized all of our microfilm and made it more accessible.

This made me think of a question – if years ago people said you should microfilm everything and now everyone’s saying you should digitize it – what’s to say that in another 50 years there won’t be another format? This sounds to me like a never ending loop – but at the same time it sounds like such an obvious progression given the technology we have and the types of users we’re dealing with.

Next, we need better selection – right now we’re just digitizing whatever we’re handed – this means we don’t have full collections. Because of this the Internet Archive now has 90 sponsor collections – “We need help!”–Brewster asks that we pick an area of cataloged material and share that digitally – think outside of your own library. For some reason librarians seem to think that they’re only responsible for digital copies of materials they have in their own library – keep digital copies of things from other libraries – why only have digital copies of items you have in print? You want a full collection on your area of study for your library. This was something I was working on at the Seminary. I was finding digital copies of materials I thought would be of interest to our students and importing those OCLC records into our catalog. Just another way to provide access to data.

The next step according to Brewster is to build the catalog and “we finally need to do this FRBR thing – come on guys, it’s not that hard!!!” Even if the digital copy of the book isn’t available yet, it makes sense to provide pages for the book with catalog data that pulls information from sites like Amazon and other book information sites.

Code4Lib – Day 1
Originally uploaded by nengard

When the books are available, we need to work on our displays. Many of our displays are lacking. We need better search functions, open APIs to allow people to re-purpose our data in ways that make sense for them. We also need to make book images with pages that flip, provide the ability to zoom in and printable. In fact the Internet Archive offers a service where people can print books out from their service in real paperback looking formats.

Code4Lib – Day 1
Originally uploaded by nengard

Another option is to use the One Laptop per Child as an ebook reader. The kindle handles ASCII formats okay – but not the types of images that we’re creating for our digital collections.


We have to work together on building this! We can’t just check back in a year and see what’s happening – instead of waiting for others to do the work – why not contribute? We want to be able to build some great services that will allow people to bulk download these materials and re-purpose them if they want.

One way is to join the Open Content Alliance – there are over 80 libraries now. It’s free to join, you just have to contribute.

The next step is to get service layers in place – this is where the code4libers come in. We have the skills to make the Internet Archive even more accessible and valuable.

Questions & Answers

Dan Chudnov asked what he called “tough questions” – now that some companies like Reed Elsevier are trying to change their business models from journal sales to other routes, is there an opportunity to go and buy up their journal services so we get our data back?

Brewster’s answer: there is a way to do this – some people are trying – until it comes to the point where they aren’t making money any more we’re going to have to keep scanning ourselves

Dan’s other question – is power an issue?

Brewster – power is costly, but not running out any time soon.

Another question: the data is only good as long as the disks are still spinning – how do you make it last for years?

Brewster: the question is a good one – the real way to have long term preservation is to have access – access drives preservation. dark archives lead to data being lost. we have to replace our machines every few years to keep up. tapes suck! have you ever tried to read them back??? if there are at least 5 copies – 5 organizations then I can sleep

Real Conclusion

“if you’re frustrated enough – please come and help!” — Brewster

What an amazing way to stop! What an amazing way to start the conference! So many people were completely inspired, I can’t wait to see what comes of this talk – I hope some amazing APIs start popping up!

[update] Video online [/update]

Technorati Tags: , , ,

Code4Lib Scholarship Winners

I was lucky enough to win a scholarship to attend Code4Lib last year – and to be on the committee that chose this year’s winners – so I’m happy to announce that the winners have been chosen:

We are happy to announce the winners of the Oregon State University / Code4lib Scholarships.

The OSU / Code4lib Gender Diversity Scholarship was awarded to Deborah Mouw, Electronic Resources Specialist at Western Michigan University Libraries.

The OSU / Code4lib Diversity Scholarship was awarded to Ranti Junus, Systems Librarian for Web Services and Electronic Resources at Michigan State University Libraries.

In addition to congratulating the winners, the search committee would also like to thank all of the applicants – we had a record number of applications for this year’s scholarships, and there were many deserving candidates, of which we could only pick two winners. We are greatly encouraged that each year the number of applicants and the overall quality of the applicant pool continues to grow and improve.

There were so many amazing people to choose from, the committee had a hard time making up their minds. I hope to see some of you try again next year! Congrats and see you both at Code4Lib (since I’ll be there again this year).

Technorati Tags:

Code4Lib 2008 Conference

I’m registered – are you?? Check out the program and details at the official site.

The conference will be held at the Embassy Suites Downtown Portland. A single suite is $150 per night, which includes full breakfast and free happy-hour. To make reservations, please call the hotel directly at (503)279-9000 and let the guest representative know that you are with the 2008 Code4Lib Conference.

Technorati Tags: ,

My Code4Lib Lightening Talk

My Code4Lib Lightening Talk is now available on video. While I was listening to others I thought “Wow, 5 minutes is a long time! Look how much they can cover” – but when I got up there – I learned that 5 minutes is not long at all!!! Anyway, if you want to see my lightening talk on Jenkins Intranet you can view it in Large MP4 Format 12.3 Mb or Small MP4 Format 1.7 Mb.

See the other videos from the conference.

Technorati Tags: ,