Tuesday, September 24, 2013

Invited Talk on Augmented Notes

On Friday, I had the honor of giving a talk, called "From the Parlor to the Laptop: Victorian Lyrics and Digital Tools," at Columbia University about Songs of the Victorians and Augmented Notes.  Alex Gil, the Digital Scholarship Coordinator there and fellow Praxis Program alum, invited me as part of Studio@Butler's digital humanities speaker series.  I really enjoyed the format of the afternoon:  first, I delivered my talk and we had a question and answer session, and then, after a short break, we reconvened for a workshop in which I walked the participants through making their own website with Augmented Notes.

In my talk, I first explained the purpose and rationale behind building Songs of the Victorians, demonstrated the how archive and analysis pages work, and explained the design principles that governed the project.  Then, I shifted to a discussion of Augmented Notes.  I explained that I wanted to help other scholars build sites like Songs of the Victorians without needing the programming experience that I had to develop.  I demonstrated how I took my initial project and built a generalized, public humanities tool to help further scholarship and pedagogy.  I also gave a brief demo of the tool, which I showed off in more depth in the workshop.  The tool has changed slightly since I last wrote about it on this blog, so here is the new order of the steps:

1. Users upload three things to make an archive page: ogg and mp3 audio files (an ogg is necessary because firefox can't play mp3 files) and pages of the score. Users can optionally upload an MEI file.
2. The site then takes users to a page where they click and drag to draw boxes around each measures (they can also edit the sizes and order of these boxes); these boxes are what highlights each measure in time with the music.
Box Drawing Page: Boxes are red as they are being drawn (through clicking and dragging) and grey once they have been created.  Users can edit the boxes by changing their size and order and also delete them.

3. The site then takes users to a page to set the time data:  they hit the "save" button at the exact second each measure ends to record that time.  The site brings together the measure and time information, which enables each measure of the song to be highlighted in time with the music.

Time Edit: Users click on the "save" button at the exact end of every measure, which records that time in the open boxes at the right.  
4. Users then click "Download zip" to download a zip file with the html, css, and javascript files necessary for a complete archive page, which they can then style themselves. A sample resulting html file is below:

I was very grateful for all the fascinating suggestions and feedback I received in the question and answer period.  Some people suggested that I should consider altering the box-drawing tool to let users draw any shape they want:  this would let users circle individual notes and entire phrases.  At some point, I would love to add this functionality, although I will not have time to build it until next fall, because I am currently teaching, finishing my dissertation, and going on the job market.  I was also pleased to hear that some people are planning to use my tool for the classroom, especially in music appreciation or introductory music classes to help beginning music students follow along.

If you have any comments on the new features in Augmented Notes or ideas for future features, please do let me know! I'd love to hear your feedback!


  1. Joanna, this is amazing! I work at Columbia and I'm sad I missed this. I don't have a music background but I wonder how your tools might be used for other specialties? Good luck with dissertation!

  2. I wish I could have been there--this is terrific!