Saturday 9 April 2011

WUSB Digitzation Project

Here's what I am working on for the grants for WUSB radio digitization. I am waiting on most of the numbers but this is what we'd be looking for:
WUSB Digitization Project v0.8

Part I: Hardware

Goals
  • Archive the entire wusb library for easy search, retrieval and playback
  • Replace the digikart with a more robust but just as easy to use solution

Storage Requirements
  • 35,000 cds immediately (12TB)
  • 7,500 cds / year (+2.5TB / year)
  • This assumes all cds are full albums that compresses on average to 333MB

Storage Solution ($2075)
  • Need 14TB of usable storage + room to expand
  • NORCO RPC-4224 3U Rackmount 24 bay SATA/SAS case ($400)
  • Areca ARC-1220 SATAIIx8 PCI-Express raid ($475)
  • 9x2TB WD AV-GP WD20ECDS ($1200)

Server Audio Requirements
  • 2 stereo outs (audition/program), 1 stereo in (master mix)

Server Solution ($965)
  • ASRock X58 Extreme mobo ($175)
  • Core i7 950 ($280)
  • PowerColor AX5450 ($50)
  • Corsair XMS-3 2x4GB DDR3 ($100)
  • Corsair CMPSU-950TX ($160)
  • 2xM-Audio Audiophile 2496 ($200)

Import Requirements
  • Import current library in less than 6 weeks
  • Automatic metadata lookup
  • Double parity disk checking

Importing ($6000)
  • Ripstation 7604 from simplyez.com ($4400)
  • Extension to 3-year warrantee ($1600)

Summary
  • Year 0: 2x(Storage + Server) + Ripstation = $12,080
  • Year 1: 4x(CD Drives) = $125
  • Year 2: 6x(Hard Drives) + 2x(CD Drives) + Raid (8x) Controller = $1000
  • Year 3: 4x(Hard Drives) + 2x(CD Drives) = $850
  • Year 4: 4x(Hard Drives) + 2x(CD Drives) = $750
  • Year 5: 2x(Hard Drives) + 2x(CD Drives) = $650
  • Year 6: 6x(Hard Drives) + 2x(CD Drives) + Raid (4x) Controller = $750
  • Year 7: 2x(Hard Drives) + 2x(CD Drives) = $250
  • Year 8: 2x(CD Drives) = $100
  • Year 9: 2x(CD Drives) = $100
  • Total Price over 10 years: $16,655
  • Total Storage over 8 years: 35TB ( 100,000+ albums )
  • Prices from newegg except where noted

Part II: Software

Goals
  • Allow any dj to use any software they are comfortable with to play music from the library
  • Store the audio in a format flexible enough to migrate to whatever we want in the future
  • Keep a low latency - three djs should be able to play 2 tracks plus a third for cue
  • Be able to view music trends, dj statistics in an interesting and meaningful way
  • Generate and submit playlists and archives automagically
    • Link the songs played in each playlist to a referral service to buy them?

File Format
  • Flac is free, open source, cross platform, streams well, and has good metadata support
  • With fuse, people can browse /music/mp3/ or other formats which convert on the fly
    • We can proxy the conversion with another machine if we want to

Software Interface
  • Share the archive over the internal network through nfs - no internal db should exist
    • This allows any dj to use their own software, including anything on the CR machines

1 comment:

  1. Adding Katherine Tong and Caeley Colgan to this since we are working on it together and I didnt tag them :)

    ReplyDelete