That's how I started: I listened in 2009 a bootleg of the gig at BBC, "Seasick, yet still docked" got stuck in my head and then I searched for more, pretty randomly. Bootlegs, Youtube, anything works once you acquire the taste (ha!). Otherwise I guess I didn't have the patience to explore things systematically. Only afterwards I started with the albums. But Viva Hate is a good starting point, indeed.
Here's a link for you, as the links on this site for the BBC gig are dead.
http://www.mediafire.com/?azkttrw98u9lvzv