Wiscon is very good. There are some others that are also known as being more for readers than media fans--one of them is named Readercon (who would have thought?). But that's on the east coast and I've never been. There's Potlatch, which moves up and down the west coast (it's in Portland this year, I think) and of course the big gun is World Fantasy.

At the larger regional cons you can usually sort of piece together your own reader's track. You'll still be wandering around amongst the dancing Klingons, outside of the panels, but that just adds spice. :-)