You can collect it all in card-like form with Chu-Bops:
They used to sell these in record stores (places where music pressed onto vinyl discs was sold). At one point I had a collection of them. I found one at a flea market recently for a buck and picked it up for my Festival of Bric-a-Brac.
I found my old 45 collection recently and discovered that a lot of the early hip hop picture cover ones sell for decent money, relatively speaking, like twenty bucks each.
If they were cheap enough, I'd buy old CDs or cassettes just for the cards or booklets.
As far as 8-tracks go, I used to have a Hank Aaron 715 one that I sold at a card show. Great cover art.