I sold cars for years, and I have been in a situation where someone wanted to test drive a rare car that we did not want to put miles on. The salesman should have done a better job at qualifying to see if you were a serious customer. I've denied people test drives, but in a nice way, and still ended up selling them a car when they were ready to buy.
Sorry about the bad experience. Its salesmen like that that give car salesmen a bad rep.