I would, except I hate ivory too. I was in a pretty similar situation I suppose, I originally wanted black or white myself as well, but when I walked into the dealership and saw this vanilla-tan-dirt white- kinda thing inside the car and all I said was NEXT! I didn't bother looking at silver because the last thing I wanted was to have someone like my mom or dad drive up next to me in their silver camry giving me a thumbs up on my color choice. I didn't want Atomic Blue because it's just a bit dull to me. At the time, the Royal Blue Pearl and Rallye Red for the non Si's weren't out yet so that pretty much left me with GG. It's a pretty unique color and though I'd prefer a black interior, grey was close enough. It's a bit more brown than gray, but as you can see I didn't really have much of a choice.
I had no regrets buying GG, until I heard about black seat covers to compensate for the ivory interior
I can probably be expecting quite a bashing from my comments but to me every color had a flaw, either the exterior color itself or the interior. To me, GG's flaws were the most bearable.