I just used goo gone to get rid of badge adhesive and it didn't remove the clear coat or damage the paint.
Just don't use a lot.
I dabbed a paper towel in goo gone and then used it to "wet" the adhesive without even touching the area around it.
I'm not sure about carbon fiber, but like ronin said you can always just dab a tiny bit of goo gone somewhere inconspicuous and see if it hurts anything.
By the way, anyone looking for goo gone, Wal-Mart actually carries it.
But they keep it over by the laundry detergent, not in automotive or hardware where I thought it would be.