Removing rear panel

I thinking of fitting a rear panel eliminator kit, how much of the heat shield can you safely remove? Has anyone had an issue with this (i.e. paint/clam damage) post mod?

Cheers