The GCC optimizer is among the best regarding high-level optimizations,
but it may (take that 'may' literally, on some platforms it does just as
good of a job as any other compiler) be lacking in platform-secific
small-scale optimization.
This doesn't really matter, however: Since your target is a Cortex M4, I
assume your code base will get comparatively large (several 100k of
binary size). In that case, minor differences in compiler optimization
aren't your concern anyways. You will always need to profile your
application, no matter what your compiler is, as compiler optimization
will never yield the performance gain you get when rewriting hot spots
using a different algorithm or even going straight to assembler for a
crucial piece of code.
Due to the widespread usage and long history, GCC's language support
tends to be more solid and implement more of relevant language
standards. This may be a major selling point if you use lots of shared
code, especially external code libraries.
For the same reason you get lots of independent tools that work with it,
be it for profiling or debugging. There is more choice (which has its
own cost, of course).
As for the difficulties in setting it up, that varies a lot. For some
platforms, there do exist fully automatic GCC installers that just work,
and on others, there don't. If you have people on site that speak
command line fluently, you will always get it working. Also keep in mind
that this is a one-time cost.
But in the end, there are too many specifics. Your JTAG adapter may not
be supported by one or the other tool, the µC you chose has that amazing
super-optimized compiler, or just that platform happens to be well done
in GCC, so many variables. If you want a solution that works best for
your specific case, just try them. GCC is free and the others should
have evaluation versions. Write a small test app in each of them and go
through debugging, profiling and all of your general workflow.
If, on the other hand, you want to establish one generic development
platform for all sorts of controllers, there is no way around GCC, as it
supports about everything there is.