Should we retreat?

I've been on plenty of "retreats."

Some have been personal, most professional.

Every time I've returned I've felt a little squeamish about the term retreat. Why? Because words and titles matter.

They matter in terms of what they communicate about the events, particpants and those on the outside looking in.

So, with that said, do we always want to "retreat?"

I ask because, in some instances, retreating is negative.
Retreating is surrendering.
Retreating is defeat.

Is that the message we want to send?

In some cases, you need to retreat. 

In most "retreat" situations, you're going to rejuvenate. Or relax. Or escape.
But, if our intentions are to do some of the latter terms, why don't we honestly use them?

Furthermore, how does our "retreating" sound to the outsider?
What, exactly, are we retreating from?