Some people will reach a point in their growth when they wish to withdraw from the world. It is not the withdrawal of an antisocial or fearful person running away from the world. Short periods of withdrawal are, of course, beneficial to everyone.
However, the type of withdrawal we are talking about is for the purpose of deep, spiritual transformation. It is the withdrawal of someone who is, generally, already competent in the world. Otherwise, our shortcomings will rise to pull us back into the world where they will be thrown at us again for educational reasons. Withdrawal is not really a choice, nor is it difficult. The attachment to the world will have already diminished and we will crave the solitude that seems to be the only way that we can connect to that which we seek.
Rite of Passage
Some type of separation or seclusion is, for some of us, a necessary rite of passage. When we see through the self-confirmatory nature of human interaction, we can decide to refrain from participating in it for some time. One must learn to tolerate and live with silence before one is ready to talk the talk of the angels.
For a few people, the silence remains in the form of seclusion.
For all, it remains internally and is regarded as precious. It sometimes requires the silence of withdrawal to spiritually work through some inner milestones. What other people think about this is only of concern because of our love for others and our compassion for their inability to understand what we may be doing.