Afghanistan was destabilized long before the U.S. intervened.
I'm pretty sure that, if I were a woman in Pakistan, I would want intervention to keep the Taliban from regaining control. The situation of women under the Taliban wouldn't be tolerated by the international community if we were talking about a religious or ethnic minority instead of merely women.
And no, I'm not blind to the fact that we helped fund the Taliban when they were fighting the Soviets. If anything, that makes us more, not less, responsible for what happens if the Taliban regain complete control.