meaning - If you say in English: wear the pants in a relationship, then can you also say wear the skirt in a relationship?

What I mean is: if the person wearing the pants assumes a masculine/dominant role, then can we say someone assumes a feminine/submissive role by saying they wear a skirt in a relationship? Especially if they were not given a choice and have to accept their subordinate role?

Is it possible in English? It's not my first language and I would appreciate the comments.