First of all, You don’t have to feel any shame or anything. You are trying to support your wife and that’s a great thing to do. Many people don’t sacrifice their comfort for their spouse. The only thing that matter is that you both are happy. You don’t have to always listen to society. Many people will say many things that doesn’t mean everything is true. You need to stay calm and keep supporting your wife. If you and your wife don’t have any problem leaving in your wife’s salary then your family shouldn’t too. If one is earning money, then the other is managing the home. That’s the beauty of life. And a man can also leave his job and come with his wife to support her. So feel proud not ashamed.