Is the father a Mahram (Non-marriageable) to his son`s mother-in-law?

The father is a non-Mahram (Marriageable) to his son`s mother-in-law, so it is impermissible for them to look at each other, or to have a seclusion (Khalwah).

What should a person, who doubts the validity of his Wudu, or over performs it, do?

One who doubts the validity of his/her Wudu while performing it should redo it until he/she is certain of having attained purity. But, if doubt was after having performed Wudu, then he/she should not pay attention to that as doubt after the end of an act of worship does not count. This is of course in case doubt was within the reasonable limits since once it goes beyond that, it becomes a whispering of the Shaytaan (devil) which he/she should ignore as the Wudu is valid.

Is it permissible for a person who had vowed to give a certain amount of money to another, but didn`t find the latter to donate that money to the mosque?

In principle, the vowing person should abide by his vow as much as possible. Therefore, if he couldn`t find the person that he had made the vow for, then the vow itself is countless and nothing is due on its maker. However, if the latter happens to find the former later on then, he has to give him that money.

Is it permissible for the big brother to force his sisters to wear Hijjab (Islamic wear) if their father didn`t do his part in this regard ?

All Perfect Praise is due to Allah, The Lord of The Worlds

The father`s attention should be drawn gently and politely, and the sisters should also be reminded with good words since Allah, The Almighty, Says (What means): "O ye who believe! Save yourselves and your families from a Fire whose fuel is Men and Stones." [Al-Tahreem/6]. And Allah Knows Best.