Is it permissible for a person, who vowed to offer two Rak`ahs (units of prayer) everyday for Allah`s sake, to do so after the Fajr (dawn) prayer?
In principle, a vow should be fulfilled as it was originally intended, and if its time lapses then, it should be fulfilled at any time because of the vow. Therefore, it is permissible to offer them after the Fajr prayer, and there is no prohibition in doing so. However, it is preferable for him to offer these two Rak`ahs at some other time to avoid the disagreement amongst the scholars in this regard.
I prayed all the obligatory prayers in congregation, but after finishing the `Isha prayer, I remembered that I had forgotten to pray Dhuhr. What should I do, and is my prayer invalid?
Your prayers are valid, but you must make up the Dhuhr prayer as soon as you remember it, based on the saying of the Prophet (peace be upon him): "Whoever forgets a prayer must pray it as soon as they remember it; there is no expiation for it except this." [Muslim]. And Allah knows best
Is it permissible to swear by (Allah "The Living")?
Yes, it is permissible because "The Living" is one of Allah`s Attributes.
Who should pay the Zakah (obligatory charity) from the orphan`s money?
His/her guardian, and if the latter fails to do so, then the orphan himself/herself is obliged to pay the Zakah once he/she reaches puberty, and is capable of handling his/her own affairs. And Allah Knows Best.