Is it permissible to pray with a heater (stove) in front of me?
There is no harm in praying with a heater in front of you, as long as you do not intend to venerate the fire or imitate those who worship it. And Allah Knows Best.
I took a housing loan from the bank for a 20-year period. Four years have passed, and I recently learned that this loan is usurious. I wish to perform Umrah. Am I permitted to perform it? If not, what should I do?
You are permitted to perform Umrah. Strive to repay the debt in hopes of reducing the amount of usurious interest. Allah Says (What means): "And there are others who have acknowledged their sins. They had mixed a righteous deed with another that was bad. Perhaps Allah will turn to them in forgiveness. Indeed, Allah is Forgiving and Merciful." [At-Tawbah/102]. And Allah Knows Best.
Which is better, to pray at a prayer place (Musala) whereas many people pray in it, or at a near by mosque in which a few people perform prayer?
Praying at the mosque that has a bigger number is better so long as the number of praying people at the other mosque permits performing prayers in congregation. And Allah Knows Best.
Is prayer nullified by having thoughts while performing it?
Prayer isn`t nullified by having thoughts while performing it, provided that the praying person offers all of its pillars and meets all of its conditions. However, the reward decreases significantly in the absence of reverence since a praying person is rewarded according to the attentiveness of his/her heart during prayer.