Since this is my thing, and since everyone's entitled to my opinion , in order of cold weather comfort and efficiency for a garage:
1) In-floor radiant heat. There's nothing better, nothing more comfortable, and nothing else compares. Work in your shirt-sleeves. Lay on the floor. It's wonderful. the drawback is that you have one chance to do this-- when you are building the garage. If the pipe isn't in the floor, you're screwed.
2) Forced air gas heat. The space heats up quickly, and is pleasant to work in. Laying on the floor gets cold, but at least you're warm everywhere else.
3) A woodstove. It does nothing for you when you aren't feeding it logs, but when you are-- the heat is pretty darned nice. Drawbacks-- it's an open flame. At least it vents outside.
4) Infrared heat. The idea is to warm objects under the heat-pipe, not the air around it. It's a nice theory, but stuff "in the shade" not in a line of sight under the heat-pipe gets no heat. Working under a car is not in the line of sight. It requires a gas line, and really isn't all that comfortable.
4) A heat-pump. The only advantage here is that it runs on electricity. The heat is really uncomfortable-- mildly warm(ish) air blowing around the room (nearly) constantly.
5) Electric heat. It's a nice heat, but get out your wallet-- there's nothing cheap about heating with resistance heat.
Unacceptable-- any ventless heater, propane or natural gas. It's dangerous and stupid. I did it on one of my places, and will never do it again. A good way to get kidney or brain damage, or suffer with a lifetime of autoimmune problems.
In order of preference for fueling whatever you do:
1) Natural Gas. North America (the US and Canada) are the Saudi Arabia of natural gas. The commodity itself is almost free. What you are paying for is the cost to get it to your house.
2) Wood.
3) LP. It's #3, but I'd put this about 8 rungs under natural gas if there were 8 other things to put in between. There's not, so here we are. Get a big tank.
4) Electricity. It's just expensive.