If it is frozen solid at 20F, its water, not coolant. Someone added an incorrect mixture. If it only hit 20F for one night, its not likely a deep freeze that would crack your engine block, but that is a risk you are running until you get the fluid drained and replaced. Your radiator or expansion tank may have cracked. Only time will tell
You don’t want to go under a car supported by a jack. That said, you should never need to go under a car to change a tire. I change tires using just a floor jack