OUP: We have a DuroMax XP4400E Generator (4400 W) and just manually plug in what we need. (Here it is on Amazon:
DuroMax XP4400E)
In a dire emergency, I could temporarily wire it into our oil burner. I last used it for the first time this past summer when we lost power for a couple of days and needed to rebuild the carburetor (with my neighbor's help). For a whole-house generator and proper installation (using a transfer switch) you'll pay 10X-20X the amount of this little stand-alone unit.
It's a good thing you don't have oil heat there. At those temperatures the oil in above-ground tanks & pipes turns to sludge and won't pump without an additive to lower it's viscosity.
Strength_and_Pow: An alternative to a UPS you might want to look into, for low-power devices, is a lithium battery power station. This is the one I have:
BALDR Portable Power StationIt even states CPAP backup as an application. I use it for charging phones, etc and running low power lights, fans, etc during blackouts.
Stay Warm Everyone! You're in our prayers.