Assuming this is an owner-occupied home, I would only consider Option 2 as a temporary emergency solution while you save the funds for Option 1. However, you would only be kicking the can down the road and it should be cheaper in the long-run to get Option 1 over and done with.
I would run a mile from Options 3 and 4 unless the property is rented out and you don't care about massive electrical bills.
You should also consider converting to Natural Gas if it is available in your area.
As with any heating upgrade, you should also ensure you have a high standard of insulation or else you will essentially have a system which is super efficient at sending heat out through your walls.
Finally, make sure your new boiler is serviced annually by a registered installer. Otherwise, you may void the warranty.