Not advisable, this is utility bill the tenant should pick up. Do you pay the waste charge as well?
Normally as with ESB when a house is vacant I do claim for the cost. I don't know if you could claim for a full tank of oil unless of course the bill is to the rental address.