WHy don't you set up a bank account and get your tenant to desposit the rent into your bank account.
The bank statements will then become your record of rental income. It is hassle free for you and you can easily check if your tenant has paid if you use on-line banking.
If the tenant makes a deposit, they will be given a receipt by the bank. I don't bother giving any receipts myself. Strictly speaking you are supposed to. You could type up a recipt or statement of acount every say 3 months, detailing lodgemennts you your bank account, sign it and post it to your tenant.
You should set up a file for your property which can be a lever arch file or a shoebox! Put every receipt, coresspondance etc into it.
You are better off avoiding having to call to the house regurlarly. You need to be professional(firm but fair) in your dealings. Organise inspections of the property ie give them notice and arrange a time suitable to them.