No, they get the extra day's pay either way.
My reading of the Organisation of Working Time Act 1997 leads me to understand that when the normal working day of the part time employee falls on a public holiday and they do not work, the pay arrangement is the same as for the other part-timers i.e one fifth of their weekly pay, which is therefore less than they would otherwise receive.