Can you go to Bank B, borrow, say 195K, at a variable rate - then pay off 195K from the original fixed rate mortgage.
Now you have 5K at the original fixed rate and 195K at the variable rate. And you haven't broken the fixed rate mortage, it still exists just a reduced capital amount!