No, Apple Pay won't work over the counter at bank branches. You will need to use your relevant physical cards to complete these transactions.