You may have location services turned on for your Apple Pay wallet.

To turn location services off go to 'Settings' > 'Privacy' > 'Location Services' > 'Wallet'. Change the setting to 'Never'.