Apple pay and Google wallet, how secure?

How secure is Apple pay and Google wallet? With many merchants and stores accepting Apple pay and Google wallet, what should I be concerned with about using either of the two for payment? Can unauthorized transaction be performed with the two without the one using Google wallet or Apple pay knowing? How long are the data collected by the merchant stored on their server?
