Here is the reality of the situation.
Your chip in your card, when it makes a transaction, creates a one time unique transaction number that allows the charge. Your account number, name, and other details are not used. It is a one shot thing.
To do the transaction, if someone could actually walk near you and scan the card, with no interference from other RFID cards, they would need to have a merchant account and be set up to handle transactions, so there is a record of who scammed you, like showing your passport when robbing a bank.
All the CC company has to do is reverse the transaction and delete their access...so from a criminal mastermind standpoint, it just does not work.
If you get warm fuzzies from buying all sorts of RFID items, go ahead, a feeling of false security is better than paranoia and worry after all.