Controller latency issues PC

Has anyone had an issue with their wireless Xbox controller becoming, “laggy”. There are times when I try to press “A” and the game takes a second to register the button press. I have updated the controller and have tried bluetooth and wired, I even went out and bought a new controller thinking my old one was busted. Some games are fine, and others become an unresponsive mess. I have switched to kb&m and have not encountered any issues.