I did experience this issue with my iOS devices. It turned out that using aftermarket adapters is the cause as the issue never happened to me when using the adapter that came with the device. And as per checking several forums, Android users say the same thing. I suggest you try to use both a stock charger and an aftermarket one and compare if there is a difference in the responsiveness of the touchscreen of your device.