OK so after swapping out switches a few more times I've worn down the plate a bit and it's gotten much easier to pull switches. Still a couple huge annoyances though, maybe once every few days I'll hear the windows "device unplugged" sound and it will just stop working entirely. Unplugging and plugging it back in does nothing, it stays dark. Leave it unplugged for an hour and it'll start working again once reconnected.
I'm also getting double presses every once in a while which is a huge PITA when doing word processing. Definitely would not recommend.