I use tongs, cooking chopsticks, or a slotted spoon to get something out of hot water; it's a lot faster than putting on a glove. But if you must, obviously you need a waterproof mitt for that so silicone is the best choice.
Silicone varies in response to heat ranges. But many silicone oven mitts will top out at 450-480F. Just something to keep in mind.
Someone gifted me a pair of Ove Gloves and TBH they're great if I need the dexterity for some time. Like cloth mitts, you can't get them wet since water is an excellent heat conductor. But most often I use kitchen towels. They're faster and more accessible than mitts or potholders.