In principle, sure. However, You have to keep in mind that the feed is still full of the previous ink. So when you swap in an other converter with a different ink you still have to clean the pen.
Also there are no caps for converters, so your other previous converter, which I assume still has ink in it would just sit there, a leak hazard and the ink slowly drying out.
It would be easier if you just emptied the original converter cleaned it along with the feed and filled it with a different ink.
If you want quick access to different inks your only viable option is to get more fountain pens, each with its own converter, filled with its own ink.