I'm not an expert, but yes there is a small difference. Lossless music will be clearer, more crisp and detailed but if you're not a audiofile, you won't really tell the difference that much. But of course, not only the supported formats is important. An audio player, compared to a phone, is dedicated to music so the components inside will provide a better sound quality and less distortion. Some of them has a normal 3.5 audio jack with an aditionnal balanced port and/or a line/coax out. Some also provide the option to be used as USB Dac for your computer for example, which would output better audio than what your computers's sound card would offer.