Lossless digital is better from a sound quality perspective (Assuming decent source material/mastering). It's true that in some cases, LPs are mastered differently (sometimes better) than the digital version, though in many cases the record is cut from the same master track anyway.
You're not losing signal in digital (any digital loss is way below the analog noise floor). This is a common assertion by people with a poor understanding of how digital audio works, or who want to stand up for the logic of a record collection that they have a buttload of money invested in.
Records are fun, and they can sound very good, but there's no technical superiority. If you just want the best sound, stick with lossless digital. If you want to get all subjective, and ignore the technical merits, get yourself an expensive turntable and tube preamp, and enjoy it. (Just don't try and tell people it's better than digital)
Also, don't get hung up on high bit depth/sampling rate either. Normal 44/16 is fine. I've never heard of any properly set up ABX testing showing that _anyone_ can tell the difference with any equipment. Again, I'm not speaking of mastering differences, which can sometimes be significant, but the formats themselves.