As someone who has had the pleasure of reading The Silmarillion, I can attest it is a supreme work of literature and a joy to (and in my opinion, superior to LotR).

In other words, people's tastes are their own. Don't let this person put you off.