All perfect praise be to Allah, The Lord of the Worlds. I testify that there is none worthy of worship except Allah, and that Muhammad, sallallaahu 'alayhi wa sallam, is His slave and Messenger.
In this case, you must ask the Mufti to clarify to you what he had meant with his Fatwa; whether he had meant prohibition or dislikeability. If you are unable to do that, then you may ask a scholar whom you trust and act according to the Fatwa he issues to you. The matter is easy, praise be to Allah.
Allah knows best.