That's part of it. Even setting aside the association with chattel slavery, there's also the class-based master vs servant dichotomy which is another unfortunate aspect of history.is it possible the term master in english has bad connotations due to slavery ?
In addition, there's the connotation of "mastering" a skill meaning that you have completed your understanding of it with no room to progress.
All told, the various connotations in English add up so that it's not a title I would want applied to me.