I agree. If only pro sports fighters are elite then there would not be many (if any) elite fighters in their 40's. And I know some very good fighters well over their 40's.
My master is in his mid fifties and I have never met someone with more skill and knowledge about martial arts. A lot of text books and articles will refer to the Hwarang (sp?) as elites, whether in fighting or just as upperclass. I think it is a more general term than many realize.