Sure, no one is denying that Conor is a competent boxer. It's just that there is a huge difference between someone whose highest boxing accomplishment was winning an amateur all-Ireland championship at the youth level and someone who has won 15 professional world championships in 5 weight classes, is undefeated in 49 professional fights, and is considered by many to be the greatest pound-for-pound boxer of the last 25 years.
I mean, I'm competent at BJJ, but that doesn't mean I can hang with Marcelo Garcia.
Conor's one advantage is probably his age. He's 11 years younger and more in his physical prime. Even so, it would be a major upset for him to win under boxing rules. (In MMA the advantage would be his, but that fight isn't going to happen.)