Leonard was flat out better than Hagler. Quicker, more versatile, more athletic, more talented, and mentally tougher. He would have beat him worse in 82/83 without the layoffs.
In fairness I think SRL would always have caused Hagler problems because of his speed and versatility.