Yes, defining potency correctly, as effect per milligram.
However, as the number of milligrams (or micrograms) is not in itself an important thing – who cares that the number is less – potency really is not important.
If a drug gives equally good effects with less side effects but requires 10 times the milligrams to do it, it’s still the better drug despite being less “potent” (effect per milligram.)