Your E2 isn’t that elevated (some would argue that it isn’t elevated at all). So it is possible you won’t feel anything from lowering it.
A fact that is little discussed is that in most men FREE estradiol drops with age even if total estradiol rises. You can google or pubmed studies on his if you want. (Thus, for example, the apparently paradoxical loss of bone mass with aging despite increasing total E2.) If this is the case, reducing E2 with an AI may not be good for health, rather the opposite.
In any case, very few men report any significant improvement with arimidex monotherapy. If your goal is faster recovery, I really doubt you will achieve that with arimidex.