Milk

Does milk have enough estrogen to have side effects on a guy such as increased catabolism? I think that I read some where that this can occur.