Clomid and libido are like opposites, once the zuclomiphene builds up in the bloodstream, kiss libido goodby. The zuclomiphene is the estrogen receptor agonist, once elevated there is little to no libido.
This is why you always hear men speak of having libido initially on clomid, then libido tapers off and that is because zuclomiphene building up in your system.