Can men have enlarged breast lymph nodes? by Specialist In men, lymphoma, lymphadenitis, breast cancer or local inflammation can also lead to swollen lymph nodes in the breast, so it is important to consult a doctor for a clear diagnosis.