Testicular infections are usually caused by bacteria and viruses. Testicular infection often causes swelling and pain in the testicles, sometimes accompanied by systemic symptoms such as fever and chills. Since the testicles are where men produce sperm, they should be taken seriously enough and you should actively seek medical attention at a regular hospital when testicular infection occurs.