Although these foods have been linked to lower testosterone levels, they aren’t replacements for anti-androgen medication. You might’ve heard that certain foods can decrease testosterone levels.