From the article:
On average, testosterone levels did not decline significantly over five years; rather, they decreased less than 1 percent each year, the authors reported. However, when the investigators analyzed the data by subgroups, they found that certain factors were linked to lower testosterone levels at five years than at the beginning of the study.
“Men who had declines in testosterone were more likely to be those who became obese, had stopped smoking or were depressed at either clinic visit,” Wittert said. “While stopping smoking may be a cause of a slight decrease in testosterone, the benefit of quitting smoking is huge.”
[…]
Unmarried men in the study had greater testosterone reductions than did married men. Wittert attributed this finding to past research showing that married men tend to be healthier and happier than unmarried men. “Also, regular sexual activity tends to increase testosterone,” he explained.