Levoxyl and next morning

I am just slightly hypothyroid and could go without meds, but decided to try meds, and endocrinologist suggested Levoxyl 50 mcg per day. First day on the drug, felt exhausted by night time, next morning, usually jump out of bed for workout and was extremely tired at the gym, no energy, was starving during the day even after breakfast which is unusual for me, and exhausted by evening, and third day woke up with swollen glands and exhaustion, knew something was up. Decided to research the side effects and found others with similar symptoms and didn't like long term effects so I am going off the drug and hoping I caused no damage to my system. My doctor's reaction was "impossible" that the drug could cause this. My reaction was, "no thank you, I think for myself, know my body, and know this drug caused this reaction." I was feeling fine before 3 days ago, and how could so many have similar symptoms if it isn't the drug.