Xbox wireless mic turned off and plugged in but still picking up sound?

Yup, my mic is picking up any sound even though its showing the charging light pattern when i plug it in, and im kind of out of ways to fix it since it only has about 3 buttons