Thanks again. It is a relief to hear your opinion. I think I am going to reconsider keeping joint legal, and stay with my original petition for sole. At least in the process, I have set myself up to accept joint legal if the judge orders it. I will still ask that he can have his supervised visitation one night - overnight - with his mom, so they can still go to the shore house (which my daughter LOVES) over the summer (it would still work out in the school year too). As much as I dislike his mom personally, I know she wouldn't let him do any drugs around her.
Btw, he does not live with his mom. He just left staying with me and is staying at random friends' houses until he gets his own apt. (if he ever does!).

Thank you again, I feel better after hearing your input (and no, I won't used it against if you are wrong later)