Bill Cosby was just "having a good time" back in the day when he was giving Quaaludes to women in hopes of having sex with them ... and that's a real quote from his former manager. Andrew Wyatt joined us on "TMZ Live" Thursday and we asked him...