Simon Cowell's speaking out about Liam Payne ... saying the loss hit him hard -- but you can't pin someone's life on a guy 10 years after he signed them to a music deal. "The X Factor" mogul addressed the chatter that he somehow played a role...