Ray J has responded to Kim Kardashian and Kris Jenner's defamation lawsuit ... and his rebuttal is as stunning as it is brazen. TMZ broke the news ... Kim and Kris were fed up with Ray J claiming they're the subject of a federal criminal...