I suppose it's possible that Crichton may not even be admitting to himself how traumatic his experience with Grayza was (or at least can't bring himself to tell Aeryn about it, which any clearing of the air between them would require). My own reading of a lot of Series 4 is that they're both suffering from post-traumatic stress, to which they react in different ways.