I would rather not comment on that.

I really better not comment on that.

To be honest, I don't comment on things like that. I try not to go there.

I'm not going to comment on what the results of those polygraphs have been,

It is not useful for me to comment on it.

does not comment on rumors.