请问一下老师，以下4个句子中括号部分只能填did结构吗？  我4句全填了had done结构，这样就不对吗？

I'd rather he (left) earlier.  （leave）
I'd rather you (didn't speak) to him.  (not speak)
I'd rather my father (settled) the account.  (settle)
She'd rather you (didn't tell) anyone about it.  (tell)