The past tense of express regret is expressed regret.
The third-person singular simple present indicative form of express regret is expresses regret.
The present participle of express regret is expressing regret.
The past participle of express regret is expressed regret.