The past tense of finish quickly is finished quickly.
The third-person singular simple present indicative form of finish quickly is finishes quickly.
The present participle of finish quickly is finishing quickly.
The past participle of finish quickly is finished quickly.