We do not currently know of any antonyms for having a soft spot for.
For similar words to having a soft spot for, try: