I managed to take it out with a breaker bar and vice, I wrapped the shifter in a old towel so I did not mess up the chrome . After taking it out I was able to see it has red lock tight on it, so that's probably why its so hard to get out! After pulling it out I reapplied lock tight and put it back where it would sit right, it feels nice and firm now.
I hope this helps and good luck!