yes, you can.
use a smaller screw driver, it only needs to be just snuged in a bit since it seals with an o-ring and not a gasket. Very common to see these overtightened.
You can get the old piece out with a small screwdriver pushed into the groove in the threads.