Oh sh*t! Bye-bye pacis, cue the meltdown?

Poke a pin hole in it and it will make the binky unsatisfying to him. He'll give it up on his own. Just make sure you do them all so he can't switch them out.