It's not a matter of belief, just a straight up fact.
The toggle is a neutral switch. It has no will of its own and it won't be forcing or coercing anyone into using it. Having PvP off is a conscious choice. If you actively blockade yourself from PvP, no matter how many times you say you want PvP, your actions show otherwise. It's akin to going to a party saying you want to stay sober, but the first thing you do when you arrive is drink until you're comatose, and then blame the party for having drinks on free offer.
It's people taking cover behind this "everyone else will turn it off" to have themselves set to PvE who can possible kill "world PvP," nothing else. Not the toggle, not PvE players removing themselves from PvP, not us. People who are serious about wanting ganking are invited to have themselves set to PvP and never turn it off. Who will decide if the server has active"world PvP" are the PvPers and the PvPers alone.