Faction Change Question

I am considering changing factions and was wondering if anyone could confirm you do not loose your arena points if you switch?