RFD vote to kick abuse

Sometimes, when you join an RFD group with a pre-made group (3 or 4 players) you can be kicked right before boss without any reason (I am 1st or 2nd in damage done metric, don't wipe party or doing something bad to group). Probably, I am getting kicked because some of the players wanna same gear that I can need (rare trinket for example). There is any way to report that players or something? In all cases, they were from opposite fraction, so I can't ask them why I was kicked. It's quite annoying to waste time (~20 min waiting for group and ~10 in dungeon).