Kicking people in instances.

I have a question. I've been in an icc10 (with global) and i got kicked after the 4th boss (no roll on items either) and the GM said they are not giving help regarding such matters.
So, are you allowed to make a raid for icc10/25, then just kick whoever u do not like after you did some bosses and not even allowing them to roll on the items it dropped since then?
I already waited for 4-5 days to get a repply on the ticket so i hope someone with better knowledge than me can answer it here.
Thank you and Happy New Year!

What knowledge do you want? You went with some randoms, not trustworthy by default and happened what is to be expected.
You learned everything you need to know.

I thought they might be a rule that dissalowed things like this to happen.

Dude, that's hilarious. But I understand why you would have such a false impression with all the rules that "help" upstanding players like yourself. It is great to turn your brain off and there is rainbow behind every boss, until you realize - its just an illusion to make it hard for you to see and avoid those brown stains behind it. Just like it happened to you.

To report such things you should make screenshots, upload them into imgur and create a ticket with links. Try to show raidframes and the most of the relevant chat.

What IcarNS said is correct, that's the only way they can do anything and they can and will ban for that type of stuff. Ignore the obvious troll type responses that are just out to troll.

There's nothing in the rules particularly against kicking a raid member out after a certain number of bosses, so far as I know.

If they operated some sort of loot system other than the default Group Loot or Need Before Greed, and did not declare that at the start of the raid, you *might* be able to petition for a Ninja Loot judgment if you had screenshots of them withholding loot that would otherwise be usable by you without giving you a fair chance at claiming it. I wouldn't guarantee it, but framing it in that fashion and providing evidence would be your best bet.