Who gets to vote who stays on the island and who gets voted off? Just you?

If so then can you make a borderline area where we get like a test run, probation type deal and you can be fired if within a certain amount of days before you get into the union type deal like at work?