The only time a person passes is on the first roll - and that is only if they lose the roll. (That is each player rolls 1 dice - high dice goes first, so if your opponenet gets the lowest dice, they have to "Pass" to you so you can start.)