If your alliance is public, you cannot kick players, as they would just be able to rejoin right away. 

If you would like to have control over who joins your alliance, you can switch it to private by opening the alliance menu, selecting "edit," then unchecking "Public Alliance."

You'll then be able to kick other players!