You should be able to blacklist players, to avoid having to play with them again. For fairness, if you blacklist someone, you will automatically be blacklisted for them as well.
Users on this list will NOT be able to join games that you have already joined/created.