If there is a player you no longer want to be matched with you can remove them by going to their profile and selecting the options button. From there you can opt to remove them from your match list. Doing this will prevent you challenging them to live play.