Darren Ambrose inspired a 2-1 upset after extra time at Old Trafford.
Ambrose broke the deadlock from long range, but United bounced back with Federcio Macheda scoring from the spot three and a half minutes later after being hauled down in the area by Patrick McCarthy.
Substitute Glenn Murray secured a win for Crystal Palace in extra-time at Old Trafford.
