Bradford, who compete three leagues below the Gunners, won on penalties after the game finished 1-1 after extra time.
“To be only three minutes away from beating a team of Arsenal’s calibre says it all,” Parkinson told the club’s official website.
“The talk after the game might be about the penalty shoot-out win and our run of penalty victories, but that shouldn’t take anything away from the lads’ performance.”