Perhaps Brown's most memorable moment as a Raider came during Super Bowl XI, when he intercepted a Fran Tarkenton pass and returned it a Super Bowl-record 75 yards for a touchdown. NFL Films immortalized Brown's play with a film clip of Brown running with the ball, appearing to be running straight to the camera. His record stood for 29 years until it was broken by Kelly Herndon's 76-yard interception return in Super Bowl XL.

Brown retired after the 1978 season, and finished his Raiders career with 39 interceptions, tied for first all-time on the team. He finished his 16 professional football season seasons with 54 interceptions, which he returned for 472 yards and two touchdowns. He also recovered three fumbles. Brown is a member of the American Football League All-Time Team and was inducted into the Pro Football Hall of Fame on July 28, 1984, his first year of eligibility. In 1999, he was ranked number 50 on The Sporting News' list of the 100 Greatest Football Players, making him the highest-ranking Raiders player.

This Oakland Raiders mini helmet was signed by Brown and inscribed, "HOF 84." This mini helmet includes a Leaf sticker and COA.