After a solid high school career Herb Scott chose to play his college football at Virginia Union University. Herb became a four year starter for the Division II Panthers and he helped to lead the 1973 Virginia Union team to the school's first conference title in 50 years. Along the way Herb was named first team All Central Intercollegiate Athletic Association three consecutive years and was twice honored as a Division II first team All-American. He was the first Virginia Union player to be so honored. After completing his stellar career Herb Scott was inducted into both the Virginia Union and CIAA Halls of Fame.

In spite of obvious talent, Herb Scott was not certain of a professional career due to playing for a very small school. Fortunately, in the 13th round of the 1975 NFL draft the Dallas Cowboys made Scott the 330th player selected. He became one of the dirty dozen a group of twelve rookies to make Tom Landrys roster that year. This group is credited with being the catalyst for the Dallas success over the second half of the decade. Herb Scott's rapid development allowed Dallas to trade John Niland for the draft pick that brought Tony Hill to the Cowboys. The following season Scott became the full time starter at left guard replacing the aging Blaine Nye. Over the next several years he proved to be one of the most solid interior linemen in the league. Along with Pat Donovan, John Fitzgerald, Jim Cooper, and Tom Raferty; he formed a group that called themselves the four irishmen and a scott. This line, especially the guys on the left, Scott and Donovan, formed the core group of blockers whose efforts helped Tony Dorsett to a Hall of Fame career as a running back. Speaking of the guard that led the way on so many of his carries, Tony Dorsett said "when Herb goes after a guy, the next thing you see is feet in the air". Perhaps the most memorable play of Herb Scott's career came on a Monday Night Football game at Minnesota in 1983. Cowboy fans remember this as the play were Dorsett took the football 99 yards for a touchdown. It was Herb Scott, along with Tom Rafferty who set the block that sprang TD for his record setting run. One other play from Herb's career will always be remembered as the answer to a trivia question. Herb Scott caught the last pass of Roger Stauback's career. Unfortunately, Herb was an ineligible reciever, and the play went for naught.

After the 1980 season Herb Scott was named as the first team All Pro guard, becoming the first Dallas linemen to receive this recognition since Rayfield Wright. It was the first of two All Pro selections and five Pro Bowl selections that he would earn. During his ten year stint in the NFL Herb Scott would also help win 3 NFC crowns and Super Bowl XII. Unfortunately injuries took their tole on Herb's body; even though the Cowboys tried moving him to tackle to ease the effects, Herb was forced to retire after the 1984 season.