Jim Harrison's career spanned most of the decade of the 1940s. He was a three-year letterman in both baseball and football from 1947-49, before graduating in 1949 with a degree in education. In 1949, he was captain of the baseball team, which captured the first OVC championship. He then signed a professional contract with the St. Louis Brown's baseball team.