He was unpopular with his team mates early in his career, and was suspended for punching an umpire.
I would suspect that had some sway with early HOF voting and by the time the huge push in the 60's and 70's came along for pre-war players, he was probably largely forgotten.
https://sabr.org/bioproj/person/303fac26