Yep - Feller did in 1940. This could actually technically happen during the season as well, although it never would. Every batter could walk and then get picked off.