If you look at 1800s baseball photos, they did wear a variety of cap styles including some without the front bill. Old college religous school teams, and likely women's teams, sometimes wore unusal caps.
