The Penguin uses state birds as the basis for his crimes in Batman 58 (April/May 1950), in a story by Woolfolk, Sprang and Paris.
The Penguin tries to get a bird lovers society to proclaim the penguin the state bird for Antarctica, ignoring that it is not a US state. They do not take him seriously, so he vows revenge on them, using the birds that represent the states individual members are from as the basis for their crimes.
It’s not one of his better stories. The giant pipe organ at the climax is ok, but has no relationship to the theme of the story.