"But" at the Beginning of Sentences

But at the beginning of a sentence can sometimes be permitted on grounds of syntax (But for his habit of whistling Mozart tunes, Michael might easily be assumed to have no culture at all). And one may certainly cut some slack for a writer who begins a sentence with a conjunction when the argument can be made that the new sentence builds upon something earlier (as is this case in this very sentence and the one that follows).

But then there's the problem of an entire work that begins with a conjunction. About three years ago, I put together a playlist of YouTube videos for a fun online contest and asked the players to find out what they had in common. I see that one of the clips has since been removed, but here's the sequence:

1. Jerusalem, sung by Mary Hopkin
2. Walk Away Renée by the Left Banke (sung by a trio of animated Minis against a background of Stonehenge)
3. My Way, the Paul Anka song associated with Frank Sinatra, as sung by Sid Vicious
4. a live version of Mrs Robinson by Simon and Garfunkel
5. Signs, by the Five Man Electrical Band
6. Aubrey, by Bread
7. Divorce Song, by Liz Phair
8. a live concert performance of Walk On, by U2

The connection, of course, was that the lyrics of all eight songs begin with the word and.