Augustine had more sense that we do…

There is, he [Augustine] states, just one day, and it should not be understood in the same way we understand days that are measured and counted by the sun’s circuit. The day that was originally repeated three times before the creation of the sun and moon on the fourth repetition is not the same kind of day we experience. Thus, the night and day that God divided in Genesis 1:4 “are to be taken in quite a different sense from this night and day, between which he said that the lamps he created were to divide, when he said, And let them divide between day and night (Gen 1:14). The fourth day was when God fashioned the kind of day we know. But the day that was originally created had already gone through three repetitions before the lights were created on the fourth repetition.—Early Christian Readings of Genesis One, page 285 (italics in the original translation)

<idle musing>
And don't try to tell me he was influenced by Darwin and therefore compromised! He lived 1400 years before Darwin was around. And by the way, this was from his "literal" commentary.
</idle musing>