In Isaac Bashevis Singer's short story "Pigeons", Professor Eibeschutz says that he's ashamed of the religious implications of the phrase "Thank God":
Professor Eibeschutz returned to his front hall, where he kept a sack of feed, and refilled his bag. 'I hope they wait,' he muttered. When he came out, the birds were still there. 'Thank God,' he said, somewhat embarrassed by the religious implications of his words.
(translated by the author and Elizabeth Shub)
I don't recall the Professor being ashamed of his Jewish roots earlier in the story; why then does he state that he's ashamed here?