Which author is credited with the phrase, “I would prefer not to.”?

Explanation

The phrase “I would prefer not to.” is famously written by Herman Melville in his short story "Bartleby, the Scrivener." Edgar Allan Poe, Thomas Gray, and Henry David Thoreau are notable authors but are not associated with this quote.