As described in historical dictionaries

Patronymica Britannica (1860)

HORACE. I do not see why this name should not have been derived, through the French, from the Roman Horatius ; but Mr. Ferguson deduces it fi-om the 0. Saxon, Fi'iesic, and Norse, hros, Iwraz, hross, a horse.

Lower, Mark A (1860) Patronymica Britannica: a dictionary of the family names of the United Kingdom. London: J.R. Smith. Public Domain.


BritishSurnames.uk is a Good Stuff website.