An enzyme that breaks down a nucleic acid by removing nucleotides one by one from the end of a chain.