The Collaborative International Dictionary of English v.0.48:

Regressively \Re*gress"ive*ly\, adv.
   In a regressive manner.
   [1913 Webster]