The Collaborative International Dictionary of English v.0.48:

Abstinently \Ab"sti*nent*ly\, adv.
   With abstinence.
   [1913 Webster]