The Collaborative International Dictionary of English v.0.48:

Drollingly \Droll"ing*ly\, adv.
   In a jesting manner.
   [1913 Webster]