The Collaborative International Dictionary of English v.0.48:

Grumblingly \Grum"bling*ly\, adv.
   In a grumbling manner.
   [1913 Webster]