The Collaborative International Dictionary of English v.0.48:

Billy goat \Bil"ly goat`\
   A male goat. [Colloq.]
   [1913 Webster] billyo

WordNet (r) 3.0 (2006):

billy goat
    n 1: male goat [syn: billy, billy goat, he-goat]