Had it been stored somewhere damp before you got it (you may not be able to find out though)? I store mine in a shed with a moisture trap next to it, it seems to help keep it fresher.
I used to work at an agricultural college and they used to store their hay in a open sided structure. It was crazy, the amount of hay they had to chuck every few weeks due to mould must have cost them loads.