You might. As a general rule, you want to keep your seed about the temperature of your ground (air temp in a cool spot is fine). There is some speculation (not aware of any studies) which would suggest keeping seed in the fridge and then planting too soon (before the temps match) might cause delayed germination.