Time of day, month, year–all of this is as important as geography in your story. If you find yourself struggling with a story, sometimes it’s difficult to remove a doctor from a hospital setting or a lawyer from a courtroom.
Seasons bring weather differences and holidays which can add something extra to your story. Everyone seems to be in rush near Christmas and night comes quicker.
Summer usually means thunderstorms and longer days. Even if your story is presented inside, the weather outside can affect it. Holidays are conversational with your reader. It will evoke their feelings of that holiday. But its the same dressing as setting a story in a gothic manor or in outer space. Holidays and seasons create an aesthetic you can play into or play against.
Likewise, your feelings on the season will likely frame your story. Are summers hot and humid or a chance to get out on the beach?
If a story isn’t working in the original season that you set it in, switch it up, or focus on what makes that season help tell the story you want to tell.