"In the next week" means "sometime within the next seven days." It may be easier to understand if I use months instead of weeks as an example. Right now, it is May, so if I say "next month," I mean sometime in June. However, if I say "in the next month," I mean "sometime in the next thirty days." Those thirty days include some days in May.
Right now, "next year" means 2022. "In the next year" means anytime between now and May 25, 2022. "Our store will reopen sometime in the next year" could mean that I'm planning to reopen the store in August. "Our store will reopen next year" means it will definitely not reopen until at least January.
The same is true with weeks. "Next week" starts on either Sunday or Monday, depending on what kind of calendar you use. "In the next week" means anytime between today and one week from now.