How to store Store the cupcakes in an airtight container at cool room temperature for 3 to 4 days. You can also freeze the fully assembled cupcakes for up to 3 months. Just wait to decorate them with the Biscoff cookies until after they've thawed, so the cookies stay crisp.