The longtime staple will close at the end of the month, making way for a new bakery that's also well known along the lakeshore.