No, a guest account cannot be saved. When the host or guest signs out, the guest account is removed. Your guest should create a Microsoft account and Gamertag if they plan to play on this console using the same account in the future.
For more information, check out this Xbox Support article.
https://beta.support.xbox.com/help/account-profile/manage-account/set-up-and-use-guest-account