You can do this with the guest mode of the Google Assistant

Google recently rolled out Guest Mode for the Google Assistant. This is not an incognito mode for the voice assistant, but guests in the house will not be able to access personal information either. We will explain in this article what it is and what you can do with it.