Having trouble giving a Larvel Forge daemon xhost permission on our Ubunutu server

I have an artisan command triggering a job using dispatchSync(). This job opens up a headed chrome browser (for scraping) on our ubuntu server. I was able to get this to work by adding the local users to xhost xhost +local: and running the artisan command as the forge user.

If I update this command to trigger the job using dispatch() so it uses horizon, ran by a daemon set on forge, the browser does not open and chrome driver crashes. The daemon is also using forge as user. Any ideas why this might be happening with the daemon? Is there a way for xhost to give permission to the daemon running horizon?