Laravel's broadcasting system is excellent and provides a lot of options: https://laravel.com/docs/broadcasting
Laravel's event system handles the scenario you are mentioning.
You're going to have to also make use of Laravel Echo for the front-end portion and showing the notifications to users.
A free alternative to Pusher is the laravel-websockets package: https://github.com/beyondcode/laravel-websockets. Definitely more to setup on the server. I usually reach for Pusher first, as its free tier is quite generous with up to 100 concurrent users and there isn't any complex server setup.
I have a really old video on setting everything up. It's still somewhat relevant though to help you get started: https://www.youtube.com/watch?v=pjK0VMTCtVg