Session flash message logs out user without remember_me (Laravel 5.2)

I ran into a problem where a user without remember_me set to true during login, logs out randomly. Looking in further, I've noticed that this only happens when a redirect is made with ->withErrors(...) or ->with(...) or even when Session::flash(...) is used. This does not happen for a user with remember_me set to true.

Is it supposed to be this way? Is there a way to fix this?