@aurelianspodarec its not that straightforward.
You can have thousands of users logged in but not making any requests, so not loading your server at all.
Suppose your server could only serve one request at once. If that took 100ms to return the response, then a second user accessing the server at the same time would wait 100ms, and a third at the same time 200ms. Then if a third request came in 100ms later and a 4th 100ms after than then suddenly work starts to queue.
Now suppose your code is so poor, or your database queries so complex that each request now takes 1 second and not 100ms. Seems obvious but you have now gone from 10 requests per second to 1 request per second.
Now, instead of users waiting 100,200,300ms they are now waiting 2,3,4 seconds. Not only are they now seeing longer wait times, but the chances of more users making requests at the same time has gone up significantly.
Fortunately, web servers don't only serve one request at a time, and with more memory and more threads they can serve more and more concurrent requests.
But there is no hard and fast rule because it involves too many factors.