ralphmorris's avatar

Blocking bots from creating sessions

Hi!

We've been having an issue with lots of bots creating redis sessions that has started to hit performance.

So I created a middleware with the following to not create the redis session if a bot is detected.

This has successfully drastically reduced the number of redis keys but it still seems higher than I would expect and so I think some bots are not getting detected.

Has anyone got a better way of detecting bots?

Thanks!

0 likes
1 reply
LaryAI's avatar
LaryAI
AI
1 year ago
Level 58

To improve bot detection and prevent them from creating sessions, you can enhance your isBot method by using a more comprehensive list of known bot user agents. Additionally, consider using third-party libraries or services that specialize in bot detection. Here's an improved approach:

  1. Enhance the Bot Detection Regex: Expand the regex pattern to include more known bot user agents.

  2. Use a Third-Party Library: Consider using a library like jaybizzle/crawler-detect which is specifically designed to detect crawlers and bots.

Here's how you can implement these improvements:

Enhanced Regex Pattern

You can expand the regex pattern to include more known bot identifiers. However, this approach can become cumbersome and may still miss some bots.

private function isBot($userAgent)
{
    return preg_match('/bot|crawl|spider|slurp|mediapartners|bing|yandex|baidu|duckduckgo|facebook|twitter|pinterest|linkedin|whatsapp|telegram|discord|skype|reddit|tumblr|quora|snapchat|tiktok|instagram|weibo|wechat|line|viber|kik|signal|vkontakte|odnoklassniki|myspace|flickr|foursquare|meetup|xing|renren|kaixin|douban|qzone|taringa|mixi|cyworld|badoo|stumbleupon|delicious|digg|slashdot|hackernews|producthunt|dribbble|behance|deviantart|500px|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|ello|

Please or to participate in this conversation.