Return different data to search bots?

Hi all,

As the title says, I wondering what the best way to return different data to search bots than regular users.

I am using an ajax call for an infinite scroll on some of my pages but Google at least does not get all of the content.

What I'd like to do is return the full page for Google and other search bots while showing the infinite scroll for others as I need to comply with a few API's T&Cs regarding how I show/fetch images.

Thanks, Rob

robsox

8 years ago

Level 1

Found this (https://github.com/JayBizzle/Laravel-Crawler-Detect) just after posting and am going to give it a run.

If anyone has any other ideas or if I should be formatting my view differently please let me know.

Thanks again.

sutherland

8 years ago

Level 28

I would just provide a fallback pagination system for users that have JS disabled. It's also a good thing so that a user who finds one of your pages in a search result and clicks it, they're actually taken to a page with what they were looking for and not the beginning of the infinite scroll every time.

Please or to participate in this conversation.