Isnt it possible to fetch data in a specific interval? If you always only go 5 minutes back and query every 5 minutes that should do it (you might want a tiny overlap to ensure records created at 00 seconds aren't missed)
Update Database with API that doesnt have webhook
Hi All,
I have a laravel app that takes data from an API that doesnt have a webhook, so i need to basically fetch the data periodically when ever a new record is created (on a schedule).
This data is paginated in the response, so i have to loop through multiple pages, what is the most efficient way to update my table without downloading the entire data set every time i want to update?
Ideally if there was a webhook i would just download the data once and use a webhook to notify me when a new record has been created.
Thanks!!
Yeah very. Your best bet is using pagination to get the least data possible, but it's not optimal. If they still work on it, you could request some more control (date or datetime)
Please or to participate in this conversation.