Best way to handle dynamic sitemap laravel for large sites?

hey everyone, hope you're all having a productive week. we've been working on this 'Dynamic XML Sitemap for Laravel' tool for a while now, primarily because dealing with sitemaps for our own and client sites, especially as they grow, is just such a headache. trying to keep them updated manually? no thanks.

our main goal with it, naturally, is to make sure all new content – whether it's a blog post, a product page, or user-generated content – gets picked up and indexed by search engines, especially Google, as fast as possible.

the thing is, even with an auto-updating sitemap that pings Google on changes, we're still seeing some frustrating delays. sometimes Google just seems to take its sweet time picking up new URLs, particularly when the content is super dynamic or for really large sites with thousands of pages. it's like, c'mon Google, catch up!

so, i'm here to pick your brains. beyond just having a perfectly generated, auto-updating sitemap and submitting it via Search Console, what are the actual best practices or even some clever 'hacks' you've used to really push for faster laravel indexing of dynamic content? we want to cut down that indexing lag.

specifically, i'm curious about:

• what's your take on optimal sitemap submission frequency? is it better to submit daily, or only when significant changes occur? are there other methods besides just GSC?
• how do you effectively leverage Google Search Console for dynamic URLs? beyond the basic 'request indexing' for individual URLs, which isn't scalable for thousands.
• any server-side considerations for handling really large sitemap files without bogging down the server? caching strategies, perhaps?
• what common mistakes do you see people making with dynamic sitemaps and indexing that might be slowing things down?

anyone faced similar indexing challenges with dynamic sitemaps and found effective solutions? appreciate any insights you guys can share!