Happy to help!
I’d just turn rocket loader off entirely, like I did, to be honest.
Better to use a good Wordpress optimizer instead (or a couple of them).
I am not related to them in any capacity and I don’t have their paid versions, but this is what I use for performance (I host on NGinx):
- Autoptimize
- Asset CleanUp: Page Speed Booster
- Nginx Cache
- WebP Express
- WP-DBManager
- Rank Math SEO (I found it better than Yoast etc)
- All In One WP Security
I won’t get into setting up those, sorry, lots of things to do on each, I would not even remember if starting over, would face many of the same problems again LOL.
A bit over half of a decade running Wordpress, this is what I came up with, so far, performance wise.
The rest is testing things out, turning them on and off. And, if you can, get rid of Google Fonts or any other fonts by manually editing your themes (you can customize the CSS but it’s not as efficient if you can edit the theme files directly) to use native fonts like Arial instead of whatever fancy font people chose in your case. I get people like to be stylish but I prefer to have my site loading much faster without pinging a third party server or loading an additional file just so 3% of the pixels of each letter are slightly improved.
But that’s my personal choice, of course. I also stopped using Google Analytics, it slows down a lot, I just rely on Cloudflare stats and Google Search console.
That also means I don’t need to bother with cookie consent. No cookies, no need to ask for permission, just have a quick notice informing users that there’s only essential cookies or, incidentally, you might get a cookie from an embedded item like a YouTube video or Tweet Quote. 
I always have 100 or similar speed score on budget hosting. 