The answer is almost always "yes", but you need to give more details, otherwise answers can only be vague.
While your question is about chaining routers, which works (apart from possible care needed over double NAT), the solution seems unnecessarily complicated. You might want to go for a much more direct and simple solution.
What we need to know, to say more, is - country, ISP, connection media (fibre, copper, dedicated link, whatever), the internet connection type on that media (ADSL, ADSL2, VDSL,...) that's actually coming into the premises, and what modem/router equipment the ISP and you, have connected to it. If you can add a photo of any label and the ISP box, that would also help.
The reason being that, it may well be that the ISP modem is itself a poor choice and you should get a different one, which solves your issue much more directly. All *DSL and fibre connectivity rends to be quite standardised, so if your current ISP box isn't doing what you need, or gets disruptive updates, it is quite/very likely that you can keep their box safe in case you ever need to show or return it, and but a cheap different box that does the job you need without disruption.
(Also as a slight digression, many ISP provided routers are often "cheap" models. I don't know if that's the case for you, but it's worth bearing in mind. They routinely have shocking security lapses (plenty of research on this - Google it) including in some cases "well known" backdoors/unsecured internet-side admin logins, they run on lowish power CPU/RAM compared to what one might actually want to use, which limits connection capabilities, and updates may only be for a limited period. This night not apply to you, but I wouldn't treat one as secure or use it for routing, I'd always pass through directly to a capable trustworthy device.)
Coming back to your situation, I had a similar issue (UK, fibre link, VDSL). I replaced the ISP router with a plain VDSL modem, backed by a software router ("pfSense") that's cheap, extremely powerful, almost certainly a ton more secure (FreeBSD + open source + security audits), and gets continual updates long past the point where an ISP product would get none. The router automatically handles the PPPoE and CHAP authentication required by my ISP, and even on a 15 year old P4 it's still probably way more powerful than any consumer router so it never slows or drops connections due to lack of resources. Its been a stable setup for maybe 8 years now, with no issues at all, and I basically forget about it for months at a time between config modifications and updates. I have a lot more confidence in it than I would have in any ISP supplied router.
The ISP router is in a store cupboard in case they ever need it back, or if there's a fault and they won't repair unless its a problem on their equipment too, but those are the only situations its used, and its been used maybe once, perhaps twice, in all that time, to check if a fault would still be present when their equipment was used - it was. Once the fault was fixed it went back in storage and my usual equipment was reconnected.
