As long as you use something like fail2ban you should be okay. If you really want to go hard there are things like authentik or even vlans to keep your important stuff separate from exposed services.

I’ve been using a jellyfin server with SWAG on an unraid server for years with a few friends with 0 issues.