You just have to avoid attacks by jumping and running around. Really, really invest in extra jumps, I wish there was a tome for it. Even if you get hit you can get back to the shrine quickly with jumps, even with slow characters. You get a weapon back after each charge section, so if flamewalker is your second weapon, you just need to make it through the first section of the fight.