We ended up ignoring the banners in my group during the last boss. They boost his damage but they don't seem to stack with each other. We did kill the idols that occasionally popped up though and did our best to avoid as much of the incoming damage as possible. The doom mechanic is negated by being healed to full so an attentive healer is a must.
