Relationship between Layer, View, Viewer, and Context

I have a single context and single viewer, but create multilple views so the scene can be viewed from different directions. For each view I create a Visual3d_Layer so that I can add text and linework. I'd like to add different text to each view. Unfortunately, all views appear to draw the same overlay layer, the last one I created. Is there any way to get different views of the same context to use different overlays? For performance reasons I'd really like to avoid creating 4 different viewers and 4 different contexts, each containing an identical set of shapes.