This paper is the second in a series dealing with the structure of the full isometry group I(M) for M a connected, simply connected, homogeneous, Riemannian manifold with non-positive sectional curvature. It is shown that every such manifold determines canonically a conjugacy cl…