This note is concerned with isometries on the spaces of self-adjoint traceless matrices. We compute the group of isometries with respect to any unitary similarity invariant norm. This completes and extends the result of Nagy on Schatten $p$-norm isometries. Furthermore, we point out that our proof techniques could be applied to obtain an old result concerning isometries on skew-symmetric matrices.