If $R[G]$ is right principally injective, then $R$ is right principally injective and $G$ is locally finite. (The converse is false.)
If $R$ is right self-injective and $G$ is locally finite, then $R[G]$ is right principally injective.
Reference(s)
W. K. Nicholson and M. F. Yousif. Principally injective rings. (1995) @ Theorem 4.1 p 91