Assuming it is possible to get it (unlike the secret characters on the Music Star) and its for us collectors it'd probably be the multi-connection characters from the P's. Most people find it hard getting one P's, nevermind 3 >w<.
The rarest character as in, the least known about is probably gonna be one of the anime-exclusive characters who only appears in one episode... there are quite a few of those kinds of characters.