Unable to generate User Certificate in Windows Server 2012 R2

I'm trying to generate a user certificate from Windows Server 2012 R2 by going to https://mydc/certsrv. The username is kk!#$%^&()_-{}. I'm getting the following error.

An error occurred while creating the certificate request. Please verify that you selected the correct CSP, or contact an administrator for assistance.

When I click details, I get the following message.

Suggested cause:

The profile for the user is a temporary profile.

Error: 0x80090024 - NTE_TEMPORARY_PROFILE

I tried for various other users which do not have special characters or just 1 special character in their name and it works fine.

Are special characters not allowed in the user certificate's SAN field? If that is the problem, then what are the characters allowed?

UPDATE

I also tried various other usernames with special characters and found that whenever the username has & in it, the error occurs.