Msdeploy not removing the NON-empty directory during deployment

I am getting following error during deployment when there was a folder recursively removed from code. As a workaround i had to manually delete the folder from destination path on server.

Error: (12/26/2018 4:32:27 AM) An error occurred when the request was processed on the remote computer.
Error: An error was encountered when processing operation 'Delete Directory' on 'C:\Alam\Test\MSF\Config'.
Error: The error code was 0x80070091.
Error: The directory is not empty.

at Microsoft.Web.Deployment.NativeMethods.RaiseIOExceptionFromErrorCode(Win32ErrorCode errorCode, String maybeFullPat
h)
at Microsoft.Web.Deployment.DirectoryEx.Delete(String path)
at Microsoft.Web.Deployment.DirPathProviderBase.Delete(Boolean whatIf)
Error count: 1.