Before you remove files, make sure you are on the host side. If you are deleting files over a network share, things will be slow. So remote into your server before deleting the files, and make sure you use the local drive to delete the files, not a network share pointing to the local drive.
Now, the next problem is making sure you are not going file-by-file, which is what the del command does.
Instead, you will want to use the rd (or rmdir) command. Normally an rd <folder> will throw in an error stating that the folder is not empty and will not delete it, but this is just a safeguard.
rd has an option to delete files too, namely /s.
So what you want to do is executing a rd /s <folder> and it will delete that folder with everything inside it in a matter of seconds.