The usual reason that windows will not allow you to delete a file you have permission to delete is because the file is open. Running a program or a service is one way in windows that files are opened. Check to see if there's still any services or registry start keys for any norton related files, remove or disable them, reboot and then you might be able to remove the remaining files.

-David