Since it is a standalone server, you shouldn't have a need for NFS (unless you want to do local mount, but that's another story).
You can always reinstall the relevant packages later on, and re-enable it.
If you are referring to whether you should compile your kernel with NFS support, I think you should, since you may have a need for it in the future. NFS server is the insecure part, but the kernel compile is the client side of things, so it doesn't make too big of a security risk. The server side is just regular userland packages; no kernel involved.