no dont remove lvm1. keep both lvm1 and lvm2.
if you have an older version of lvm1 installed, you'll probably get an error complaing about conflicts if you try to install lvm2. so first upgrade your lvm1 to lvm-1.0.3-17. it along with almost all required upgrades can be found at
http://people.redhat.com/arjanv/2.6/RPMS.kernel
here r wut u need to install or upgrade before upgrading to kernel 2.6:
devicemapper-1.00.07-1.i386.rpm
initscripts-7.28-1
kernel-utils-2.4-9.1.102
lvm2-2.00.08-1
mkinitrd-3.5.7-2
module-init-tools-0.9.15-pre4
nfs-utils-1.0.5-1
almost all of them can be found at the URL above. if you are using rh9, some important notes can be found here
http://thomer.com/linux/migrate-to-2.6.html