Congratulations, 114 orders so far and only the first fraud attempts - that's less than 1%. We receive like 30-40% fraud orders
Yes, keep the records in your system, just in case. You may need to reference them in the future. For instance there are some very persistent (and stupid) idiots out there that try to register twice with the same address and email but with different name, etc, the data from the fraud order may help you to catch those, in case they manage to trick the antifraud system.