I found some info about your computer at ...
Dell Dimension 2100.
No offense, but your computer is rather low tech.
My big concern is the power supply. New faster hardware could require more power than your current configuration can supply.
One thing you might not know is piece meal upgrades can cost more than a new PC that already has the upgrades you want.
If you must piece meal upgrade, I would recommend external devices... an external HDD and an external DVD. In this manner, if the new device causes problems, you still have your original computer and you can return the new device.