This is in my ~/.shrc on BSD to keep me from accidentally nuking or clobbering files I forget are there:
alias cp='cp -ip'
alias mv='mv -i'
alias rm='rm -i'
This also works in ~/.bashrc for bash, & with GNU versions of cp (except `cp -p` preserves different file attributes), mv, & rm.