What is the difference between deleting and archiving emails?

There are roughly two ways to get an email out of your inbox, namely by deleting or archiving the message. But what is the difference between deleting emails and archiving emails? You can read that here.