What is (and isn't) a GMO?

Many nations ban them, most people have eaten them, and some actively protest in opposition to their existence, but what exactly is a genetically modified organism, and what are some things that aren't a GMO but are nonetheless often confused with them?