Edit /etc/lightdm/lightdm.conf and add the following to exsting section.
allow-guest=false
For previous versions
apt-get remove gdm-guest-session
Why oh why would such a stupendously insecure option be enabled by default and be so difficult to turn off?