Yep, not a bug, this is very much intentional.
Container names are used to set the UTSNAME which in turn is used as the hostname, that hostname is then picked up as the leading part of the FQDN by various piece of software. We therefore restrict the container name to match the smallest common subset of both the DNS record and hostname RFCs of all operating systems implementing containers.