Multiple websites using host headers - how to set default site?

I have multiple sites set up in IIS 7 sharing the same port and SSL. This is on an Azure VM. I associated different domains to the sites via host headers and hitting those domains works correctly. However, if I navigate to the box directly without the DNS entry (e.g., http://myazuresite), it defaults to the second site I created instead of the first. How can I set it up so that the default site when you hit it directly (via IP or machine name) goes to a particular site? I can't figure out how it chooses the site to default to.