Sql Server replication requires the actual server name to make a connection to the server (Replication to Azure VM Issue)

When I try to create a new subscription for my Azure VM default database server (2008 R2), I have run into this error:
“Sql Server replication requires the actual server name to make a connection to the server. Connections through a server alias, IP address or any other alternate name are not supported. specify the actual server name”

The connection I used is the DNS name for the server:
myVM.cloudapp.net,57500
It seems the replication does not like this way even though you can connect to the database server with no problem through SSMS.
There is no server name change involved either.
The solution I found from a stackoverflow thread: .

I have included the solution here provided by eLVik:
Steps:

Read the error message and remember SERVERNAME which is in quotes.
Run Sql Server Configuration Manager on publisher/distributor side;
Expand Sql Native 10.0 Configuration\Aliases node;
Create new alias which name exactly SERVERNAME from 1. It is should be a NetBIOS machine name or NetBIOS\instance_name for named instances.
Specify another options for alias (port, server and protocol).
Repeat 4 and 5 for 32bit native client.

Test. Run Management Studio on the same machine and try connect to the server (specify alias as server name).

Repeat 2 – 7 for all client machines where Management Studio will be used for replication setup.

For my 64-bit machine, I need to create new alias for both 32-bit and 64-bit (Sql Native 10.0) as described above.
In my case to connect my database at Azure VM:

Alias Name: myVM
Port No: 57500
Protocol: TCP/IP
Server: myVM.cloudapp.net

Click Apply button when you are ready.