Application does not connect to the database after deployment on Azure

When publishing MVC app on Azure, the connection string is picked automatically but I fail to understand how the deployed app connects to the database using this connection.

There's server error: SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible.

How do I resolve this on Azure.