Hi Mikkel,
You can say: turn on the water, turn on the faucet or turn on the tap. All are correct. You can also say, turn on the hot/cold water.
Open the water, is not correct. If there is a valve on a pipe, you could say, open the water valve. You would still say, turn on the water.
Hope this helps!