You can in a pinch, but it’s much better to use distilled or de-ionised water. That’s because regular tap water contains minerals that can form hard deposits within the cooling system, increasing the risk of premature wear and tear of internal components, as well as reducing the lifespan of the coolant/antifreeze itself.