According to the WHO, tap water is safe for consumption for 99% of the country.
The tap water quality is about the same for rural and urban areas.
Tap water is safe to drink but sometimes has an unpleasant taste (in some areas it is slightly saline) so many locals use filters or spring water dispensers at home. Bottled water is available everywhere. Do not drink water from rivers or lakes as it may contain bacteria or viruses that can cause diarrhoea or vomiting.
According to the CDC tap water is generally safe for consumption.
According to the Numbeo water drinkability and accessibility index, tap water has a score of 70.44 / 100 (100 being best).
Numbeo considers this score to be "High"
1 adult could save about 905$ per year in Israel by drinking tap water instead of buying bottled water.
๐ณ Drinking tap water would also help with reducing your plastic footprint and improve environmental pollution.
Like in most countries, water quality and accessibility differs from location to location, therefore it's the best to check the information available on that place.