Tap water is generally fine for brushing your teeth, but is not recommended for consumption, particularly outside urban areas and in the current crisis. Water shortages across the country mean you should be conservative in your usage, to say the least.
According to the CDC tap water is generally not safe for consumption.
According to the Numbeo water drinkability and accessibility index, tap water has a score of 32.19 / 100 (100 being best).
Numbeo considers this score to be "Low"
1 adult could save about 767$ per year in Venezuela by drinking tap water instead of buying bottled water.
๐ณ Drinking tap water would also help with reducing your plastic footprint and improve environmental pollution.