Tap water is generally safe to drink, though it's best to check in advance at your hotel or rental villa.
According to the CDC tap water is generally not safe for consumption.
According to the Numbeo water drinkability and accessibility index, tap water has a score of 75.0 / 100 (100 being best).
Numbeo considers this score to be "High"
1 adult could save about 1825$ per year in British Virgin Islands by drinking tap water instead of buying bottled water.
๐ณ Drinking tap water would also help with reducing your plastic footprint and improve environmental pollution.