It is very common and nobody will shame you for asking water in Brazil. Some cities even have laws mandating that filtered water should be served for free.