It's tough to say, but if they are seemingly "holding them hostage", then they may understand something. Roger heard all of the voices, and I think that went for the Poneglyphs as well. I think Rayleigh mentioned it at some point - that he couldn't read the text but was able to understand it regardless.