My parents taught me that I must never touch any suspicious looking item.
If somany of us actually went to that castle and the gem is still there, there's something suspicious going on. Maybe it's a trap or something... There's no reason for some gem to be in a pool of water for so long without anyone getting it. Either it's fake or there must be a trap. Conclusion: don't touch it...
O.o