Coming from the cemetary, you're in the west corner, fight your way past steel skeletons to a skeleton tied to a wall with a pentagram and candle in front of it. Click on the candle and proceed a few steps north - the Chamber of Illusions is open and you've got your sword. Those gems there vanish, remember: illusions.