If you didn’t find Gnomelette in the Loize Valley Mine earlier, you’ll be prevented from entering the Temple, so travel back his way and offer him a Mizuho potion to avoid being barred from entering. After passing under the first bridge, take the first right and descend the well-protected trail that leads to the bottom.