The Inquisitor’s medallion is one of the three things in the wall stash in the dungeon at the start of the game, with the Key and a King’s signet. It sits in your quest items for a long time and cannot be thrown away, so there is no risk of losing it before you need it.
It opens the locked gate of the Abandoned Tower, together with the Secret combination. You get the medallion back when the gate opens.