A red castle hidden deep in a town that had been off the beaten path for years was enough to attract the attention of adventurers.