I often look for one, then find another one o.O Once I searched for like, a half hour, then I leave and suddenly I came across it

You should mark their positions on the map, I found 3 that way. And the Dungeon/Haunted House are the easiest ones, but they're sometimes stuck in a wall.