The town of Castellbò is located in a gorge, at an altitude of 802 m, between the Serrado de la Borda and the Roca Redona abutments.

Castellbó is located on a plane of the hill where the ruins of the old castle of Castellbò are located, which was demolished by order of Fernando el Católico in 1513, although the chapel of San Pedro and San Francisco of the castle was demolished centuries later.

Among the buildings of interest, the collegiate church of Santa Maria de Castellbò, the Virgen del Remedio de Castellbò, the Cruz de Palo de Castellbò, the dovecotes, the castle and the bridge stand out.