Townsville Council Moves to Fix Years of Duplicate Images Clogging City's Digital Archive This WeekUpdated

Townsville City Council's information management team has begun a structured cleanup of its central digital image repository this week, after an internal audit identified more than 4,200 duplicate files sitting across shared drives used by the Planning and Development directorate. The problem, which staff say has accumulated over at least a decade of uncoordinated uploads, is now being tackled through a dedicated deduplication project that started Monday, July 1.

The timing matters. Council is midway through digitising physical planning records tied to the 2019 flood recovery, converting paper files from properties across Rosslea, Idalia and the northern beaches corridor into a permanent digital archive. Pumping duplicate images into an already-strained system risks burying critical flood-mitigation documentation under layers of redundant files — precisely the kind of records that planners and insurers need quick access to as the city's resilience infrastructure program rolls into its next phase.

What Triggered the Push

The audit was completed in late June by the Council's Records and Information Governance unit, based at the Civic Theatre precinct on Boundary Street. Staff found that the duplication problem was heaviest in two areas: aerial photography of the Ross River corridor taken between 2017 and 2022, and heritage site imagery gathered during the refurbishment of buildings around Flinders Street East. In several cases, the same high-resolution image had been saved under six or seven different filenames by different departments with no cross-referencing system in place.

Townsville City Libraries, which manages the local history collection from its main branch on Denham Street, has been looped into the project because a portion of the duplicates originated from digitisation grants the library received through the State Library of Queensland's Community Heritage program. Coordinating between the two systems — Council's enterprise content management platform and the library's own cataloguing software — has added complexity to what staff initially expected to be a straightforward deduplication task.

The practical cost is real. Storage on Council's managed cloud environment is billed per gigabyte, and the 4,200-plus duplicate files were identified as consuming approximately 1.8 terabytes of redundant data. At current contracted rates, that excess storage represents a recurring overhead that the audit report — tabled internally this past Wednesday — flagged as an avoidable expense ahead of the 2026-27 budget cycle.

How the Cleanup Is Running

The project is using automated deduplication software to flag identical files, with human reviewers from the Planning directorate making final calls on which version to retain. Files connected to active development applications — including several lodged by Defence Housing Australia for properties adjacent to Lavarack Barracks on Stuart Drive — are being reviewed last to avoid any disruption to live approvals.

Council's geographic information team is separately auditing mapping images used in the hydrogen hub precinct planning documents, a body of work centred on the Port of Townsville and the surrounding industrial zone at Bohle. Those files include satellite imagery licensed from third-party providers, meaning duplicate retention carries additional licensing risk on top of the storage cost.

The full remediation is expected to take until late August, according to the internal project timeline. Once the archive is clean, Council's Records unit plans to introduce mandatory metadata tagging at the point of upload — a standard practice recommended by the Queensland State Archives that Townsville had not formally adopted across all departments.

For residents and businesses with development applications currently before Council, the message from the Records unit is that the cleanup will not delay any approvals processing; the teams running the deduplication are separate from assessment officers. Anyone needing access to planning documents or historical property imagery can still submit requests through Council's online portal or visit the Denham Street library in person during standard business hours, Monday to Friday, 9am to 5pm.