Throughout the project, the team met at least weekly, to address the challenges and monitor our progress. This was vital to the success of the project; sustaining a constant dialogue was key to resolving challenges and to partnership building.
We began exploring data collection methods via preliminary Teams’ meetings in the three months before the project started (Oct – Dec 2020). Initially we planned a simple email to DU and DCC staff asking for volunteers to send us their energy bills for the period. However, we quickly realised that not everyone would know how to access two years’ worth of their energy bills and, even if they could, we needed to know far more than just how much energy they had consumed.
We recognised that we needed to control for a range of variables, such as whether the volunteer had remained in the same accommodation throughout the period (essential for comparison), whether their household had grown or shrunk during the lockdown, whether they had made any energy-related changes such as installing a new boiler, buying an electric vehicle, installing insulation, etc. Consequently, we decided that we needed to conduct a fairly detailed, personal survey.
Initially, we hoped to gather the information using an online survey, but unfortunately the cloud-based form systems that we investigated, such as Google Forms, did not allow for the level of customisation necessary. Essentially energy billing systems are quite idiosyncratic, and it swiftly became apparent that an offline survey document would be needed, that could be customised to meet the needs of individual participants. This proved to be a major undertaking, requiring far more time that we had budgeted for.
To address the challenge of how to frame our questions, so as to ensure that we got the information we needed, we conducted a pilot survey with willing colleagues. These participants identified a number of issues which we then corrected before sending the survey out.
Given the short project length (just six months), we needed to send out the survey in February, but because the project covered two years, 1 April 2019 – 30 March 2021, we realised that we would need to re-contact our volunteers very close to the end of the study to get their last three months of data.
Securing volunteers also posed a challenge and we adopted different tactics with respect to staff from the DU and the DCC. At DU we largely focused on engineers and energy scholars and used departmental mailing lists, but as the number of participants did not swell, we made use of social media and the university’s emailed announcements. None of this was particularly successful. In contrast at DCC we opted to recruit from volunteers with a particular interest in climate change, using the Climate Champions (over 100 staff members representing every business group in the Council), interested colleagues we already worked with, and the intranet and staff magazine to bolster our numbers of volunteers. Despite all of this, we failed to achieve the 100 volunteers, across the two organisations, that we had aimed for. Nevertheless, we were able to obtain meaningful data and results from the study.
We took data protection very seriously and developed a completely anonymised numerical system for handling volunteer’s data, which worked well. We also ensured that we had the appropriate permissions in place.
We were able to access complete, accurate energy consumption data for the seven office buildings by working with the DU Estates Team and the DCC Energy Management Team, both of whom use Systems Link energy management software that records half hourly data.
Several aspects of the project, especially volunteer engagement and data analysis were much more time and resource intensive than anticipated. We also found that many potential volunteers were unable to take part in the project because they could not access their consumption data, either because they had switched energy supplier during the period or because of problems with their smart meter. We addressed this with BEIS and have held meetings with the Smart Meter team.