Planned trial methodology
To capture the impact of our intervention, a Randomised Control Trial (RCT) was implemented across 12 sites in the City of Westminster area. This involved four sites being randomly allocated one of the three conditions. The allocation of sites are detailed below:
The control sites tested were:
- Gloucester Street J/W Lupus Street
- Warwick Square J/W Belgrave Road
- Leinster Terrace J/W Leinster Place
- Ilbert Street J/W Third Avenue
The biophilia sites tested were:
- Gloucester Street J/W Lupus Street
- Warwick Square J/W Belgrave Road
- Leinster Terrace J/W Leinster Place
- Ilbert Street J/W Third Avenue
The affect sites tested were:
- St Georges Drive J/W Denbeigh Street
- Ilbert St J/W Fourth Avenue
- Sutherland Street J/W Clarendon Street
- Craven Hill Gardens J/W Craven Hill
From the data collection, we obtained four weeks of usable baseline data, and four weeks of usable Phase 2 data. Baseline data is data from the period before the interventions were put into place. Measuring this allows us to control for preintervention levels of dumping behaviour. Phase 2 data is from the period after the new designs were implemented.
The data collection was carried out by the City of Westminster, and the processing of the data was carried out by Ogilvy. This allowed us to establish both baseline and phase 2 measurements for all three conditions for the following variables:
Dumped waste
- Black bags dumped
- Carrier bags dumped
- Recycling bags dumped
- Pieces of cardboard dumped
Large/bulky items dumped
- E.g. mattresses, wood, metal, furniture etc. Additionally, local residents in the area were interviewed to provide qualitative feedback on the new bin designs
Results
In this section you will first see the results for general dumped waste, then large/bulky items and then finally the resident’s perception of the new designs from an on-street survey.
How to interpret the data
During our trial, levels of dumped waste were recorded. This was done numerically, so if there was one black bag dumped outside the bins, this was recorded as a “1”. If there were two dumped black bags, then this was recorded as “2” and so on. Importantly, if there was no dumped waste, then this was recorded as “0”. Indicating that on that day, on that collection occasion, there was no dumped waste outside the bins. This process was the same for all categories of rubbish recorded (black bags, carrier bags, recycling bags, cardboard and large/bulky items.)
What’s an ANCOVA, Tukey test and p-value?
The above are all statistical techniques to ascertain whether we can be confident that the change we observe in the data was caused by the differing conditions and not some other extraneous factor.
An ANCOVA is the main test we use to see if the conditions had some kind of significant effect on the level of dumped waste. It automatically controls for levels of baseline rubbish, which makes it useful in this case. In terms of statistics, this means we are using levels of baseline rubbish as a “covariate”.
A Tukey test is used if the ANCOVA detects some kind of difference. The ANCOVA detects if something was statistically significantly different, the Tukey test detects what was statistically significantly. This is useful for interpreting, for example, if the statistical significance in the results observed, occurred between the flower and control, monster and control, or both.
p-values are how we decide if something is statistically significant or not. The general practice in academic research is that if the p-value is below 0.05 then it is deemed as statistically significant. We used this cut-off point for our tests too. The lower the p-value, the more confident you can be that what you observed was caused by the conditions and not something else. Occasionally you’ll see the p-value displayed in terms of “e”. e is just a very common number in mathematics like “pi”, so it has its own name “e”. In our case, when the p-value is expressed in terms of e, then this means that it is very low, almost zero. Which means you can be almost 100 per cent confident that the change you observed was because of the conditions tested and not something else.
Dumped waste (black bags, carrier bags, recycling bags, cardboard)
A one-way ANCOVA was conducted to compare the effectiveness of three bins at reducing dumped waste, whilst controlling for baseline levels of dumped waste. There was a significant difference in mean rubbish left on the street [F(2,2587) =38.3247, p<2e-16] between the different types of bins. Post hoc comparisons using the Tukey test were carried out. There was a significant difference between flower bin sites and control bin sites (p <1e-06) with flower bin sites having 0.66 more pieces of rubbish on average compared to the control. There was also a significant difference between flower bin sites and monster bin sites (p <1e-06) with flower bins sites having 0.67 more pieces of rubbish on average compared to the monster bin sites. Comparing the estimated marginal means showed that flower bin sites had the most rubbish on the streets (1.4 pieces of rubbish on average). While monster was the best (0.768 pieces of rubbish on average), which was slightly better than the control (0.778 pieces of rubbish).
A one-way ANCOVA to compare the effectiveness of three bins at reducing dumped waste
Test |
Difference |
Std. Error |
t-value |
p-value |
Flower – Control |
0.65884 |
0.08759 |
7.521 |
<1e-06 |
Monster – Control |
-0.01008 |
0.08762 |
-0.115 |
0.993 |
Monster – Flower |
-0.66892 |
0.08757 |
-7.639 |
<1e-06 |
Effectiveness of three bins at reducing dumped waste
Condition |
Mean |
Std. Error |
df |
lower |
upper |
Control |
0.778 |
0.0620 |
2587 |
0.656 |
0.899 |
Flower |
1.436 |
0.0619 |
2587 |
1.315 |
1.558 |
Monster |
0.768 |
0.0619 |
2587 |
0.646 |
0.889 |
Large, bulky items
IMAGE: Large bulky levels of rubbish between groups
A one-way ANCOVA was conducted to compare the effectiveness of three bins at reducing the number of large/bulky items dumped on the street whilst controlling for baseline levels of large/bulky items dumped on the street. There was a significant difference in mean large/bulky items left on the street [F(1,644)=3.100, p=0.046] between the different types of bins. Post hoc comparisons using the Tukey test were carried out. There was a significant difference between flower bin sites and monster bin sites (p=0.035) with flower bin sites having 0.261 more large/bulky items on average compared to the control. Comparing the estimated marginal means showed that flower bin sites had the most large/bulky items on the streets (0.650 large/bulky items on average). While monster was the best (0.388 large/bulky items on average), which was slightly better than the control (0.527 large/bulky items).
A one-way ANCOVA was conducted to compare the effectiveness of three bins at reducing the number of large/bulky items dumped on the street
Test |
Difference |
Std. Error |
t-value |
p-value |
Flower – Control |
0.65884 |
0.08759 |
7.521 |
<1e-06 |
Monster – Control |
-0.01008 |
0.08762 |
-0.115 |
0.993 |
Monster – Flower |
-0.66892 |
0.08757 |
-7.639 |
<1e-06 |
Effectiveness of three bins at reducing the number of large/bulky items dumped on the street
Condition |
Mean |
Std. Error |
df |
lower |
upper |
Control |
0.778 |
0.0620 |
2587 |
0.656 |
0.899 |
Flower |
1.436 |
0.0619 |
2587 |
1.315 |
1.558 |
Monster |
0.768 |
0.0619 |
2587 |
0.646 |
0.889 |
Attitudes and perceptions to new bin designs
In addition to the main trial, qualitative data was recorded to determine attitudes and perception to the new bin designs. To achieve this, WCC staff members stood by the bins to interview residents. The team asked an open question to residents, asking them to nominate whether they loved, hated or were indifferent to the bins. Those that engaged were then asked follow up questions regarding what they were there to do and their impact. The results from this indicated that most residents were in favour of the affect/character bin designs.
TABLE
Surprisingly, even more people like the floral designs of the biophilia bins. However, these proved to be the least effective in terms of alleviating the dumping problem.
TABLE
This was reflected in the qualitative feedback which was largely positive:
- “Thank you for trying to fix the dumping problem, it is nice to see someone cares”
- “My kids love the new bins and enjoy seeing them every day on the way to nursery”
- “Hopefully this will encourage people to do the right thing, although this is the worst site for dumping in this area”
- “I love them they cheer the area up”
- “They make the effort to be less drab – it’s nice for children”
However, some people disagreed or were confused as to their purpose.
- “They look ridiculous with the countryside scene in central London”
- “We would like to see more bins in this location to deal with the dumping”
- “I thought the flowers on the floor signalled where to put your bags”
- “Need to allow the recycling bin lids to open fully”
- “Prefer the bin with the window”
We have also reviewed the feedback by residents and local councillors, through email communications and twitter. Residents raised concerns that they felt the bins were increasing the levels of dumping on the streets, and that some of the bins were being damaged through use. Residents also complained that the new recycling trial bins, were locked and had an envelope through which to post waste, preventing residents from placing large bags directly inside the bins. This is standard practice for Westminster recycling bins and is in pace to reduce recycling contamination. However, many of the old black style bins have had their locks broken over time and residents are able to open the bins.
Results summary
The biophilia/flower bins were ineffective at reducing dumping behaviour and may have slightly increased on street waste. However, this may also indicate that people were using them more, but just using them incorrectly. Affect/monster bins did reduce all types of waste in absolute terms, but this effect was not large enough to be statistically significant. Neither condition had a statistically significant effect on dumped large/bulky items, but again affect condition performed the best in absolute terms. Public perceptions of the new bin designs were in positive when residents were surveyed on street. However, several residents made it clear that they did not, reporting that they had increased the dumping of rubbish on street.
Limitations
The following limitations may have impacted our ability to infer meaningful results from the data collected:
- Little room for improvement on average – As the grey dots on the plots above indicates, by far the most common reading was zero. This means that most of the time, there was no waste being dumped around these bin sites. This makes detecting any improvements in average dumping difficult, as there are few occasions to improve on.
- Potential contextual factors: The intervention measurements took place in August which may have had an influence on the amount of rubbish being disposed of. Events like school holidays, vacant student properties, pandemic related changes in living arrangements and habits, or other cultural moments could have influenced dumping behaviours.