Air Quality Monitors: When Paying More Does Not Get You More Accuracy

by Achim Haug

Typically, a higher product price should correlate with better quality, features and/or performance. Take for example computer CPUs: The higher the cost of the CPU, the better the performance. The graph below chart illustrates that very well:

CPU Performance vs Price. Source: cpubenchmark.net

So let’s look at air quality monitors.

When it comes to air quality monitors, we need to first decide what is the most important performance criterion? Is it the design? Is it the size? Is it the connectivity?

These might all be important factors but the key performance criterion is the accuracy of the monitor. If a monitor does not deliver accurate measurements, even the best design is of no use. So let’s have a look at the correlation between air quality monitor prices and accuracy. For this analysis, we only look at the accuracy of PM2.5 as this is one of the most common air quality parameters and, thus, one that most monitors measure.

South Coast AQMD, does independent tests of air quality monitors and most of the well-known monitors went through this testing. So this is an excellent data source that we can use for our analysis. I downloaded the data as of April 12, 2023 and looked at the correlation between price and accuracy. As an indicator for the accuracy, the agreement between the sensors and a standard reference instrument was determined. To quantify this agreement, South Coast AQMD determined the R2 value which measures the linear relationship between the sensor and their reference instrument. An R2 approaching the value of 1 reflects a near perfect correlation, whereas a value of 0 indicates a complete lack of correlation.

When we plot the accuracy (R2) against the price of all the monitors tested, we can see the following:

R2 vs Price. Data Source: South Coast AQMD Data

It looks quite different from the charts about CPU performance, doesn’t it? The price does not seem to affect the accuracy of the monitor which can also be seen by the flat trend line.

This is obviously not what we expected, so let’s drill a bit more into the data.

In the next figure, I separated the monitors into different price ranges and show the average, minimum, maximum as well as 25% and 75% quartile of R2. Here we can see that monitors in the price range of USD 100 - 200 seem to offer the best accuracy and that the most expensive monitors accuracy is pretty much the same as of the cheapest monitors.

R2 vs Price Ranges. Data Source: South Coast AQMD Data

So, a monitor that costs USD 2000 delivers the same accuracy as a monitor for USD 200 (for PM2.5 measurements).

Since we only focus on the accuracy of PM2.5 and put the complete price of the monitor in relation, we could miss some important aspects like:

  • More expensive monitors typically measure more air pollutants, e.g. NO, NO2, O3 etc. And some of these sensors are quite costly.
  • More expensive monitors might have better connectivity options, e.g. 4G, LoRa etc.
  • More expensive monitors might have more robust enclosures and better mounting options

Above could partially explain the reason for the higher price, however we should at least expect the same or better accuracy for PM2.5 which is paradoxically not the case.

What is your experience with the accuracy of air quality monitors? We are curious, drop us a line!

By the way, we are currently doing co-location testing of our new open-hardware outdoor monitor Open Air and first tests indicate an R2 of 0.8 - 0.9. We will publish detailed test results in the coming weeks.

This is an Ad for our Own Product

AirGradient DIY Air Quality Kits

Build your own open source air quality sensor measuring PM2.5, CO2, TVOC, Temperature and Humidity. Easy to build, accurate and affordable!

Learn More