Best vacuum cleaners for carpets in 2024
All vacuum cleaners on CNET’s best lists are tested and evaluated in our state-of-the-art testing labs. CNET Testing Labs go beyond product specifications and test in real conditions with real junk. Our test laboratory is specially equipped for assessing robot vacuum cleaners, a grueling test environment that you will not find anywhere else.
Here’s an overview of how we measure vacuum performance:
Differences in scoring
At CNET, we carefully test as many products as possible to ensure we can give you the best advice. When applying this to vacuum cleaners, there will be inherent differences in the testing methods. With cordless vacuums, operation and comfort are important factors as you physically hold the device in your hand to use it. This does not matter with robot vacuum cleaners, but the features do. So this is why you will notice a difference in the graphs below.
Methodology for cordless vacuum cleaners
| Methodology for vacuum scoring with wireless stick | ||
|---|---|---|
| Subrating category | Weight | What we were looking for |
| Performance | 30% | Performance score extrapolated based on the average sand score and average rice score on hard floors, short pile carpets and medium pile carpets. |
| Value/Price | 25% | Assessment of the sales price taking into account all other features, compared to the value of the features offered. |
| Features | 20% | Usefulness of additional features (such as self-emptying station, handheld conversion, extra tools, multiple batteries, NAV technology, mopping) |
| Handling and comfort | 15% | Overall comfort and use of the product. (i.e. Heavy vs. Lightweight, Comfortable Handle). |
| Ease of use | 10% | Overall user experience with configuration, functionality, smartphone app accessibility, smart home features. |
Methodology for robot vacuum cleaners
| Subrating category | Weight | What we were looking for |
|---|---|---|
| Performance | 30% | Performance score extrapolated based on the average sand score and average rice score on hard floors, short pile carpets and medium pile carpets. |
| Price | 25% | Assessment of the sales price taking into account all other features, compared to the value of the features offered. |
| Features | 15% | Usefulness of additional features (such as self-emptying station, handheld conversion, extra tools, multiple batteries, NAV technology, mopping) |
| Duration | 20% | Navigation efficiency score (1-10), based on the time it takes to complete a full cleaning cycle in CNET LABS’ custom-built robot vacuum NAV test chamber. |
| Ease of use | 10% | Overall user experience with configuration, functionality, smartphone app accessibility, smart home features. |
Robot vacuum testing
Test 1: Floor covering capacity
The first test is to find out how well a robot covers the floor while cleaning. We have built an industry standard testing facility as specified by the International Electrotechnical Commission only for this purpose. The IEC is an international standards body responsible for managing robotic vacuum test procedures, including for vacuum manufacturers.
Inside this chamber are objects designed to simulate typical obstacles a robot vacuum cleaner encounters for navigation while cleaning. These obstacles include wall edges, table and chair legs, couches, other furniture, and so on, plus bare tile and hardwood floors and carpet. We install LED lighting at the top of each vacuum cleaner. The dimensions of the lamps correspond to the measured nozzle width of each specific robot vacuum cleaner we test.
As robots move around the room while cleaning, an overhead camera captures a long-exposure image of the entire room in low light. That photo will then have a light trail, created by the LEDs, showing the exact areas the robot traveled during its run (and the position of the nozzle). We can also see areas of the floor where the vacuum cleaner may have missed or got stuck. You can see the navigation results of all robot vacuum cleaners in our test group in the gallery below.
Laser guided navigation example
Test 2: Debris Absorption Performance
The second type of test shows exactly how much physical dirt a vacuum cleaner can pick up from the floor. To simulate dirt with a small particle size, we use a mixture of play sand and garden sand. For larger particles of soil we use uncooked black rice grains. Robots then run in a straight line across three types of floors (low-pile carpet, medium-pile carpet, and bare hardwood floors).
We also check the specific nozzle width of each vacuum cleaner. We built an adjustable tool to pollute our test floors. This allows us to create a strip of precise ground to match the nozzle dimensions of each robot. The mass of land is also not chosen arbitrarily. We measure a proportional amount related to the floor material, dirt type and nozzle width of each vacuum cleaner.
We carry out (at least) three cleanings per floor type. We also carry out separate cleaning tests with sand and rice. This amounts to at least 18 tests per robot vacuum cleaner. We weigh the robot’s trash can both before and after each run. From there we can calculate the percentage of dirt pick-up for each cleaning session, as well as the average amount of dirt a machine manages to remove. In addition, we conduct anecdotal (visual) hair tests for each robot on all three floor types.
Our test with medium-sized rice-based particles didn’t show enough distinction between the cleaners, which says they can all handle larger particles without any problems. For removing fur from pet owners, we have reviewed anecdotally.
Testing cordless stick vacuum cleaners
Cordless vacuum cleaners have improved tremendously in recent years and can now handle the vast majority of a home’s cleaning needs.
As with robot testing, the width of the test bed is proportional to the nozzle width of the vacuum cleaner. We measure this width ourselves. We also use the nozzle width and floor type to calculate the soil density for each test, according to IEC guidelines. Here too we use the same soil types; sand, rice and animal hair. We perform (at least) three runs per floor type. We also test the suction power separately with sand and rice. This amounts to a minimum of 18 tests per vacuum. We weigh the vacuum cleaner’s dust container both before and after each run.
From there we can calculate the percentage of dirt and debris picked up for each run, as well as the average amount of soil a vacuum manages to remove. In addition, we conduct anecdotal (visual) pet hair tests for each vacuum cleaner, on all three floor types, to help us select the best cordless vacuum cleaner.
