Why is Consumer Reports unreliable?
brendainnj
13 years ago
Featured Answer
Sort by:Oldest
Comments (11)
paintguy1
13 years agoChristopher Nelson Wallcovering and Painting
13 years agoRelated Discussions
Consumer Reports Reliability Data 2008
Comments (35)Roadbike, of _course_ I'm comparing CR's reliability reports to those of other research journals. Gathering data, reporting on it, and analyzing it is what CR purports to be doing. What else should they be compared to? I am _not_ talking about their individual product tests - I'll get to that in a minute since you brought it up - but rather these data compilations from which CR expects its readers to draw conclusions. There are literally thousands of research journals in all kinds of fields, and their processes are standardized and transparent. And there's a reason: because you can't draw conclusions about sample data or generalize such conclusions beyond the sample if the research isn't rigorous, well controlled, and transparent. The fact that CR is sampling owners of mowers is no excuse for their piss-poor work, anymore than if they were surveying patients in a research study for medication compliance. The research is only useful if it meets research standards. Such things as interrator reliability (where different-branded mowers that are the same under the paint and made in the same factory should have the same result) matter. If the reports aren't reliable or valid, then what is the point of buying the magazine!?! Why would _anyone_ buy CR if they didn't think the info in it was reliable or valid? That would just be plain stupid. But it's not, and all the advertisement of their _journalists_ in white lab coats won't change that. Speaking of their product tests, I recall one test of an Echo blower that was tested in some standardized way (ANSI? OSHA? I forget) and reported with some sort of decible rating for that lab test. CR purported to replicate the test and got a louder result, and called Echo liars in writing. Unfortunately, they didn't know all the original test procedures and therefore couldn't possibly replicate the standardized testing. But that didn't stop them from smearing the Echo product all to hell and back. Even after Echo wrote a letter protesting the incorrect procedures, CR wrote a rebuttal saying "Echo does have a choice: tell the truth about their product!" That not only shows a lack of willingness to listen, but also a fundamental misunderstanding of proper testing procedures....See Moreconsumer reports
Comments (20)First time back on line in a long while. Finally bought a new computer (Sony Vaio) Hopefully I didn't miss too much! I don't particularly pay too much attention to CR, although sometimes I find myself browsing through their magazines while shopping around at the store just out of curiosity. Their good and bad bets are pretty much the same as they were in previous years. I find Carsurvey.com and Epinions.com to be more valuable. I have a 1996 Honda Accord with the 4-cylinder, 223,000 miles and just keeps on trucking. I've had to service it as I would with any other car, but it's never given me any unexpected problems on the road or failed to start one morning. The engine still retains most of it's original major components (such as the alternator, AC compressor, starter, PS pump, master cylinder, etc.) which is truly amazing in my opinion. I am a strong believer in preventive maintenance and upkeep, and I'm sure that has had something to do with my car's reliability... but I've definitely only had to do the very basics to keep it so. Also have a 2001 Pontiac Trans Am, which CR listed as unreliable. Currently have 56,000 miles and haven't done squat to it except change the oil/filters, brakes, tires and light bulbs. Absolutely nothing else. Had a pretty good experience with a 97 Mercury Cougar also(V8 model) The transmission and intake manifold were the only weak links in this otherwise solid car...but my transmission and manifold had already been replaced before I bought the car used with 90,000 miles. Sold it with a little over 150,000 miles....See MoreAnything else besides Consumer Reports for appliance evaulations?
Comments (8)The reason online reviews should play a small role is because they are not reliable. User reviews are all over the map for pretty much every appliance out there. I don't trust Consumer Reports because whenever I've used an appliance in real life that they've tested, I've disagreed with their findings. Plus, on multiple occasions they've given the same appliance under different brand names completely different ratings. This demonstrates that either they have a bias they aren't telling us about, or their testing is unreliable. You should definitely look at online reviews before buying. If they are all negative and complaining about the same problem, I would avoid that product. But if there are a mix of positive and negative and the complaints aren't all the same, I wouldn't take the product out of consideration. If you stop considering something because it has any negative reviews at all, you will never find anything to buy. Buying appliances today is a crapshoot. There is a point where you need to stop overthinking and just pull the trigger based on the looks, price, and features you want....See MoreConsumer Reports on Paints
Comments (19)Realize this is a very old post however will add my two cents ... ☺. Love Behr's (& CIL/Canadian brand of paint) colour swatches far more than Benjamin Moore as they appear more accurate on the card. That said; every time I have used BM I have ended up tweaking the colour formula as to me their 'colour chips' do not read the same once applied to a sample board or wall. (Shall add, I am very good at detecting undertones.) Also as far as durability goes I can walk throughout my home and pick out what is Benjamin Moore as find it has NOT held up as well as CIL paint and that's the truth! In summary, I feel BM is over rated in more than one aspect and a $8.00 charge for their sample pots (at least here is Canada) is ridiculous. P.S.: I am not a rep or spokesperson for either Behr or CIL paints....See Morebrendainnj
13 years agoUser
13 years agoLori A. Sawaya
13 years agoChristopher Nelson Wallcovering and Painting
13 years agonick59
13 years agoWendyB 5A/MA
13 years agoFaron79
13 years agobrendainnj
13 years ago
Related Stories
KITCHEN DESIGNSpecial Report: Kitchen News from Cologne
Blended Kitchen-Living Rooms, Super-Skinny Counters and Hidden Appliances Are Headed This Way
Full StoryINSIDE HOUZZData Watch: Home Renovation Professionals Bullish on 2016
Two new Houzz reports show that 2015’s confidence is continuing this year — but professionals still face several business challenges
Full StoryTHE HARDWORKING HOMECES 2015: Inching Toward a Smarter Home
Companies are betting big on connected devices in 2015. Here’s a look at what’s to come
Full StoryFURNITURESmart Shopper: How to Buy a Mattress
Confusing options, hair-raising prices, haggling ... Our guide can keep you from losing sleep over mattress shopping
Full StoryDECORATING GUIDESCalifornia Law: License to Practice Interior Design?
A proposed bill that would require a license to practice interior design in California has Houzzers talking. Where do you stand?
Full StorySAVING WATER11 Ways to Save Water at Home
Whether you live in a drought-stricken area or just want to help preserve a precious resource, here are things you can do to use less water
Full StoryMissoni for Target Collection Debuts to a Shopping Frenzy
Get a look at the colorful collection that led eager shoppers to line up early and crash site
Full StoryCLOSETSThe Most Popular Closets of 2015
These closets are only a dream for most of us, but they’re full of great ideas
Full StoryEVENTS5 Big Trends From This Week’s High Point Market
Learn the colors, textures and shapes that are creating a buzz in interior design at the market right now
Full Story
annika_s