DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run Scan×
Skip to content
VGSources
Blog

Ugly Reviews: What Makes a Literature Review Mislead

Linda Finlay's term "ugly reviews" describes literature reviews that mislead or misrepresent the evidence. Here is how to spot the three failure modes and check a review's scope.
Length5 min Posted Quest giverVGSources Team
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

An “ugly review,” in the sense used by qualitative methods scholar Linda Finlay, is a literature review that misleads or misrepresents the evidence on a topic and may cause harm. The term comes from Finlay’s 2024 article “Qualitative Research: the ‘good,’ the ‘bad,’ the ‘ugly’,” published in the European Journal for Qualitative Research in Psychotherapy (volume 14, pages 1–19). It describes academic literature reviews, not consumer reviews of games or other products. For readers of video-game coverage, it is most useful as a way to test claims that a field has “little research,” that a question is “settled,” or that a summary of studies is complete.

Where the three categories come from

Finlay sorts weak review work into three tiers. The “good” review makes its choices visible and engages critically with the material. The “bad” review has flaws that weaken it but do not, on their own, distort the field. The “ugly” review is the consequential case, where misrepresentation or omission steers readers toward a distorted account.

Category Typical features Finlay describes Effect on the reader
Good Scope decisions are made transparent; the rationale for choices is explained where possible; limitations and debates are identified; both methods and findings are critically discussed; the review is up to date and coherent The reader can understand what was covered and why, and can judge the conclusions
Bad Selection logic is weakly explained; key material is missed; the discussion is outdated; claims go beyond the evidence The review is weaker than it could be, but its distortion is limited
Ugly Claims that little or no research exists when relevant studies have not been found; selective favouring of the author’s own work; contradictory evidence or live debates omitted or played down Mislead, misrepresent, and perhaps even end up being harmful

Finlay’s own wording for the category is direct: “‘Ugly’ reviews are, the ones which mislead, misrepresent, and perhaps even end up being harmful.” The definition is about effect, which is why the same surface features can appear in a bad review or an ugly one depending on what the omission does to the reader’s understanding.

Three ways a review can mislead

Claiming there is little research

A statement such as “few studies have examined this” is only reliable if the search was broad and suited to the topic. Finlay treats a claim of scarcity as a finding that needs its own justification. A narrow search that returns few hits can produce a confident statement about an empty field when the real gap is in the search strategy. Check which terms, databases, or sources were used, and whether relevant work from neighbouring areas was considered.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Selective citation that favours the author

Reviews by researchers working on a topic often cite their own studies heavily, which is normal. The problem arises when the author’s work is presented as the field’s answer while comparable studies from other groups are left out or given less weight. Finlay frames partisan selectivity as one possibility to watch for, not as a universal explanation for how reviews are written.

Omitting contradictory evidence and live debates

A review that presents a finding as uncontested, without naming the studies that disagree or the debates still in progress, gives readers a smoother story than the evidence supports. Finlay’s criteria for good reviews ask for limitations and debates to be identified, so their absence is a signal worth noticing. A reader can test this by asking whether the review says where its conclusions conflict with other work.

Omission is not the same as intent

An incomplete review is not automatically a dishonest one. Finlay’s category describes what a review does to its readers, and a writer or reader should keep those two questions apart. The observable effect of selective or incomplete coverage can be assessed from the text: which studies are absent, which claims are unqualified, which debates go unmentioned. A claim about the author’s motives requires evidence beyond the review itself, and it is better to describe the effect than to assume a cause.

How to check a review yourself

  1. Find the stated purpose and scope. A review that says what it is trying to cover gives you a standard to test it against.
  2. Look for the selection logic. Note the databases or sources used, the search terms or inclusion rules, and whether the review explains what it excluded and why.
  3. Test any “little research” claim. Ask whether the search was broad enough for the topic, and whether the review reports how many sources it found and screened.
  4. Compare the author’s citations with the wider field. A review that leans heavily on one group’s output should explain that choice.
  5. Search for named disagreements. Look for studies that point the other way and for an explicit account of where the field is still debating.
  6. Check currency. A review should bring readers up to date with recent work and current debate, not stop at an older consensus.
  7. Check that the conclusions match the methods and findings reported. Strong conclusions need support from the material the review actually presents.

Narrative and systematic reviews are judged differently

Finlay distinguishes the approach of the two review types rather than ranking one above the other. A narrative review is more descriptive, creative, and less structured, which suits synthesis and interpretation. A systematic review requires a rigorous, scientific approach, which suits questions about what studies collectively show. A narrative review is not therefore weaker, and a systematic review is not automatically more accurate. The test in each case is whether the review’s methods fit the claims it makes.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Review type Approach Finlay describes What to check first
Narrative More descriptive, creative, and less structured Whether the author’s selection is explained and whether contrary work is engaged
Systematic A rigorous, scientific approach Whether the stated method was followed and whether its scope matches the conclusions drawn

Judging qualitative reviews on their own terms

Finlay cautions against applying arbitrary external standards to qualitative work. Criteria should follow the study’s aims and methodology. For a qualitative literature review, that means asking the following:

  • Does the review’s method suit the question it is asking?
  • Are the reasons for interpretive choices given, even where no single procedure is mandated?
  • Does the review assess the quality of the work it covers, not only its topic?
  • Are the findings presented in a coherent and informative way that a reader can follow?

Applying a checklist designed for another design can flag a sound qualitative review as weak, and miss the problems the article actually describes.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Reading claims about games

When a video-game article cites a body of studies to support a claim about players, design, or effects, the ugly-review tests apply directly. Ask whether the cited literature was searched broadly, whether competing findings are acknowledged, and whether the author’s own studies dominate the references. A claim that the field is settled, or that little work exists, deserves the same scrutiny Finlay gives to any review.

Finlay’s article is a methods discussion and does not provide a count or rate of ugly reviews in the literature, so no frequency should be inferred from it.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Source: Finlay, Linda. “Qualitative Research: the ‘good,’ the ‘bad,’ the ‘ugly’.” European Journal for Qualitative Research in Psychotherapy, 2024, volume 14, pages 1–19.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More quests from Patch Notes

  1. How To Create Custom Stickers & Shoutouts In Monster Hunter WildsMonster Hunter WildsBlog20min
  2. How to Get XL Gogoat in Pokemon Legends Z-A (An Extra-Large Gogoat)Pokemon Legends Z-ABlog20min
  3. How to Get Rotting Lightbringer in Diablo 4Diablo 4Blog17min
Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.