Psychology Studies Fail “Science” Test/ Big Time

THE GUARDIAN /

Study delivers bleak verdict on validity of psychology experiment results (studies are not experiments)

Of 100 studies published in top-ranking journals in 2008, 75% of social psychology experiments and half of cognitive studies failed the replication test “ (Scientific experiments MUST be replicated by other scientists.)

Psychology experiments are failing the replication test – for good reason

A major investigation into scores of claims made in psychology research journals has delivered a bleak verdict on the state of the science.

An international team of experts repeated 100 experiments published in top psychology journals and found that they could reproduce only 36% of original findings.

The study, which saw 270 scientists repeat experiments on five continents, was launched by psychologists in the US in response to rising concerns over the reliability of psychology research.

The first imperative: Science that isn’t transparent isn’t science

Chris Chambers and Brian Nosek: Today we launch a new initiative to promote ‘open science’ or as we hope to one day call it, ‘science’ OMG!

“There is no doubt that I would have loved for the effects to be more reproducible,” (Results are either reproducible – or not. This isn’t relative) said Brian Nosek, a professor of psychology who led the study at the University of Virgina. “I am disappointed, in the sense that I think we can do better.”

“The key caution that an average reader should take away is any one study is not going to be the last word,” he added. (Although we see this claim made in study after study)

“Science is a process of uncertainty reduction, and no one study is almost ever a definitive result on its own.” Nice try: What the average reader needs to take away is that psychological studies are not “scientific experiments” and are not to be trusted: never ever use junk psychology for self-diagnosis or diagnosis of your child.

All of the experiments the scientists repeated appeared in top ranking journals in 2008 (if they publish junk science, how can they be called “top ranking”) and fell into two broad categories, namely cognitive and social psychology. Cognitive psychology is concerned with basic operations of the mind, and studies tend to look at areas such as perception, attention and memory. Social psychology looks at more social issues, such as self esteem, identity, prejudice and how people interact.

In the investigation, a whopping 75% of the social psychology experiments were not replicated, meaning that the originally reported findings vanished when other scientists repeated the experiments. Half of the cognitive psychology studies failed the same test. Details are published in the journal Science.

Even when scientists could replicate original findings, the sizes of the effects they found were on average half as big as reported first time aroundThat could be due to scientists leaving out data that undermined their hypotheses. (This is routine practice:)

(What hypotheses? Hypotheses are routinely extracted from inflated and manipulated results: Hypotheses are made after the fact to support extravagant conclusions.) and by journals accepting only the strongest claims for publication. (Terrific: journals with high standards “might” relax their requirements for publication, resulting in higher rates of replication. WOW!)

Despite the grim findings, Nosek said the results presented an opportunity to understand and fix the problem. “Scepticism is a core part of science and we need to embrace it. If the evidence is tentative, you should be sceptical of your evidence. (Thank-you for admitting that psychologist do not possess the qualities necessary to “do science”) We should be our own worst critics,” he told the Guardian.

One initiative now underway calls for psychologists to submit their research questions and proposed methods to probe them for review before they start their experiments. (The typical American solution to unethical behavior: Ask the offenders (nicely and deferentially, of course) to correct the low standards or deceptive practices that they themselves created – Remember the Big Banks-Wall Street financial crisis? The government’s response was, “Here is a huge bailout, so please don’t wreck the economy again.”)

John Ioannidis, professor of health research and policy at Stanford University, said the study was impressive and that its results had been eagerly awaited by the scientific community. Sadly, the picture it paints – a 64% failure rate even among papers published in the best journals in the field – is not very nice about the current status of psychological science in general, and for fields like social psychology it is just devastating,” he said. (Really?)

But he urged people to focus on the positives.

The results, he hopes, will improve research practices in psychology and across the sciences more generally, where similar problems of reproducibility have been found before. (Divert attention from egregious incompetence in your field by “roping in” other fields)  In 2005, Ioannidis published a seminal study that explained why most published research findings are false. OMG! (Typical evasion. Slander all scientists to save your own ass.)

Marcus Munafo, a co-author on the study and professor of psychology at Bristol University, said: “I think it’s a problem across the board, because wherever people have looked, they have found similar issues.” In 2013, he published a report with Ioannidis that found serious statistical weaknesses were common in neuroscience studies. (When children try this, “everybody does it” tactic they are reminded that it’s an invalid excuse meant to avoid personal responsibility.)

Scandals prompt return to peer review and reproducible experiments (Someone would have to prove that this state of “ethical behavior” ever existed. ) High-profile fraud has galvanised scientists to urge a return to a crucial element of the scientific method

Here is where the bullshit really starts: The claim that science proceeds by means of incompetence, cheating and fraudulent results; that indeed this is the scientific  method. Incompetence or fraud = valid risk-taking.

Nosek’s study is unlikely to boost morale among psychologists, (or to affect their way of doing research) but the findings simply reflect how science works. OMG! In trying to understand how the world works, scientists must ask important questions and take risks in finding ways to try and answer them. Missteps (weasel words – typical psychology. Magic words will “change” reality) are inevitable if scientists are not being complacent. (?)

As Alan Kraut at the Association for Psychological Science puts it: “The only finding that will replicate 100% of the time is likely to be trite, boring and probably already known: yes, dead people can never be taught to read.”

There are many reasons why a study might not replicate. Scientists could use a slightly different method second time around, or perform the experiment under different conditions. They might fail to find the original effect by chance. None of these would negate the original finding. Another possibility is that the original result was a false positive.

(These important results are certainly worth the billions being spent on research) Among the experiments that stood up was one that found people are equally adept at recognising pride in faces from different cultures. Another backed up a finding that revealed the brain regions activated when people were given fair offers in a financial game. One study that failed replication claimed that encouraging people to believe there was no such thing as free will made them cheat more.

How pathetic!

Munafo said that the problem of poor reproducibility is exacerbated by the way modern science works. “If I want to get promoted or get a grant, I need to be writing lots of papers. But writing lots of papers and doing lots of small experiments isn’t the way to get one really robust right answer,” he said. “What it takes to be a successful academic is not necessarily that well aligned with what it takes to be a good scientist.”

Excuses, excuses, excuses. These are childish attempts at dodging the actual problem: Psychology IS NOT SCIENCE. It’s an industry that operates within pop culture. Money is the motive, NOT SCIENCE.

 

 

 

 

 

Advertisements

4 thoughts on “Psychology Studies Fail “Science” Test/ Big Time

  1. Seems that ‘such behavior is largely instinctual’ looks plausible under *those* circumstances, or ‘to successfully fool others, one must first (and worst) fool oneself’.

    It would almost seem that a ***chief*** purpose of that accursed ‘theory-of-mind’ autists supposedly lack is to simultaneously engage in self-deception while in truth *actively* seeking ***self-deification***; and the purpose of ‘witchcraft manuals’ like “how to make friends/slaves and influence/control people” is to aid and abet Normalistic Instinct by means of conscious intent.

    In this way, Normdom actually achieves (e.g. t’rump) its ultimate goal:
    ‘To be psychopathic *in form and vision* is the highest goal of Normie society. ”

    (I hope to get ‘call from the cave” by jon huer shortly. I think it says much the same thing -an effectual antidote to a lifetime of Normdom’s constant predation-through-gaslighting.)

    Like

  2. Why do I get the impression that this area – like so ***much*** of Normdom’s endeavors- is less about knowledge and more – much more- about enhancing the power and prestige of those (published) individuals listed as Authors? As if the majority of the rat-race social-cattle-dung rubbish-sellers know that ‘it’s nearly ALL meaningless – so go for the dominance by claiming ‘my is bigger/faster/more effective than yours, so you need to give me the worship I’m entitled to, Fool! ‘

    Ugh, Normies! More Bogus than a whirlwind.

    Like

    • I love your comments. “rat-race social-cattle-dung rubbish-sellers” So descriptive. I doubt that the 19th C. ratio of patent medicine-peddling con-artists to
      “genuine” medical doctors has changed, but this is irrelevant if your “genuine doctors” are QUACKS. I still think most of it comes down to: 1. Humans think we’re vastly more intelligent than we are 2. Only a tiny number of individuals are above average, with the rare genius popping up now and then. 3. Everyone thinks that they magically “share” in genius, by virtue of being born human.

      It must be thoroughly depressing if one has ANY scientific ambition to know that your success depends on ass-kissing, fake studies and begging for grants. But! I fear the majority simply are unable to understand that they are not doing science; they are attempting to justify bat-crap-crazy theories from the Dark Ages of psych / psych.

      Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s