In the pinned post on the Common Sense Keto group I speak to people who love to throw out the old “Show me one peer-reviewed study” argument trying to prove you wrong. Well today I am going to show why peer-review is not in any way shape or form proof of anything and how it is more biased than most other forms of research.
Lets run quickly though the scientific process.
You run a lab and do some experiments. You write a paper about these experiments and the findings. Now of course you want to get the paper published because in the research world, the more papers you get published the more recognized you become and the more grant money you get to fund more experiments. The cycle of life for a research facility. You go online to the various Journals and submit your paper with the online form. During the online submission you select a group of scientific buddies, termed “experts” or “colleagues” – usually people you have met at conferences and have befriended over the years – and these buddies take on the duty of reviewing your paper. Essentially you tell the journal who you want to review your paper and they actually use these names. Why not. True story.
The reviewers, your peers who you recommend, have 3 options. They can approve the paper, suggest modification or outright reject the paper. Since your future grant money depends on the publishing of this paper who are you going to “recommend” to review your paper? People that share your bias or people who might reject it? Doesn’t sound biased at all now does it? Did I mention that the reviewers are well aware who wrote the paper? This is totally not predisposed to conflict of interest is it? They say that it is necessary to have the writer’s name on the paper and to allow the reviewers to know who it is so that it allows them to recognize the researchers credentials and history. Yeah that is probably why.
Essentially the peer review process is similar to the high school essay writing process. If the teacher has any sort of dislike for you, look forward to a crappy grade but if you are a teacher’s pet, A + all the way. Sounds legit to me.
Not only do you have to be aware of the bias and conflict of interest in the way of the researcher choosing their own reviewers, you have to worry about the journalistic spin and industry influence on research.
From the former editor and chief of the New England Journal of Medicine after quitting the journal:
“I witnessed first hand the influence of industry on medical research during my two decades at the journal. The staple of the journal is research about causes and treatments of disease. Increasingly, work is sponsored by drug companies. I saw companies begin to exercise a level of control over the way research is done that was unheard of when I first came to the journal, and the aim was clearly to load the dice to make sure their products looked good.”
Don’t get me wrong, there is a lot of great research done but keep in mind that everyone has an agenda when writing scientific papers. There is one key concept that should help you determine if a paper is credible.
If a study is favorable and positive regarding something that can be bought or sold, be wary!
Now if you think that this is my opinion, it isn’t. This all comes from Dr. Anthony Jay. He is a PH.D and is also the president of the International Medical Research Collaborative. This comes from his experience in research and publication of numerous studies both privately and publicly funded.
There is a Doctor by the name of Dr. Marion Nestle, no relation to the Nestle food company, who is collecting scientific studies that are industry funded that show conflicts of interest. She is compiling them and writing assessments on each to show where the conflict is. Of the 168 studies she has so far collected only 12 of them are unfavorable towards the company’s product. That doesn’t sound fishy at all.
Here is another example of how studies are massively flawed. The Bayer company did a study where they took a massive amount of studies, so a study of studies, and attempted to reproduce the results of these studies using the exact parameters laid out by the original study team. They found that the science journal’s results did not match up to their in house replications more than 75% of the time!!!
So in essence, before you start trying to use “peer-review” as the gold standard of science and trying to use your journal published study to prove your point, remember to think about agendas. Does the article have something to gain by being less than forth coming? Is there a product that hinges on the preferable outcome of the study? In essence, use Common Sense when looking at these studies. Just because they were reviewed by “peers” does not mean they are any type of validation. It simply means that people with the same bias as the writer read them and agreed. That is not proof. That is conflict of interest.
If they really wanted true proof they would find people in direct disagreement with the hypothesis to review the paper. That would validate it.
If you want to get your Ketogenic Diet back to a place of Common Sense and learn how to heal your metabolism you can get personalized coaching from Coach Jack.
Check the details here: