Sunday 4 September 2016

publications - Why don't researchers publish failed experiments?


The following might be a slight generalization for all fields but something I've noticed especially in the field of Scientific Computing:




  1. Why don't people publish failures? I mean, if they tried some experiment and realized at the end that they tried everything and nothing worked. Why don't they publish this? Is it because such content won't get published or is it because it is shameful to have a failed experiment in a journal alongside prize-winning papers?




  2. I spent a better part of a year working on, what now looks like, a dead problem. However, most papers that I read initially took you to the point of feeling optimistic. Now that I re-read the papers, I realize that I can say (with much confidence) that the author is hiding something. For instance, one of the authors who was comparing two systems, gave an excellent theoretical foundation but when he tried to validate the theory with experiments, there were horrible discrepancies in the experiments (which I now realize). If the theory wasn't satisfied by the experiments, why not publish that (clearly pointing out parts of the theory which worked and which didn't) and save the future researchers some time? If not in a journal, why not ArXiv or their own websites?






Answer



"Why don't people publish failures?"


Actually, they do.



  1. Journal of Negative Results (ecology and evolutionary biology)

  2. Journal of Negative Results in Biomedicine

  3. Journal of Pharmaceutical Negative Results

  4. Journal of Interesting Negative Results (natural language processing and machine learning)

  5. Journal of Negative Results in Environmental Science (no issues yet?)


  6. Journal of Errology (no issues yet?)


and so on...


(You might also want to see the Negative Results section of the Journal of Cerebral Blood Flow & Metabolism.)


No comments:

Post a Comment

evolution - Are there any multicellular forms of life which exist without consuming other forms of life in some manner?

The title is the question. If additional specificity is needed I will add clarification here. Are there any multicellular forms of life whic...