tag:blogger.com,1999:blog-8216971263350849959.post3366010282518882878..comments2023-08-07T16:41:49.660+02:00Comments on Die Klimazwiebel: Redefining peer review - againeduardohttp://www.blogger.com/profile/17725131974182980651noreply@blogger.comBlogger6125tag:blogger.com,1999:blog-8216971263350849959.post-84271753343923729052010-09-04T18:39:23.662+02:002010-09-04T18:39:23.662+02:00henner:
Unfortunately, I once again have to disagr...henner:<br />Unfortunately, I once again have to disagree (at least in part). A clear danger of having practitioners is that they often focus on what *they* can do. Something novel, where they (know they) lack the abilities to use the new idea, may then be rejected. I've seen a few examples of that in my own field.<br /><br />Note that some practitioners (in my field) have expressed similar sentiments about their fellow practitioners: their ideas were actively dismissed, because they were 'different'.<br /><br />Funnily enough (or maybe not), this actually touches upon a major issue we have in stopping and adapting a variety of environmental problems: it often requires a change of behavior. Tell Americans they can save loads of money by drying their clothes on a line rather than the dryer, and the vast majority will still not take action. In Japan the government had to campaign to get Japanese businesses to increase the temperature of the airconditioning and allow Japanese businessmen to remove their tie (again, this would also save loads of money). There are hundreds such examples, some small, some large.Marcohttps://www.blogger.com/profile/07262670367947223521noreply@blogger.comtag:blogger.com,1999:blog-8216971263350849959.post-17553876165519676882010-09-04T18:00:40.916+02:002010-09-04T18:00:40.916+02:00Hej Marco,
about No. 1) Point taken! I have to ad...Hej Marco,<br /><br />about No. 1) Point taken! I have to admit that I merely speculated on the basis of a rather not so amusing thesis defense two months ago. <br />About No.2) I did not suggest to introduce a “practitioner review” for fundamental research such as quantum physics or the like. I see that in these cases such a review would be pointless. I however think that a review by practitioners is helpful in the field of sustainability science. Here research is supposed to produce findings that are applicable and helpful in addressing the challenges of our time (especially climate change). This is even more valid, if we take into consideration that many research projects in this field are based on a research process that actively includes practitioners (Mode 2 knowledge production). The claim of “transdisciplinarity” is lame if only scientists are involved in the evaluation of findings. <br />Looking forward to read your reply!Hennerhttps://www.blogger.com/profile/07437402079395900595noreply@blogger.comtag:blogger.com,1999:blog-8216971263350849959.post-22393250846815324512010-09-03T18:45:34.270+02:002010-09-03T18:45:34.270+02:00Henner, first of all, using "non-conventional...Henner, first of all, using "non-conventional" methods is actually quite common. It is the use of novel methodology that grants you 'fame' (assuming it works). Doing the same as others is known as the "me too" approach, and in my field means the importance of the paper is downgraded. Which makes rejection a lot more likely...<br /><br />Second, if we had "practitional reviewers" on papers, many breakthroughs would probably never have happened. In many cases we cannot predict how a finding can be used, or abused!, in the future. Einstein once lamented his own theory of relativity, as it significantly contributed to the development of the atom bomb. But we also have used it for the "good" of humankind (e.g. nuclear power).Marcohttps://www.blogger.com/profile/07262670367947223521noreply@blogger.comtag:blogger.com,1999:blog-8216971263350849959.post-62427479408918248352010-09-03T18:14:20.797+02:002010-09-03T18:14:20.797+02:00'third-party scientists or critics with an int...'third-party scientists or critics with an interest in the work may get to hear of it and decide to contact the journal'<br /><br /><br />I have to emphatically disagree with Horton on this point. That third party scientist contact the editor on their own initiative is not appropriate. I see the figure of an editor similar to that of a judge: the editor may seek evidence from technical experts if needed - (the reviewers )- but by no means should a third party try to influence a judge on a case in which this third party has some interest. I think an editor should always block any approaching attempts by other scientist which have not been contacted by the editor on his initiative. <br />In new journals with open review process, third party scientist can submit public comments, but this is very different from contacting the editor in private.eduardohttps://www.blogger.com/profile/17725131974182980651noreply@blogger.comtag:blogger.com,1999:blog-8216971263350849959.post-31032360399978237942010-09-03T08:54:26.361+02:002010-09-03T08:54:26.361+02:00One dimension of the practice of peer review has n...One dimension of the practice of peer review has not been named by the author. In anticipation of the critical examination by colleagues researchers might refrain from applying non-conventional approaches to their research. Thus a tool aiming at enhancing the quality of science can suppress further development of the respective discipline.<br />In the field of sustainability science the question must be raised if a review by the “peer” (aka fellow researcher from the field) is really contributing to the aims of research. Why not introduce an additional “practitioner review” that will check articles for their applicability in “real life” and their usefulness in contributing to the good of humankind?Hennerhttps://www.blogger.com/profile/07437402079395900595noreply@blogger.comtag:blogger.com,1999:blog-8216971263350849959.post-49061201284948252152010-09-03T08:47:41.234+02:002010-09-03T08:47:41.234+02:00Just like in the previous post - drawing lines, il...Just like in the previous post - drawing lines, illegal crossing, definitions of what is allowed....<br />The problem of peer review as presented here immediately reminds me of the process of production of knowledge at university in general. Professors are easily tempted to influence or manipulate the content of dissertations; undergraduates have no other choice than to accept, for career reasons (maybe you think twice about coming up with a skeptical dissertation when your prof is an alarmist - just as an example); presenting a panel on an important conference sometimes needs help and intervention from powerful lobbyists; on tenure track, assistant professors are forced to publish in peer reviewed journals and are happy to have good connections to editors or friends on the editorial board...There are rules, but universities are full of informal rules beyond public control. This is in stark contrast to the appearance of science in public as neutral and objective. This 'cultural' element is inherent in peer review - it is only possible to minimize it, but not to eliminate it. Thus, transparency is important, which is different from completely 'aseptic'.Werner Krausshttps://www.blogger.com/profile/15094636819952421339noreply@blogger.com