{"id":39416,"date":"2024-08-07T09:36:41","date_gmt":"2024-08-06T23:36:41","guid":{"rendered":"https:\/\/professionalpestmanager.com\/?p=57092"},"modified":"2025-05-12T13:12:20","modified_gmt":"2025-05-12T03:12:20","slug":"ai-infiltration-can-you-trust-scientific-papers","status":"publish","type":"post","link":"https:\/\/professionalpestmanager.com\/nz\/professional-pest-manager-magazine\/ai-infiltration-can-you-trust-scientific-papers\/","title":{"rendered":"AI Infiltration \u2013 Can you Trust Scientific Papers?"},"content":{"rendered":"

The credibility of scientific literature has been somewhat undermined by the recent publishing (and subsequent redaction) of a paper that included some very obviously incorrect AI-generated material.<\/em><\/p>\n

<\/div><\/p>\n

In theory, any scientific paper should be a highly trusted source of information. It would clearly be a challenging exercise for someone to make up scientific data that builds a coherent story, especially one robust enough to get past the reviewers in peer-reviewed journals. However, it\u2019s not impossible; the \u2018research\u2019 that led to the claim that the MMR vaccine caused autism is possibly the most infamous example. But with the rise of AI, there is an increasing risk to scientific integrity, as results from a 2023 study have illustrated.<\/p>\n

A recent article in Scientific American1 <\/sup>reports a study carried out by Andrew Gray<\/strong> from University College London, that \u201cat least 60,000 papers \u2013 slightly more than 1 per cent of all scientific articles published globally last year \u2013 may have used an LLM\u201d (LLM = Large Language Model = AI algorithm).<\/p>\n

It is understandable that researchers, who are notoriously time poor, would want to use tools to help them speed up the process of writing papers, especially if they are not great at writing or if English isn\u2019t their first language. However, even for such uses and even if they review and edit the AI content, for many scientists this is simply not acceptable, as scientific research is meant to be original thought and work by the authors.<\/p>\n

It could be argued that the use of AI to aid with writers\u2019 block is hardly a major crime, as long as the author reviews and edits accordingly, but there are two fundamental issues with this. Firstly, does the author and indeed do the peer reviewers read the resulting paper in detail and edit accordingly? And secondly, where does the use of AI stop? AI is perfectly capable of generating images and even making up complete data sets.<\/p>\n

One of the key problems with AI is that it learns from published data, a lot of which is in itself, inaccurate. A second problem with AI is that it wants to please the operator and will generate an output to meet the criteria posed by the operator \u2013 it doesn\u2019t check for accuracy and in fact, some of the AI output can be entirely made up. So, whether you are a scientist or a pest manager, you need to have enough knowledge to check that what is being generated by your AI tool is accurate.<\/p>\n

This is clearly not happening.<\/p>\n

There is no doubt, there are thousands of small examples of AI use. But then there are the obvious ones, which stick out like the proverbial dogs b****. Or in this case, they belong to a rodent.<\/p>\n

In a recent paper published in Frontiers in Cell and Developmental Biology<\/em> included a rather bizarre image of the reproductive anatomy of a male rat (Figure 1). It\u2019s pretty difficult to describe what is going on here, but it is hard to understand how such an image, with the associated bizarre labelling, was submitted in the first place. But perhaps even more troubling is that it wasn\u2019t picked up by the peer reviewers!<\/p>\n

 <\/p>\n

\"Weird
The bizarre graphic that supposedly depicted the male rodent reproductive system<\/figcaption><\/figure>\n

 <\/p>\n

Which brings us to another concern: that AI may be being used by some reviewers during the peer review process to do the reviewing and generate the reviewers\u2019 report.<\/p>\n

Alas, in the scientific arena where performance is often measured on the number of publications \u2013 \u201cpublish or perish\u201d as they say \u2013 the temptation to use AI to a greater or lesser degree is significant.<\/p>\n

Indeed, AI is already capable of creating completely fictitious research on a novel topic. Researchers commissioned AI to create such a study and it provided hypothesis, methods, complex data, images, analysis and conclusions with aplomb.2<\/sup> However, it did struggle to reference existing literature correctly.<\/p>\n

Feeding off this need to \u201cpublish or perish\u201d, there are also plenty of \u2018predator journals\u2019 that will take money off scientists to publish their work, with little of the necessary quality checks.<\/p>\n

So, should we trust scientific papers moving forward? Whilst we can generally be trusting of scientific papers, it won\u2019t take many high-profile examples of AI fraud to completely undermine this trust. Quality publishers are acutely aware of this and are reviewing their processes to make sure they only publish original (non-AI) work.<\/p>\n

The problem for the lay person is that they will not be aware if the paper they are reading has been published in a quality journal. Checking to see if the journal only publishes peer-reviewed papers and whether it belongs to one of the big publishing houses is probably a good starting point.<\/p>\n

Readers of Professional Pest Manager <\/em>magazine can be assured that all magazine authored articles are written by old fashioned humans, either by one of the editorial team or a recognised industry expert.<\/p>\n

 <\/p>\n

References:<\/p>\n

1<\/sup> Stokel-Walker, C (2024). AI Chatbots Have Thoroughly Infiltrated Scientific Publishing. Scientific American<\/a>. 331 (1)<\/p>\n

2<\/sup> Elbadawi, M et al.<\/em> (2024). The role of artificial intelligence in generating original scientific research. International Journal of Pharmaceutics, 652. https:\/\/doi.org\/10.1016\/j.ijpharm.2023.123741<\/a><\/p>\n

Image link:<\/p>\n

https:\/\/www.frontiersin.org\/files\/Articles\/1339390\/fcell-11-1339390-HTML\/image_m\/fcell-11-1339390-g001.jpg<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

The credibility of scientific literature has been somewhat undermined by the recent publishing (and subsequent redaction) of a paper that included some very obviously incorrect AI-generated material.<\/p>\n","protected":false},"author":4,"featured_media":39417,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","_seopress_robots_follow":"","_seopress_robots_imageindex":"","_seopress_robots_snippet":"","_seopress_robots_primary_cat":"none","_seopress_robots_breadcrumbs":"","_seopress_robots_freeze_modified_date":"","_seopress_robots_custom_modified_date":"","_seopress_robots_canonical":"","_seopress_social_fb_title":"","_seopress_social_fb_desc":"","_seopress_social_fb_img":"","_seopress_social_fb_img_attachment_id":0,"_seopress_social_fb_img_width":0,"_seopress_social_fb_img_height":0,"_seopress_social_twitter_title":"","_seopress_social_twitter_desc":"","_seopress_social_twitter_img":"","_seopress_social_twitter_img_attachment_id":0,"_seopress_social_twitter_img_width":0,"_seopress_social_twitter_img_height":0,"_seopress_redirections_value":"","_seopress_redirections_enabled":"","_seopress_redirections_enabled_regex":"","_seopress_redirections_logged_status":"both","_seopress_redirections_param":"","_seopress_redirections_type":301,"_seopress_analysis_target_kw":"","_seopress_news_disabled":"","_seopress_video_disabled":"","_seopress_video":[],"_seopress_pro_schemas_manual":[],"_seopress_pro_rich_snippets_disable_all":"","_seopress_pro_rich_snippets_disable":[],"_seopress_pro_schemas":[],"_gspb_post_css":"","footnotes":""},"categories":[41],"tags":[],"company":[],"pest":[],"pesticide":[],"product-service":[205],"class_list":["post-39416","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-professional-pest-manager-magazine","product-service-technology","wpbf-post"],"acf":[],"_links":{"self":[{"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/posts\/39416","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/comments?post=39416"}],"version-history":[{"count":1,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/posts\/39416\/revisions"}],"predecessor-version":[{"id":39419,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/posts\/39416\/revisions\/39419"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/media\/39417"}],"wp:attachment":[{"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/media?parent=39416"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/categories?post=39416"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/tags?post=39416"},{"taxonomy":"company","embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/company?post=39416"},{"taxonomy":"pest","embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/pest?post=39416"},{"taxonomy":"pesticide","embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/pesticide?post=39416"},{"taxonomy":"product-service","embeddable":true,"href":"https:\/\/professionalpestmanager.com\/nz\/wp-json\/wp\/v2\/product-service?post=39416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}