Application of ChatGPT in soil science research and the perceptions of soil scientists in Indonesia

Since its arrival in late November 2022, ChatGPT-3.5 has rapidly gained popularity and significantly impacted how research is planned, conducted, and published using a generative artificial intelligence approach. ChatGPT-4 was released four months later and became more popular in November 2023. However, there is little study about the perception of scientists of these chatbots, especially in soil science. This article presents the new findings of a brief research investigating soil scientists' responses and perceptions towards chatbots in Indonesia. This artificial intelligence application facilitates conversation-based interactions in text format. The study evaluated ten ChatGPT answers to fundamental questions in soil science, which has developed into a normal science with a mutually agreed-upon paradigm. The evaluation was carried out by seven soil scientists recognized for their expertise in Indonesia, using a scale of 1–100. In addition, a questionnaire was distributed to soil scientists at the National Research and Innovation Agency of the Republic of Indonesia (BRIN), universities, and Indonesian Soil Science Society (HITI) members to gauge their perception of ChatGPT's presence in the research field. The study results indicate that the scores of ChatGPT answers range from 82.99 to 92.24. ChatGPT-4 is better than both the paid and free versions of ChatGPT-3.5. There is no significant difference between the English and Indonesian versions of ChatGPT-4.0. However, the perception of general soil scientists about the level of trust is only 55%. Furthermore, 80% of soil scientists believe that chatbots can only be used as digital tools to assist in soil science research and cannot be used without the involvement of soil scientists.