BIO

Paige is an Information, Communication, and Technology major from Palm Beach Gardens, Florida. She hopes to utilize her minor in Innovation and certificate in Global Citizenship to find new, interdisciplinary applications to technology. Her research interests follow this passion, looking to study human and technological interactions. She will continue working on her project, "A Comparative Analysis of the Effectiveness of Artificial Intelligence Systems in Response to Search Commands" next year, aiming to get the findings published. Aside from research, Paige has taken leadership positions on campus as an Honors Colloquium Leader for the FSU Honors Program, as well as serving as the fundraising chair for Delta Nu Zeta, raising nearly $17,000 in her two semesters served.

A Comparative Analysis of the Effectiveness of Artificial Intelligence Systems in Response to Search Commands

Abstract

This study presents a comparative analysis of traditional and artificial intelligence (AI) systems’ ability to search for relevant articles using specified search commands. With artificial intelligence ever-evolving, and the accessibility of AI opening to the general public, questions have arisen surrounding these tools in academia. The study was conducted to understand the facilitators and hindrances that impact the completion of 2-year STEM degree programs. In this study, 10 artificial intelligence systems were selected for comparative analysis, each one prompted with queries on the hindrances and facilitators of success in 2-year Career and Technical Education (CTE) and STEM programs. These papers were also cross-referenced against a list of relevant papers from the Florida State University Library Database - OneSearch. The findings were mixed, although many of the AI programs yielded papers that were irrelevant to the topic. About half of the AI assistants utilized performed at the same level or above that of a manual search. The programs producing only relevant results, upon further investigation, had actually fabricated the citations. The implications of these results lend themselves to the future usage of artificial intelligence in academia - showing both that current AI systems should not be relied solely upon for conducting proper searches and pointing out to developers where the models may be improved. The findings have implications for academic research, STEM, and the improvement of AI applications.

Keywords: Artificial Intelligence, AI, Literature Search