The Risks Posed by LLM-Based AI Tools and How to Mitigate Them

The Risks Posed by LLM-Based AI Tools and How to Mitigate Them

Understanding the Challenges of Large Language Model-Based AI

As technology continues to advance at an unprecedented pace, the rise of Large Language Model (LLM)-based AI tools has created both exciting opportunities and significant challenges for our community. These powerful AI systems, capable of generating human-like text, have the potential to revolutionize how we approach tasks ranging from content creation to problem-solving. However, the risks they pose, if left unaddressed, could have far-reaching consequences for our students, teachers, and the broader school community.

The Unconsented Use of Scholarly Work

One of the primary concerns we must address is the manner in which the training data for LLMs has been sourced. Many of these models have been trained on a vast array of written materials, including the work of scholars and researchers in the field of folklore studies. This has occurred without the knowledge or consent of the individuals whose intellectual property has been co-opted.

As an organization that values the open-access principles championed by many folklorists, the American Folklore Society (AFS) must take a leading role in addressing this issue. We need to develop policies that protect the rights of scholars, ensuring that their work is not exploited without permission. Failure to do so could undermine the very foundations of our discipline and the trust that our community has built with the individuals and cultures we study.

The Exploitation of Cultural Knowledge

Folklorists have a long history of documenting and sharing the knowledge and experiences of diverse communities around the world. This work often involves the entextualization of the words and stories of non-scholars, with a commitment to ethical practices that respect the source communities. However, the integration of this cultural knowledge into LLM training data, often without the knowledge or consent of the communities involved, represents a profound breach of trust.

Many folklorists have assured their consultants that their contributions would not be used for profit, yet these assurances are now being undermined by the current practices of AI developers. The AFS must address this issue urgently, setting stringent policies and fostering educational initiatives that emphasize the ethical implications of AI use in folklore studies.

The Transformation of Higher Education

The impact of LLM and other AI tools on higher education is already being felt, with significant implications for the teaching of folklore studies. These technologies are reshaping pedagogical approaches, research methodologies, and the overall academic landscape. Folklore scholars must navigate this rapidly changing environment, balancing the potential benefits of AI tools with the need to maintain the integrity of their discipline.

The AFS has a crucial role to play in guiding this transition, developing policies that support the responsible integration of AI in academia and providing resources to help educators adapt to these new challenges. By taking a proactive approach, we can ensure that the values and practices of our discipline are upheld in the face of technological change.

Broader Societal Impacts

Beyond the confines of academia, the widespread adoption of LLM and other AI tools is transforming social life, with significant environmental and economic effects. As social scientists and humanists, folklorists are uniquely positioned to study and intervene in these transformations.

The environmental costs of AI, including the substantial energy consumption and water usage required for training and operating LLMs, are a growing concern. Additionally, the economic implications, such as job displacement and the creation of new forms of labor, must be critically examined. The AFS should lead efforts to understand these impacts, encouraging research that explores the intersection of AI, society, and the environment, and advocating for policies that promote sustainable and equitable technological development.

Addressing the Risks: A Call to Action for the AFS

The risks posed by LLM-based AI tools are multifaceted and complex, demanding a proactive and informed response from the American Folklore Society. By addressing the unconsented use of scholarly work, the exploitation of cultural knowledge, the transformation of higher education, and the broader societal impacts, the AFS can help shape a future where AI technologies are used ethically and responsibly.

As stewards of cultural heritage and advocates for ethical scholarship, it is incumbent upon us to lead this charge and ensure that the values of our discipline are upheld in the face of technological change. This will require a coordinated effort that includes policy development, educational initiatives, and collaboration with a wide range of stakeholders, including industry, academia, and policymakers.

To this end, the AFS must take the following steps:

1. Develop and implement policies that protect the rights of scholars and the integrity of cultural knowledge. This includes establishing clear guidelines for the use of copyrighted materials and the ethical treatment of cultural data in AI training.

2. Provide educational resources and training programs for folklorists, community partners, and the broader public, empowering them to understand the implications of AI technologies and how to mitigate the associated risks.

3. Engage in advocacy efforts to influence policymakers and industry leaders, ensuring that the concerns of the folklore studies community are addressed in the development and deployment of LLM-based AI tools.

4. Foster collaborative research initiatives that explore the intersection of AI, society, and the environment, with a focus on developing sustainable and equitable technological solutions.

By taking these actions, the AFS can position itself as a leader in the responsible use of AI, safeguarding the future of our discipline and the communities we serve. The challenges posed by LLM-based AI tools are formidable, but by working together, we can harness the power of these technologies to enhance our understanding of the world and improve the lives of all.

I encourage you to visit the Stanley Park High School website to learn more about our school’s approach to technology and innovation, as well as the resources and support we offer to our students and families. Together, we can navigate the complexities of the digital age and ensure that the tools we use empower rather than endanger our community.