Generative artificial intelligence is increasingly being embedded in higher education, yet its use in relation to Aboriginal and Torres Strait Islander knowledges raises significant ethical questions. This pilot study examined a Blackboard Ultra AI Conversation role-play activity autogenerated from the scenario “I would like to design an Indigenous Knowledge education module”. The activity generated an AI persona, “Aunty Nira Thompson”, positioned as a cultural advisor. A transcript of ten interactions was analysed using the AIATSIS Guide to evaluating and selecting education resources, alongside an ethical framework for generative AI and Indigenous higher education. Findings showed that the chatbot often used respectful language, recognised limits around knowledge sharing, and discouraged inappropriate use of AI-generated cultural stories and images. However, these safeguards were insufficient. The bot simulated Indigenous cultural authority without Indigenous authorship, endorsement, attribution, co-design, or governance. It also generalised Indigenous knowledges and displaced responsibility for cultural legitimacy onto future Indigenous consultation. The study argues that ethical GenAI use in this area cannot rely on disclaimers or better prompting alone. Indigenous-led governance, attribution, consent, and co-design are necessary if educational technologies are to support rather than undermine cultural authority.
Keywords
Generative artificial intelligence, Indigenous knowledges, Indigenous data sovereignty, AI ethics.
Author Biographies
Aimee Andersen, Southern Cross University
Aimee is an Educational and Learning designer specialising in curriculum development and creating culturally responsive learning experiences. Passionate about amplifying Indigenous voices, she is dedicated to fostering inclusivity and embedding Indigenous knowledge systems into education.
Aimee's lived experience in remote Aboriginal communities, shapes her understanding of cultural inclusion. This personal connection fuels her commitment to designing learning experiences that celebrate and integrate Indigenous culture, history, and voices.
Dr Zach Quince, Southern Cross University
Dr. Zachery (Zach) Quince is an engineering education researcher, curriculum developer, and leader in higher education practice. He holds a Bachelor of Biomedical Engineering, Graduate Certificate in Higher Education (Innovative Learning and Teaching) and a PhD. He is currently studying a Master of Education specialising in educational leadership. His previous projects and skills are in programmatic assessment, professional skills development, and the ethical integration of generative AI in higher education. With a strong background in engineering curriculum design, he has played a key role in developing innovative courses and leading interdisciplinary collaborations.
Zach has received multiple grants and awards for his contributions to teaching and learning, including pioneering the integration of generative AI into assessment and pedagogy. His research focuses on ensuring graduates are equipped with industry relevant competencies and critical thinking skills. He has presented extensively on professional skills mapping, academic integrity, and GenAI in education. Passionate about fostering student success, Zach actively engages in curriculum transformation and academic leadership, ensuring alignment with industry needs and contemporary educational practices.
Dr Kylie Day, Southern Cross University
Dr Kylie Day is a scholar and Senior Lecturer at Southern Cross University’s Gnibi College of Indigenous Australian Peoples. Her research focuses on Indigenous Knowledge, relational learning, cultural continuity and community-led approaches to wellbeing. Working alongside Elders, Aunties and community partners, her research explores how Indigenous cultural practices strengthen connection, belonging and flourishing across generations. The fishing net project builds on long-standing relationships on Bundjalung Country and reflects her commitment to Indigenous-led research grounded in reciprocity, responsibility and respect.