All posts by Kath Kovac

Beyond bans: teaching and learning in the age of generative AI 

Australia’s Tertiary Education Quality and Standards Agency (TEQSA) says it is “all but impossible” to detect AI cheating. 

Still, as generative AI (genAI) expands, universities have the chance to harness its ability to improve learning and assessment – and to teach students how to use it responsibly beyond the lecture theatre and into their working lives.

Accelerating accessible learning

One growing resource is the AI teaching agent Cogniti, developed at the University of Sydney (USyd). Educators across disciplines can tailor Cogniti to their subjects, providing students with new ways to engage with course material. For instance, they can turn their lecture notes into a podcast to listen to while commuting – a great boost to accessibility.  

Cogniti doesn’t hand out answers; it challenges students’ thinking. For instance, QUT’s Professor Grant Hamilton has created a chat-based field study guide for his biology students. The interactive conversational agent withholds recommendations until the student reasons through them, turning experimental design into a critical thinking exercise. 

Hamilton’s colleague, Associate Professor Jim Hogan, notes that AI is also extremely valuable in providing formative feedback, and makes a brilliant practice agent. “There’s no way we could afford an individual tutor prompting you with questions all the time,” he says, adding that universities would need “an army of people with the right skill level” to achieve the same outcome. 

Man wearing a hat and glasses in the bush
Professor Grant Hamilton has created a chat-based field study guide for his biology students. Image: QUT.

Beyond knowledge: building capability

The University of Queensland’s Professor Jason Lodge, lead author of a new TEQSA resource about quality learning in a genAI future, says many good things about university education don’t need changing – but others do. 

Man wearing a navy jacket and blue collared shirt
Professor Jason Lodge, lead author of a new TEQSA resource about quality learning in a genAI future. Image: Supplied.

“Students still need to have deep disciplinary knowledge to build on – and AI doesn’t remove that need. But we’re finally moving away from being obsessed with the cheating aspect of AI towards a discussion about adaptive capabilities,” says Lodge.

Adaptive capabilities are fundamental to students’ work beyond graduation, and will hold no matter how much AI changes in the future. They include learning to navigate new ideas, thinking critically and asking the right questions, and adapting to new technology.

With USyd bringing in an AI Literacy and Competency unit this year, and rapidly rising numbers of lecturers developing their own AI teaching agents, building these capabilities seems a sure bet.  

AI-resilient assessment 

The rise of genAI is also driving a re-examination of how student learning is assessed. “We’ve got to look at changes to assessment that make the advantage of using AI go away, and make its use part of the assessment task,” says Hogan. 

Lodge agrees, pointing out that it’s important for assessment to demonstrate a student’s genuine understanding, instead of just submitting essays likely written by AI. 

“Good old pen-and-paper exams, interactive oral assessments and practical demonstrations all assure learning, which is what TEQSA is ultimately enforcing through its standards framework,” he explains.   

Tomorrow’s teaching, today

The capacity for self-directed, active learning, combined with the requirement for students to explain, apply and defend their thinking, makes genAI a potentially powerful learning tool. And with lecturers already using AI themselves, it makes sense that students do too – as long as both use it transparently and with integrity.

 – Written by Kath Kovac

Read more

  • Discover more TEQSA resources for institutions, staff and students about the potential impacts and benefits of gen AI tools for teaching, learning, assessment and research.
  • Find out more about the benefits of Cogniti for educators and students.

Fake papers, flawed research and AI: inside the fight for research integrity

Image (above): Distinguished Professor Susan Scott, Editor-in-Chief of Classical and Quantum Gravity. Credit: ANU.

Journal editors’ inboxes fill with AI-generated papers. Fake datasets underpin published research. This is not a vision of the future, it’s the increasingly complicated world of scientific publishing. 

How much AI is too much? 

Journals generally allow authors to use AI to improve grammar, spelling and readability. This doesn’t usually require disclosure, but more substantive use of AI must be documented. 

Ultimately, AI cannot be an author. Nature, for example, states that AI can only be used “as a supporting technology; scholarly judgement, accountability, and responsibility always remain human”.

Despite these rules, growing numbers of AI-generated papers are making their way into journal submissions. And they’re getting harder to spot. 

“AI writing has certainly improved dramatically in recent years,” says the Australian National University’s Distinguished Professor Susan Scott, Editor-in-Chief of Classical and Quantum Gravity. 

Professor Adrian Barnett of QUT, who studies research funding, peer review and research integrity, agrees. He and his colleague experimented with AI to “write a paper in half an hour with a couple of prompts that would be good enough to get published”.

For editors, this means extra work. They are now using AI to screen papers for possible AI-generated content. “For instance, we check whether references include recent work, because large language models often omit the latest studies,” says Scott. 

Publishers must also keep pace with the threats posed by generative AI (genAI), such as paper mills. “These commercial enterprises fabricate research and research papers at increasing scale,” says Alice Black, head of Editorial and Research Integrity at CSIRO Publishing.  

Should AI assess science? 

AI is also changing how research is assessed. In a recent joint statement, the Australian Research Council and the National Health and Medical Research Council say that genAI may support the grant application process, but that responsibility, expert judgement and decision-making must remain with humans.

Barnett agrees that AI peer review should “only ever be an adjunct” to human review, not a replacement. He actually thinks AI could remove some of humanity’s “huge status bias issue” when it comes to selecting grant applicants. “AI should be more interested in the idea, not where it comes from,” he notes. 

When pressure meets convenience

Regardless of rules, humans are drawn to convenience – while researchers are under constant pressure to produce. What happens when AI makes this easier?

“I worry that most academics are just going to produce more rather than better, because we’re in this ridiculous competitive environment of publish or perish,” says Barnett.  

He also describes how trust in science is being compromised by fake but realistic-looking datasets. For instance, he found that three datasets on the online repository Kaggle, including one “comically bad dataset” used to train clinical models, had been used in 135 published papers. 

How is this possible? “Unfortunately, a lot of journals don’t ask questions,” Barnett explains. “And a lot of researchers who are just looking for a dataset to get a paper don’t ask questions, either.”

Publishers have much to gain from the efficiency of AI tools, but they may need to be more effective at filtering out low-quality papers. Small publishers have an advantage here. “As matters of research misconduct grow in complexity … we can have human eyes on every paper and provide manual assessment for any that raise concerns,” says CSIRO’s Black.

This image, published and then retracted from the academic journal Frontiers in Cell and Developmental Biology, is a commonly used example of the types of errors that generative AI can cause. Image: 10.3389/fcell.2023.1339390

Why human judgement matters 

Ultimately, trust in published science depends on human integrity. AI can help us summarise and express ideas, but it must never decide outcomes. 

As Scott puts it: “If humans are going to retain our role as the pre-eminent entity on this planet, then we will need to preserve our function of carrying out the heavy-duty brain-work, including scientific creativity and ingenuity.”

Working out how we preserve that function might be the biggest question of all. 

– Written by Kath Kovac