Turkish researchers develop scale to measure students' AI confidence

Confidence shapes how people actually use a tool.
A student's belief in their ability to work with AI predicts whether they'll use it effectively or avoid it.
Mark

Why does it matter how confident students feel about AI? Isn't the technology itself what counts?

Mimi

Confidence shapes how people actually use a tool. A student who feels anxious around AI might avoid it even when it would help them. One who feels capable might experiment, learn, push further. Self-efficacy isn't just a feeling—it predicts behavior.

Mark

So this scale measures... what exactly? How do you quantify confidence?

Mimi

You ask students questions about specific situations. Can you ask an AI system for help and trust the response? Do you feel comfortable when AI is involved in your learning? Can you troubleshoot when something goes wrong? Their answers cluster into patterns—four main dimensions, it turns out.

Mark

Four dimensions. That seems oddly specific. How did the researchers land on those?

Mimi

They didn't invent them. They took an existing scale, translated it carefully, tested it on 284 students, and the data itself revealed that structure. The four factors—assistance, anthropomorphic interaction, comfort, technological skills—emerged from what the students' responses actually showed.

Mark

And most of these students had already used AI but hadn't studied it formally?

Mimi

Exactly. They're learning by exposure, not by design. They want more structured education, but universities haven't necessarily built it yet. The scale gives institutions a way to measure whether their efforts to teach AI literacy are actually building student confidence.

Mark

What happens if a university uses this scale and finds students aren't confident?

Mimi

Then they know where to focus. Not just on teaching technical skills, but on creating environments where students feel safe experimenting, asking questions, making mistakes with AI systems. The emotional dimension matters as much as the mechanical one.

  • Turkish universities are already embedding AI into classrooms, yet no validated instrument existed to measure whether students actually felt capable of navigating these systems — a foundational gap now addressed.
  • The study of 284 students revealed a telling contradiction: most had used AI in some form, but almost none had received formal AI education, leaving confidence largely self-constructed and uneven.
  • Researchers identified four distinct pressure points in AI confidence — seeking help from AI, treating it as a conversation partner, feeling emotionally at ease with it, and possessing practical operating skills — together accounting for nearly three-quarters of how students rated themselves.
  • The validated Turkish AISES scale now gives educators a reliable instrument to detect where student confidence is fragile, before anxiety quietly undermines the learning environments institutions are building.
  • The path forward is clear but unwalked: structured AI literacy programs that tend to both technical skill and emotional readiness, measured over time to confirm they are actually working.

At Koç University, researchers have quietly answered a question that precedes all the grand debates about artificial intelligence in education: not whether students use AI, but whether they believe in their own capacity to do so. By adapting and validating a self-efficacy scale into Turkish, Associate Professors Semerci Şahin and Güney have given educators a mirror — one that reflects not technical competence alone, but the emotional and psychological terrain students must cross to truly inhabit an AI-integrated world. The tool arrives at a moment when universities have been faster to deploy AI than to ask how their students feel standing before it.

Between May and November of last year, 284 university students across Turkey answered questions not about what they knew of artificial intelligence, but about how confident they felt using it. The exercise was quieter than it sounds — the validation of a measurement tool designed to capture AI self-efficacy, that particular blend of capability and comfort that determines whether a person can truly work alongside these systems or merely endure them.

The work was carried out at Koç University's School of Nursing, where two researchers took an existing English-language scale — the Artificial Intelligence Self-Efficacy Scale, or AISES — and adapted it carefully for Turkish speakers. Translation, expert review, a pilot study, and then a full test across students from public and private universities in different regions of the country. The results, published in the International Journal of Human–Computer Interaction, confirmed that the adapted scale was solid and reliable.

The context gives the work its weight. AI is already woven into university classrooms — adaptive platforms, real-time tutoring systems, automated feedback tools. But institutions have been slower to ask how students actually feel navigating all of this. The Turkish AISES measures confidence across four dimensions: the ability to seek help from AI, comfort with treating it as a kind of conversation partner, emotional ease in its presence, and practical operating skills. Together, these four factors explained nearly 74 percent of the variation in how students described their own confidence, with a Cronbach's alpha of 0.937 — a strong signal that the questions were measuring the same underlying thing.

The student portrait that emerged was instructive. Most had already encountered AI in some form. Very few had taken a formal course on it. Yet the majority wanted to learn, roughly half rated their own knowledge as moderate, and a substantial portion viewed AI as genuinely useful — not distant, but present in their lives.

What the researchers stress is that confidence in AI is not purely technical. A student may know how to prompt a language model and still feel uneasy when the system behaves unexpectedly. The emotional dimension is as real as the mechanical one, which is why the scale attends to both. The implication is a gap: universities have added AI tools without necessarily building the literacy and confidence to use them well. The validated Turkish AISES now gives educators a way to measure whether that gap is closing — whether structured programs are actually shifting how students feel, not just what they know.

Somewhere between May and November of last year, 284 university students across Turkey sat down at their computers and answered questions about how confident they felt using artificial intelligence. They were part of something quieter than it sounds: the validation of a new tool designed to measure what researchers call AI self-efficacy—not whether students could code or debug, but whether they felt capable and comfortable when they encountered AI systems in their daily academic lives.

The work happened at Koç University's School of Nursing, where Associate Professor Remziye Semerci Şahin and Assistant Professor Seda Güney took an existing English-language scale and adapted it for Turkish speakers. The Artificial Intelligence Self-Efficacy Scale, or AISES, had been developed elsewhere, but Turkey had no validated version. The researchers translated it carefully, checked the translation against the original, gathered expert feedback, ran a pilot study, and then tested it on their sample of students from public and private universities scattered across different regions of the country. The results, published in the International Journal of Human–Computer Interaction, showed something solid: a measurement tool that actually works.

What makes this work matter is the context. Universities are already weaving AI into their classrooms—adaptive learning platforms that adjust to individual students, tutoring systems that respond in real time, automated feedback tools that grade and comment on work. The technology is there. But institutions have been slower to ask a basic question: How do students actually feel about all this? Not whether they think AI is important—most do—but whether they believe they can navigate it, understand it, work alongside it without anxiety or confusion.

The scale that emerged from this study measures AI self-efficacy across four distinct dimensions. The first is assistance—students' sense that they can ask AI systems for help and get useful responses. The second is anthropomorphic interaction, which captures how comfortable students feel treating AI almost like a conversation partner, attributing intention or understanding to it. The third is comfort with AI itself, the emotional ease someone experiences when the technology is present. The fourth is technological skills, the practical know-how to operate these systems. Together, these four factors explained nearly 74 percent of the variation in how students reported their AI confidence. The scale's internal consistency was excellent—a Cronbach's alpha of 0.937, which in research terms means the questions reliably measured the same underlying thing.

The portrait of Turkish university students that emerges from the data is instructive. Most had already used some form of artificial intelligence. But very few had taken a formal class or online course specifically about AI. Yet the majority wanted to learn. About half rated their own AI knowledge as moderate. And a substantial portion saw AI as genuinely useful in their lives—not as a distant technology but as something practical and present.

What the researchers emphasize, though, is that AI self-efficacy is not purely technical. A student might understand how to prompt a language model or navigate an interface, but still feel uneasy, still doubt themselves, still experience anxiety when the system behaves unexpectedly. The emotional and psychological dimensions matter as much as the mechanical ones. This is why the scale includes questions about comfort and anthropomorphic interaction alongside questions about skills.

The implications point toward a gap in how universities are currently preparing students. Many institutions have added AI tools to their learning environments without necessarily building the confidence and literacy that would help students use those tools well. The researchers suggest that structured AI literacy programs—courses or modules that address both the technical and the emotional dimensions of working with these systems—could make a real difference. The Turkish AISES, now validated and reliable, gives educators a way to measure whether such programs are actually working, whether students' confidence is growing, whether interventions are having the intended effect.

What happens next depends on whether universities take the hint. The tool exists. The need is clear. The question is whether institutions will invest in the kind of deliberate, sustained effort required to help students move from passive exposure to genuine confidence.

AI self-efficacy is not limited to technical skills. It is also associated with students' comfort, confidence and emotional experiences when interacting with AI systems.
— Remziye Semerci Şahin and Seda Güney, Koç University
Vuoi la storia completa? Leggi l'originale su Phys.org ↗
Contattaci Domande frequenti