Abstract
Generative artificial intelligence (AI) offers strong potential for developing customized second language learning materials and tools. However, generating texts for absolute beginners which require strict lexical and grammatical control remains a challenge. Although controlled text generation (CTG) techniques exist, they often require technical expertise and infrastructure, limiting accessibility for educators. This study evaluates, in the context of Spanish, a prompt-based approach that leverages large language models (LLMs) without fine-tuning or specialized tools. Prompts enforce linguistic constraints defined in two attachments: a categorized Spanish vocabulary list, and a set of example sentences illustrating approved Spanish grammatical structures organized by communicative function. Three variables were manipulated: AI model (ChatGPT-4o vs. Claude 3.5 Sonnet), prompt type (standard vs. extended, with constraint-enhancing techniques), and attachment format (rich-heavyweight vs. lightweight JSON). A secondary variable, text type (city descriptions, personal introductions, and dialogues), was also examined. A total of 720 texts were generated, 30 per condition. Measures included proportions of non-compliant lexical and grammatical items, user-perceived latency, and errors in vocabulary, grammar, and coherence. Model choice was the primary driver of constraint adherence, with Claude 3.5 Sonnet outperforming ChatGPT-4o. Extended prompts improved adherence across models. Attachment format showed no systematic effect on adherence, but JSON significantly reduced latency and response-time variability. Text type also influenced adherence, and error rates remained low. Findings offer educators a scalable, low-barrier solution for generating tailored beginner-level Spanish materials and AI-powered tools using LLMs, along with insights into how different design choices affect performance. This approach, transferable to other languages, provides a practical alternative to resource-intensive CTG techniques, addressing a critical gap in AI-assisted language education.
| Original language | English |
|---|---|
| Article number | 103327 |
| Journal | Technology in Language Teaching & Learning |
| Volume | 8 |
| DOIs | |
| Publication status | Published - 2026 |
Keywords
- Absolute Beginners
- Artificial Intelligence in Language Education
- Prompt Engineering
- Second Language Teaching
- Technology Enhanced Language Learning
- Spanish
- Controllable Text Generation (CTG)
Research output
- 2 Other contribution
-
AI-migo & XiSPA: Custom-built AI tools for Spanish absolute beginners—Development, pilot implementation, and initial evaluation
Getino-Diez, R., García-Sánchez, C. & Dai, W., 2025, 24 p. Centre for Educational Innovation and Excellence, Xi’an Jiaotong-Liverpool University.Research output: Other contribution
Open AccessFile -
AI-migo 与 XiSPA:面向西班牙语绝对初学者的定制化 AI 驱动工具——开发、试点实施与初步评估
Getino-Diez, R., García-Sánchez, C., Dai, W., Dai, W. (Translator) & Han, W. (Translator), 2025, 22 p. 卓越教创中心, 西交利物浦大学.Translated title of the contribution :AI-migo and XiSPA: Custom-Built AI Tools for Spanish Absolute Beginners—Development, Pilot Implementation, and Initial Evaluation Research output: Other contribution
Open AccessFile
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver