item generation for test development

Download Book Item Generation For Test Development in PDF format. You can Read Online Item Generation For Test Development here in PDF, EPUB, Mobi or Docx formats.

Item Generation For Test Development

Author : Sidney H. Irvine
ISBN : 9781135663193
Genre : Education
File Size : 87. 33 MB
Format : PDF, Mobi
Download : 265
Read : 196

Get This Book


Since the mid-80s several laboratories around the world have been developing techniques for the operational use of tests derived from item-generation. According to the experts, the major thrust of test development in the next decade will be the harnessing of item generation technology to the production of computer developed tests. This is expected to revolutionize the way in which tests are constructed and delivered. This book is a compilation of the papers presented at a symposium held at ETS in Princeton, attended by the world's foremost experts in item-generation theory and practice. Its goal is to present the major applications of cognitive principles in the construction of ability, aptitude, and achievement tests. It is an intellectual contribution to test development that is unique, with great potential for changing the ways tests are generated. The intended market includes professional educators and psychologists interested in test generation.

Automatic Item Generation

Author : Mark J. Gierl
ISBN : 9780415897501
Genre : Education
File Size : 90. 20 MB
Format : PDF, ePub
Download : 141
Read : 1293

Get This Book


Automatic item generation (AIG) represents a relatively new and unique research area where specific cognitive and psychometric theories are applied to test construction practices for the purpose of producing test items using technology. The purpose of this book is to bring researchers and practitioners up-to-date on the growing body of research on AIG by organizing in one volume what is currently known about this research area. Part I begins with an overview of the concepts and topics necessary for understanding AIG by focusing on both its history and current applications. Part II presents two theoretical frameworks and practical applications of these frameworks in the production of item generation. Part III summarizes the psychological and substantive characteristics of generated items . Part IV concludes with a discussion of the statistical models that can be used to estimate the item characteristics of generated items, features one future application of AIG, describes the current technologies used for AIG, and also highlights the unresolved issues that must be addressed as AIG continues to mature as a research area. Comprehensive – The book provides a comprehensive analysis of both the theoretical concepts that define automatic item generation and the practical considerations required to implement these concepts. Varied Applications – Readers are provided with novel applications in diverse content areas (e.g., science and reading comprehension) that range across all educational levels – elementary through university.

Handbook Of Test Development

Author : Suzanne Lane
ISBN : 9781136242564
Genre : Education
File Size : 79. 48 MB
Format : PDF, ePub, Docs
Download : 498
Read : 730

Get This Book


The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.

Developing And Validating Multiple Choice Test Items

Author : Thomas M. Haladyna
ISBN : 9781136790652
Genre : Education
File Size : 82. 8 MB
Format : PDF, Kindle
Download : 786
Read : 333

Get This Book


This book is intended for anyone who is seriously interested in designing and validating multiple-choice test items that measure understanding and the application of knowledge and skills to complex situations, such as critical thinking and problem solving. The most comprehensive and authoritative book in its field, this edition has been extensively revised to include: *more information about writing items that match content standards; *more information about creating item pools and item banking; *a new set of item-writing rules (with examples) in chapter 5, as well as guidelines for other multiple-choice formats; *hundreds of examples including an expanded chapter 4 devoted to exemplary item formats and a new chapter 6 containing exemplary items (with author annotations); *a chapter on item generation (chapter 7) featuring item modeling and other procedures that speed up item development; and *a more extensive set of references to past and current work in the area of multiple-choice item writing and validation. This book will be of interest to anyone who develops test items for large-scale assessments, as well as teachers and graduate students who desire the most comprehensive and authoritative information on the design and validation of multiple-choice test items.

The Wiley Handbook Of Psychometric Testing

Author : Paul Irwing
ISBN : 9781118489826
Genre : Education
File Size : 33. 72 MB
Format : PDF, ePub, Mobi
Download : 190
Read : 255

Get This Book


A must-have resource for researchers, practitioners, and advanced students interested or involved in psychometric testing Over the past hundred years, psychometric testing has proved to be a valuable tool for measuring personality, mental ability, attitudes, and much more. The word ‘psychometrics’ can be translated as ‘mental measurement’; however, the implication that psychometrics as a field is confined to psychology is highly misleading. Scientists and practitioners from virtually every conceivable discipline now use and analyze data collected from questionnaires, scales, and tests developed from psychometric principles, and the field is vibrant with new and useful methods and approaches. This handbook brings together contributions from leading psychometricians in a diverse array of fields around the globe. Each provides accessible and practical information about their specialist area in a three-step format covering historical and standard approaches, innovative issues and techniques, and practical guidance on how to apply the methods discussed. Throughout, real-world examples help to illustrate and clarify key aspects of the topics covered. The aim is to fill a gap for information about psychometric testing that is neither too basic nor too technical and specialized, and will enable researchers, practitioners, and graduate students to expand their knowledge and skills in the area. Provides comprehensive coverage of the field of psychometric testing, from designing a test through writing items to constructing and evaluating scales Takes a practical approach, addressing real issues faced by practitioners and researchers Provides basic and accessible mathematical and statistical foundations of all psychometric techniques discussed Provides example software code to help readers implement the analyses discussed

The Next Generation Of Testing

Author : Hong Jiao
ISBN : 9781681233093
Genre : Education
File Size : 38. 15 MB
Format : PDF, Mobi
Download : 186
Read : 892

Get This Book


The Race To The Top (RTTP) federal education policy fostered a new generation of state tests. This policy advocated adopting common core standards which set a higher level of learning targets for students in the US K?12 education. These standards are intended to assess higher order thinking skills and prepare students ready for college and career. In the meantime, they are aligned with those for international assessments which keep US students abreast of their international peers. Furthermore, the new generation of state tests requires the use of technology enhanced items to align student assessments with student learning environment. Computer technology is indispensable to accomplish this goal. Computer based tests related to common core standards are different from previous state computer based tests in two important aspects, one is that the current version requires accurate assessment of students along all ability levels and the other is that it promotes the use of an efficient test delivery system, essentially the use of computerized adaptive assessment in K?12 state testing programs. In addition to providing summative information about student learning, the new common core tests add formative assessment component in the whole assessment system to provide timely feedback to students and teachers during the process of student learning and teacher instruction. As with its predecessor, the new assessment policy also holds teachers and schools accountable for student learning. With the requirements by the new federal education policy, states formed two consortia: Partnership for Assessment of Readiness for College and Careers (PARCC) and Smarter?Balanced Assessment Consortium (SBAC) to develop assessments in alignment with the new common core standards. This book is based on the presentations made at the Thirteenth Annual Maryland Assessment Research Center’s Conference on “The Next Generation of Testing: Common Core Standards, Smarter?Balanced, PARCC, and the Nationwide Testing Movement”. Experts from the consortia and nationwide overviewed the intention, history and the current status of this nationwide testing movement. Item development, test design, and transition from old state tests to the new consortia tests are discussed. Test scoring and reporting are specially highlighted in the book. The challenges related to standard setting for the new test, especially in the CAT environment and linking performance standards from state tests with consortium tests were explored. The issues of utilizing the consortium test results to evaluate students’ college and career readiness is another topic addressed in the book. The last chapters address the critical issue of validity in the new generation of state testing programs. Overall, this book presents the latest status of the development of the two consortium assessment systems. It addresses the most challenging issues related to the next generation of state testing programs including development of innovative items assessing higher order thinking skills, scoring of such items, standard setting and linkage with the old state specific standards, and validity issues. This edited book provides a very good source of information related to the consortium tests based on the common core standards.

Test Fairness In The New Generation Of Large Scale Assessment

Author : Hong Jiao
ISBN : 9781681238951
Genre : Education
File Size : 46. 29 MB
Format : PDF, ePub, Docs
Download : 432
Read : 1110

Get This Book


The new generation of tests is faced with new challenges. In the K?12 setting, the new learning targets are intended to assess higher?order thinking skills and prepare students to be ready for college and career and to keep American students competitive with their international peers. In addition, the new generation of state tests requires the use of technology in item delivery and embedding assessment in real?world, authentic, situations. It further requires accurate assessment of students at all ability levels. One of the most important questions is how to maintain test fairness in the new assessments with technology innovative items and technology delivered tests. In the traditional testing programs such as licensure and certification tests and college admission tests, test fairness has constantly been a key psychometric issue in test development and this continues to be the case with the national testing programs. As test fairness needs to be addressed throughout the whole process of test development, experts from state, admission, and licensure tests will address test fairness challenges in the new generation assessment. The book chapters clarify misconceptions of test fairness including the use of admission test results in cohort comparison, the use of international assessment results in trend evaluation, whether standardization and fairness necessarily mean uniformity when test?takers have different cultural backgrounds, and whether standardization can insure fairness. More technically, chapters also address issues related to how compromised items and test fairness are related to classification decisions, how accessibility in item development and accommodation could be mingled with technology, how to assess special populations with dyslexia, using Blinder?Oaxaca Decomposition for differential item functioning detection, and differential feature functioning in automated scoring. Overall, this book addresses test fairness issues in state assessment, college admission testing, international assessment, and licensure tests. Fairness is discussed in the context of culture and special populations. Further, fairness related to performance assessment and automated scoring is a focus as well. This book provides a very good source of information related to test fairness issues in test development in the new generation of assessment where technology is highly involved.

Challenges And Solutions In Smart Learning

Author : Maiga Chang
ISBN : 9789811087431
Genre : Education
File Size : 22. 86 MB
Format : PDF
Download : 991
Read : 823

Get This Book


This book focuses on the interplay between pedagogy and technology, and their fusion for the advancement of smart learning environments. It discusses various components of this interplay, including learning and assessment paradigms, social factors and policies, emerging technologies, innovative application of mature technologies, transformation of curriculum and teaching behavior, transformation of administration, best infusion practices, and piloting of new ideas. The book provides an archival forum for researchers, academics, practitioners and industry professionals interested and/or engaged in reforming teaching and learning methods by promoting smart learning environments. It also facilitates discussions and constructive dialogue among various stakeholders on the limitations of existing learning environments, the need for reform, innovative uses of emerging pedagogical approaches and technologies, and sharing and promoting best practices, leading to the evolution, design and implementation of smart learning environments.

Computerized Multistage Testing

Author : Duanli Yan
ISBN : 9781466505803
Genre : Mathematics
File Size : 26. 47 MB
Format : PDF, ePub, Docs
Download : 186
Read : 253

Get This Book


Devising tests that evaluate a nation’s educational standing and implement efficacious educational reforms requires a careful balance among the contributions of technology, psychometrics, test design, and the learning sciences. Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. Computerized Multistage Testing: Theory and Applications covers the methodologies, underlying technology, and implementation aspects of this type of test design. The book discusses current scientific perspectives and practical considerations for each step involved in setting up an MST program. It covers the history of MST, test design and implementation for various purposes, item pool development and maintenance, IRT-based and classical test theory-based methodologies for test assembly, routing and scoring, equating, test security, and existing software. It also explores current research, existing operational programs, and innovative future assessments using MST. Intended for psychologists, social scientists, and educational measurement scientists, this volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions. Winner of the 2016 AERA Award for Significant Contribution to Educational Measurement and Research Methodology The 2016 American Education Research Association (AERA) Div. D award committee for Significant Contributions to Educational Measurement and Research Methodology has recognized unanimously this collaborative work advancing the theory and applications of computerized MST. This annual award recognizes published research judged to represent a significant conceptual advancement in the theory and practice of educational measurement and/or educational research methodology. The 2016 award was made under the heading: Measurement, Psychometrics, and Assessment. This collective work, published in 2014 as an edited volume titled Computerized Multistage Testing: Theory and Applications, was cited by the committee both for the originality of the conceptual foundations presented in support of multistage testing and for arguing persuasively for its potential impact on the practice of educational measurement.

Developing And Validating Test Items

Author : Thomas M. Haladyna
ISBN : 9781136961977
Genre : Education
File Size : 38. 25 MB
Format : PDF, Mobi
Download : 426
Read : 1183

Get This Book


Since test items are the building blocks of any test, learning how to develop and validate test items has always been critical to the teaching-learning process. As they grow in importance and use, testing programs increasingly supplement the use of selected-response (multiple-choice) items with constructed-response formats. This trend is expected to continue. As a result, a new item writing book is needed, one that provides comprehensive coverage of both types of items and of the validity theory underlying them. This book is an outgrowth of the author’s previous book, Developing and Validating Multiple-Choice Test Items, 3e (Haladyna, 2004). That book achieved distinction as the leading source of guidance on creating and validating selected-response test items. Like its predecessor, the content of this new book is based on both an extensive review of the literature and on its author’s long experience in the testing field. It is very timely in this era of burgeoning testing programs, especially when these items are delivered in a computer-based environment. Key features include ... Comprehensive and Flexible – No other book so thoroughly covers the field of test item development and its various applications. Focus on Validity – Validity, the most important consideration in testing, is stressed throughout and is based on the Standards for Educational and Psychological Testing, currently under revision by AERA, APA, and NCME Illustrative Examples – The book presents various selected and constructed response formats and uses many examples to illustrate correct and incorrect ways of writing items. Strategies for training item writers and developing large numbers of items using algorithms and other item-generating methods are also presented. Based on Theory and Research – A comprehensive review and synthesis of existing research runs throughout the book and complements the expertise of its authors.

Top Download:

Best Books