Position Description: This position is a member of CARD’s assessment program and is an integral part of the ACTFL team. The Test Developer is an entry-level position and assists the CARD’s Principal Assessment Manager with ACTFL’s test development processes for the ACTFL Assessment of Performance toward Proficiency in Language Learning (AAPPL), ACTFL Latin Interpretive Reading Assessment (ALIRA), Oral Proficiency Interview- Computer, the Writing Proficiency Test, the K12 Writing Proficiency Test, and ACTFL Listening and Reading assessments.
Responsibilities of the position include but are not limited to:
Test Development: Contribute to the development and maintenance of ACTFL’s assessment projects
Collaborate with ACTFL staff and external consultants on test development timelines and project requirements
Participate in training and norming session for the item development teams
Communicate with external test development teams and ACTFL staff
Support video and audio taping of test items
Assist with the assembly of assessments and User Acceptance Testing
Adhere to quality control procedures for item development including test specifications, copyright laws, appropriateness to test-taker populations, sensitivity, bias and fairness
Support creation and revision of assessment-related materials (test development documentation, training materials, guidelines, etc.)
Support development and maintenance of systems for tracking and maintaining test item development
Track piloting, field testing, and usability testing data in an organized and secure manner
Maintain file storage
Validity and Reliability:
Participate in iterative quality assurance measures for assessment projects in collaboration with the Quality Assurance program
Contribute to content reviews and item performance reviews
Work with Manager, Project Coordinator and other ACTFL staff and psychometricians on test designs, specifications, and item types
Recruit participants for and assist with pilot testing, field-testing, and usability testing
Collect data from pilot testing, field testing, and usability testing
Support project research on ACTFL assessments and their validity arguments
Administration: Assist with general administrative support for ACTFL assessment projects
Test Development: Assist with the project progress updates, verification and acceptance of project requirements and deliverables for administrative processes and closing procedures
Professionalism: Demonstrate good judgment, professionalism, sound application of subject matter expertise; responsiveness in support of the ACTFL mission.
Communication: Effectively communicates with participants of the test development process including test-takers, item writers, reviewers, and raters; disseminate information to all necessary parties to ensure effective stakeholder participation.
Collaboration: Work across ACTFL departments and with LTI staff to enhance the quality of assessment offerings.
Participate in the annual ACTFL Convention either on-site or from ACTFL HQ
Support development of professional presentations related to ACTFL tests
Participate in additional assignments as needed
Qualifications, Skills, Abilities, & Experience
M.A. or equivalent degree in testing and assessment, language education, applied linguistics, world language or related field, and three years of relevant experience required
Experience working on an assessment project required
Language learning experience required; proficiency in Spanish preferred; proficiency in a world language required
Knowledge of language proficiency scales (ACTFL, ILR, CEFR) required
Good understanding of item development processes and best practices test development
Familiarity with testing accommodations and ADA requirements
Ability to identify problems, conceptualize solutions, prioritize tasks and meet deadlines
Strong organization, planning and time management skills required
Microsoft Office Suite- highly proficient in Word, Excel, and PowerPoint; comfort administering an online Learning/Content Management System (e.g. Schoology); Ease learning new technology (e.g. Learnosity)
Must represent projects positively in person, by phone, online, and via written communication; effective communication skills a must
Ability to work collaboratively, cooperatively and collegially in a results-oriented environment
Ability to comfortably facilitate virtual meetings
Excellent writing, proofreading, editing, and public speaking skills
Applications must include a cover letter and three references.
Applications without a cover letter will not be considered.
Applications will be reviewed until the position is filled.
Additional Salary Information: Please include salary requirement with the application and/or in the cover letter
The American Council on the Teaching of Foreign Languages (ACTFL) is dedicated to the improvement and expansion of the teaching and learning of all languages at all levels of instruction. ACTFL is an individual membership organization of more than 12,500 language educators and administrators from elementary through graduate education, as well as government and industry.Since its founding (in 1967), ACTFL has become synonymous with innovation, quality, and reliability in meeting the changing needs of language educators and their students. From the development of Proficiency Guidelines to its leadership role in the creation of national standards, ACTFL focuses on issues that are critical to the growth of both the profession and the individual teacher.