Post of Duty: Washington D.C - USA.
The IDB Group is a community of diverse, versatile, and passionate people who come together on a journey to improve lives in Latin America and the Caribbean. Our people find purpose and do what they love in an inclusive, collaborative, agile, and rewarding environment.
About this position:
We are looking for a looking for a professional with solid experience in designing evaluation systems and psychometric behavior analysis of virtual learning products to join our team as a PEC Consultant at the Operations Learning Program (OLP).
As a PEC Consultant, you will develop or review evaluation systems and analyze the statistical behavior of the evaluations (objective questionnaires) of virtual, in-person, and hybrid learning products based on the applicants' responses.
You will work in the Operations Learning Program (OLP), part of the Knowledge and Learning Division (KLD/SDI). This team is responsible for ensuring access to relevant and high-quality knowledge and technical learning to support corporate processes and speed up the preparation and execution of the Bank’s operational program. The Inter-American Institute for Economic and Social Development (INDES) is responsible for the learning area within this division. The INDES seeks to strengthen technical capabilities in the Region to address development challenges successfully.
What you’ll do:
Develop evaluation systems for the different virtual, in-person, and hybrid learning products of the Operations Learning Program based on the responses of the applicants. These learning products include MOOCs, private self-training courses, virtual courses with a tutor, operational certifications, and workshops. This includes:o Prepare or review objective questionnaire questions, considering the following:
Psychometric design criteria to optimize the quality of the questions according to their purpose: formative or summative. The contents of the course. Learning objectives. The guidelines of instructional design.o Prepare or review evaluation cases or scenarios.
o Prepare or review the table of specifications for each questionnaire, which must represent its structure and demonstrate its content validity.
Analyze the statistical behavior of the evaluations (objective questionnaires) of virtual, in-person and hybrid learning products based on the applicants' responses. This analysis has, among others, the following objectives: Describe the performance observed in the applicants. Describe the psychometric behavior of the evaluation. Identify opportunities for improvement in the questionnaires to optimize the evaluation, depending on their purpose. The consultant must prepare and deliver reports of these results to the Operations Learning Program. Propose solutions to improve the evaluation systems of the learning products offered by the Program.Deliverables and Payments Timeline:
Deliverables
Percentage
Estimated deliverable date.
All deliverables are described below, in the \"characteristics of deliverables\" section.
Lump sum, that total doesn't exceed the maximum amount related to this contract, and according to the products received under the Bank's satisfaction, following this detail:
- 4 payments. Each payment represents the 25% of the total amount of the contract.
Dates are flexible, depending on the requirements of each learning product.
Characteristics of deliverables:
Prepare or review questionnaire questions. Estimated quantity: 40 Prepare or review evaluation cases or scenarios. Estimated quantity: 1 Prepare or review the table of specifications for each questionnaire. Estimated quantity: 1 Analyze the statistical behavior of the evaluations. Estimated quantity: 1
What you'll need:
Education: Bachelor's degree in pedagogy, teaching, instructional design, psychology, or related field. Candidates with master's degrees in evaluation will be considered positively. Experience: At least two years of experience in classical psychometrics (Classical Test Theory). Experience in remote education aimed at public or private sector officials will be considered positively. Languages: Proficiency in Spanish and English, spoken and written, is required. Additional knowledge of French and Portuguese is preferable.Key skills:
Critical thinking and excellent analytical skills. Ability to create evaluation systems based on the program's quality guidelines and standards. Ability to propose solutions to improve the evaluations of the learning products under analysis. Rapid response capacity to respond effectively to adjustment requests and recommendations provided by the team to deliver the final version in the shortest time possible. Flexibility to establish delivery dates.Requirements:
Citizenship: You are a citizen of one of our 48-member countries. Consanguinity: You have no family members (up to the fourth degree of consanguinity and second degree of affinity, including spouse) working at the IDB, IDB Invest, or IDB Lab.Type of contract and duration:
Type of contract: Products and External Services Consultant (PEC), Lump sums