S10: Formative feedback and immediate learner reinforcement
What feedback does a learner receive after answering a formative knowledge-check question?
Why it matters: An evaluator will first confirm that feedback is actually provided during the activity, rather than only after the final examination.
Recommended response: Explain that the learning platform provides immediate feedback after the learner submits a response. The learner is informed whether the response is correct or incorrect and receives an explanation that reinforces the underlying course concept. The purpose is educational reinforcement, not merely disclosure of the answer.
Evidence expected:
Suggested owner: Instructional Designer
What information does a learner receive immediately after completing the final CE examination?
Why it matters: This confirms the basic nature and timing of summative feedback.
Recommended response: Explain that learners receive their overall assessment score upon completion, along with information identifying correct and incorrect responses. Depending on the activity and platform configuration, explanations or references to course content may also be presented.
Evidence expected:
Suggested owner: LMS Administrator or Instructional Designer
How is assessment feedback connected to the learning objectives of an activity?
Why it matters: Feedback must reinforce the intended educational outcome, not merely explain an isolated question.
Recommended response: Explain that each assessment item is associated with course content and a learning objective. Feedback is written to clarify the factual concept measured by the item and reinforce the knowledge the learner is expected to acquire.
Evidence expected:
Suggested owner: Instructional Designer
What information is collected through the post-activity evaluation?
Why it matters: The evaluator must confirm that the instrument covers the required dimensions of activity quality and educational effectiveness.
Recommended response: Explain that the post-activity evaluation collects the learner’s professional category and feedback concerning achievement of learning objectives, relevance to educational needs, instructional effectiveness, usability, learning-assessment appropriateness, and perceived commercial bias. Quantitative responses and narrative comments are collected.
Evidence expected:
Suggested owner: Accreditation Coordinator or Instructional Designer
Who reviews post-activity evaluation results?
Why it matters: Clear ownership is necessary to ensure that evaluation results lead to accountability and action.
Recommended response: Explain that evaluation findings are reviewed by the Instructional Design team, SMEs, Program Leadership, and the Accreditation Coordinator, with the Data Team supporting preparation and analysis of the dataset. Clarify which role performs routine review, which role validates content issues, and which role approves or oversees major changes.
Evidence expected:
Suggested owner: Accreditation Coordinator
How does formative feedback help learners identify and correct misunderstandings before the final CE examination?
Why it matters: ACPE reviewers may want to distinguish meaningful instructional feedback from a simple “correct” or “incorrect” notification.
Recommended response: Explain that feedback is placed immediately after the learner interaction so that the explanation remains connected to the content being assessed. It identifies the correct concept, explains the reasoning, and allows learners to recognize areas they should review before proceeding to the summative assessment.
Evidence expected:
Suggested owner: Instructional Designer
What happens when a learner does not achieve the required passing score?
Why it matters: Reviewers need to understand the complete remediation and reassessment pathway.
Recommended response: Explain that an unsuccessful learner receives the assessment result and guidance to review relevant course content before another attempt. The learner is permitted to reattempt the assessment in accordance with the activity requirements, but cannot redeem CE credit until the passing requirement has been satisfied.
Evidence expected:
Suggested owner: LMS Administrator, supported by the Accreditation Coordinator
How do you ensure feedback remains appropriate for a knowledge-based CPE activity?
Why it matters: The feedback should reinforce recall, understanding, regulations, professional responsibilities, and key concepts without inadvertently changing the activity into application-based CPE.
Recommended response: Explain that Conduent offers knowledge-based activities and reviews feedback to ensure it supports factual knowledge and comprehension. SMEs validate technical accuracy, while Instructional Designers review the instructional level, wording, and connection to the approved learning objectives.
Evidence expected:
Suggested owner: Instructional Designer and SME
When and how is the evaluation administered, and which learners are required to complete it?
Why it matters: Timing, participation, and completion controls affect the representativeness and credibility of the evaluation data.
Recommended response: Explain that the evaluation is administered after the activity through the applicable LMS or survey platform. Clearly state whether it is required before CE credit redemption, which learners are included, and how incomplete evaluations are handled. The response should distinguish a system-enforced requirement from an operational expectation.
Evidence expected:
Suggested owner: LMS Administrator and Accreditation Coordinator
How does learner evaluation feedback lead to a course or program improvement?
Why it matters: Collecting evaluation data is not sufficient unless findings are converted into decisions, actions, and follow-up monitoring.
Recommended response: Describe the process from data collection and analysis through identification of a concern, consultation between the Instructional Designer and SME, determination of whether the change is minor or major, implementation, approval, archival, and follow-up review. When the data do not support a change, the rationale for taking no action should also be documented.
Evidence expected:
Suggested owner: Instructional Designer and Accreditation Coordinator
How do you ensure that formative feedback is meaningful and consistently implemented across all ten CPE activities?
Why it matters: A few strong examples do not establish that the process operates consistently throughout the accredited course portfolio.
Recommended response: Explain that formative feedback is developed and reviewed through the instructional-design and quality-review processes. Instructional Designers and SMEs confirm that feedback is accurate, supports the relevant learning objective, reinforces the content, and is appropriate for a knowledge-based activity. The final response should identify the actual control used across courses, such as a storyboard field, quality-review checklist, or course validation requirement.
Evidence expected:
Suggested owner: Instructional Designer, supported by the SME and Quality Assurance reviewer
How do you provide useful post-examination feedback without compromising the integrity of the final assessment?
Why it matters: Detailed disclosure of answers may support learning but can create test-security and memorization risks, particularly when unlimited reassessment is permitted.
Recommended response: Explain the program’s defined balance between educational feedback and assessment security. Feedback should clarify the concept or direct the learner to relevant content without creating an answer key that can be used mechanically during a reattempt. Identify whether questions are randomized, whether answer choices change, whether attempts are limited, and whether learners must revisit content before another attempt. The response must reflect the actual platform configuration and documented practice.
Evidence expected:
Suggested owner: Instructional Designer and LMS Administrator
What triggers a revision to assessment feedback?
Why it matters: Feedback may need revision because of low learner performance, confusing wording, new regulations, outdated content, learner comments, SME recommendations, or an identified mismatch with the learning objective.
Recommended response: Explain that assessment performance trends, learner feedback, recurring areas of confusion, regulatory or content changes, SME review, quality-review findings, and gap analyses may trigger further review. The Instructional Designer and SME determine whether the appropriate action is to revise the feedback, assessment item, supporting content, or a combination of those elements.
Evidence expected:
Suggested owner: Instructional Designer
Why are evaluation results analyzed separately for pharmacists and pharmacy technicians, and how is that analysis performed?
Why it matters: The two audiences may have different educational needs, scopes of practice, learner experiences, and expectations.
Recommended response: Explain that profession-specific analysis allows Conduent to identify differences in satisfaction, perceived achievement of learning objectives, relevance, usability, and other experience indicators. Describe how the profession field is collected, how reports are segmented, which measures are compared, and who reviews the findings.
Evidence expected:
Suggested owner: Data Team, supported by the Instructional Design team
What happens when a learner reports that an activity may contain commercial bias or promote a product or company?
Why it matters: Evaluation serves as a secondary control supporting the integrity and independence requirements described under Standard 5.
Recommended response: Explain that bias-related responses and comments are flagged as priority concerns and reviewed by Instructional Designers and Program Leadership. The concern is investigated against the actual course content and disclosure records. Depending on the result, actions may include SME follow-up, content revision, independent review, additional monitoring, or exclusion of an individual from future activities. Findings and actions should be documented in the compliance file.
Evidence expected:
Suggested owner: Accreditation Coordinator or Program Leadership
What happens when a reviewer discovers that formative feedback is inaccurate, ambiguous, outdated, or does not adequately explain the correct concept?
Why it matters: Reviewers will test whether Conduent has an operational correction process and not merely a stated expectation for high-quality feedback.
Recommended response: Explain that the issue is documented and evaluated by the Instructional Designer and SME. Depending on the cause, the team may revise the feedback, assessment item, or supporting course content. The change is validated by the SME, quality-reviewed, approved before implementation, entered into the revision record, and monitored in a later reporting cycle when appropriate.
Evidence expected:
Suggested owner: Instructional Designer, with SME approval
How does Conduent ensure equivalent feedback and reassessment controls for Conduent-hosted and client-hosted learning experiences?
Why it matters: The CESAR explains that Conduent retains control of the assessment and credit-redemption gate even when clients host course content. An evaluator may test whether the learner experience and controls are genuinely consistent across delivery arrangements.
Recommended response: Explain which components remain under Conduent’s control, including the CE examination, passing determination, reassessment pathway, and access to credit-redemption instructions. Describe how client-hosted learners are directed into the controlled assessment process and how Conduent verifies that learners cannot receive credit without passing.
Evidence expected:
Suggested owner: Accreditation Coordinator or Program Manager, supported by the LMS Administrator
How do you distinguish a feedback problem from a content problem, an assessment-item problem, or a genuine learner knowledge gap?
Why it matters: Revising the wrong component can conceal the actual problem and weaken the validity of the assessment.
Recommended response: Describe a structured review beginning with item-level and objective-level learner data. Confirm whether the correct answer is clearly supported by course content, review the question for ambiguity or weak distractors, examine the feedback for clarity and instructional value, and consult the SME regarding technical accuracy. Then document the root cause and select the corresponding corrective action.
Evidence expected:
Suggested owner: Instructional Designer, with SME and Data Team support
How do you verify that aggregated evaluation results are complete, accurate, and representative before using them for decisions?
Why it matters: Large response volumes do not automatically establish data quality. Reviewers may ask about duplicates, missing profession data, response bias, coding errors, and aggregation across different course versions.
Recommended response: Describe the process used to extract, clean, reconcile, and validate the data. Explain how the Data Team manages missing values, confirms course and version identifiers, separates pharmacists from pharmacy technicians, validates totals against platform records, and documents any exclusions or limitations.
Evidence expected:
Suggested owner: Data Team
The CESAR states that disagreement with the statement “This course did not promote a particular product or company” decreased from 3.30% in 2024 to 2.40% in 2025 and approximately 2.33% in 2026. How did Conduent determine that semantics, rather than actual bias, explained the responses?
Why it matters: The numerical trend appears favorable because disagreement decreased, but the conclusion that wording caused the results requires documented analysis. An evaluator may also question the report’s use of the expression “declining trend” if it is unclear whether this refers to disagreement, agreement, or concern.
Recommended response: Clarify that the reported percentages represent disagreement with a negatively worded statement, not the percentage perceiving no bias. Explain the analytical steps taken, including review of learner comments, activity-level results, profession-specific data, course content, product references, disclosures, and recurring patterns. Show exactly what wording was changed, why it was considered ambiguous, and whether follow-up data supported the conclusion. Avoid asserting that semantics were the cause unless the analysis is documented.
Evidence expected:
Suggested owner: Accreditation Coordinator, supported by the Data Team and Program Leadership
Show us how Conduent can demonstrate that formative feedback improves learning rather than simply giving learners the answer.
Why it matters: The most difficult issue is not whether feedback exists, but whether it is educationally meaningful and supports achievement of the associated objective.
Recommended response: Select a specific assessment item and trace it from the learning objective to the instructional content, knowledge check, feedback explanation, and subsequent learner-performance data. Explain why the feedback addresses the concept rather than merely revealing the answer. If Conduent has before-and-after results following a feedback revision, present them. If effectiveness has not been measured separately, state that transparently and explain how objective-level assessment results, learner comments, and recurring error patterns are used as indirect indicators.
Evidence expected:
Suggested owner: Instructional Designer and Accreditation Coordinator, supported by the Data Team and SME
Preparation note: The CESAR describes immediate formative feedback and its intended educational purpose. The team should still be ready to demonstrate consistency and measurable effectiveness across courses, rather than relying only on selected screenshots.
Demonstrate, from a learner’s first unsuccessful attempt through eventual credit redemption, that feedback, reassessment, and credit controls operate as described.
Why it matters: This tests implementation through a complete audit trail rather than isolated screenshots.
Recommended response: Present a de-identified learner record showing course completion, first assessment attempt, score and feedback received, subsequent review or reassessment where recorded, passing attempt, completed activity evaluation, and final credit-redemption eligibility. Explain each system control and identify who monitors failures or exceptions. If the platform does not record content review between attempts, state that accurately rather than claiming it is technically enforced.
Evidence expected:
Suggested owner: LMS Administrator and Accreditation Coordinator
Preparation note: The CESAR lists CE examination screenshots, user results, reassessment instructions, and credit-redemption instructions as evidence. The strongest presentation would connect these artifacts into one end-to-end learner record.
Provide an example in which performance data led to a change in assessment feedback, and demonstrate that the change improved the learner outcome.
Why it matters: This tests whether the claimed continuous-improvement cycle closes with follow-up measurement.
Recommended response: Present an example showing the original objective, supporting content, assessment item, feedback, performance result, diagnosed cause, approved revision, implementation date, and subsequent performance. If no revision was made specifically to feedback, state that and use an example involving content or question revision while explaining how feedback was reviewed as part of the analysis. Do not imply that an effectiveness result was measured if only the change itself was documented.
Evidence expected:
Suggested owner: Accreditation Coordinator, Instructional Designer, and Data Team
Preparation note: The CESAR gives an extensive example of feedback associated with controlled-substance learning objectives, but the evaluator may still ask for a complete mapping and post-revision effectiveness result.
Show us one activity-level evaluation report for pharmacists and pharmacy technicians separately, explain the differences, and demonstrate what decision was made from the results.
Why it matters: This tests whether profession-specific reporting is operational, interpreted, and linked to decision-making rather than merely planned.
Recommended response: Present one selected activity with response counts, objective-achievement results, relevance, instructional effectiveness, usability, assessment appropriateness, comments, and bias responses separated by profession. Explain whether the differences were meaningful, what threshold or professional judgment was applied, who reviewed the result, and whether the decision was to revise, continue monitoring, or take no action.
Evidence expected:
Suggested owner: Data Team and Accreditation Coordinator, supported by Program Leadership
Readiness risk: The CESAR states that during 2026 Q3 Conduent was still working on the profession-separated summary report and strengthening aggregated learner-feedback and trend-analysis reports. Reviewers may therefore focus heavily on whether those reports are now complete, reproducible, and used in governance decisions.
Demonstrate a closed-loop evaluation process from the initial learner signal through investigation, decision, implementation, follow-up measurement, and determination of whether ACPE notification was required.
Why it matters: This is the strongest test of whether evaluation, continuous improvement, governance, and accreditation oversight operate as an integrated system.
Recommended response: Present one complete case. Identify the initial quantitative or qualitative signal, the threshold or reason for escalation, the analysis performed, consultations conducted, decision reached, classification as a minor or major change, approval, implementation date, documentation retained, subsequent evaluation or performance result, and the Accreditation Coordinator’s determination regarding ACPE notification. If recent evaluations did not produce a course revision, use a genuine monitored concern and show why no revision was warranted. Do not manufacture a corrective action merely to provide an example.
Evidence expected:
Suggested owner: Accreditation Coordinator and Program Leadership
Preparation note: The CESAR states that recent learner evaluation data did not identify significant trends requiring course changes. That is not inherently a deficiency. However, the team should be able to show that “no change required” resulted from a documented review and reasoned decision, not from the absence of formal analysis.