UX Research: Manager Direct Reports Page Usability Evaluation
We conducted a usability study to evaluate the overall user experience of the Manager Direct Reports Page and its subpages. The goal was to understand how managers use this feature to track progress, view reports, and send reminders, as well as to identify areas for improvement and potential new features based on user needs.
Test Plan Overview
We interviewed managers within the organization who regularly use the app in their managerial capacity. Participants had varying levels of expertise and represented diverse roles, ensuring a well-rounded set of insights.
Test Goals
- Understand managers’ goals, needs, behaviors, and expectations.
- Set a product roadmap by prioritizing features based on user needs.
- Identify opportunities for new features and highlight areas of improvement.
- Assess data that may indicate potential issues with direct reports’ training progress.
- Uncover potential disengagement factors and areas to enhance user support.
Methodology
The study was conducted through user interviews with scenario-based tasks. Managers were asked to walk through key functions such as reviewing progress, comparing performance metrics, identifying overdue tasks, and providing feedback on training performance.
Key Tasks Tested
Reviewing Progress Reports
Participants walked us through their current process of reviewing direct reports’ progress.
Monitoring Compliance
Managers explained how they ensure their teams meet mandatory compliance requirements.
Providing Feedback
We observed how managers use the system to give performance feedback to their teams.
Addressing Performance Issues
Managers were asked to investigate and resolve training delays or non-compliance using the page.
Key Findings and Outcomes
Enhanced Data Visibility
Managers expressed a desire for more detailed data insights, such as the total number of overdue courses, course completion rates, average scores, time spent on courses, and CEUs. This would provide a more comprehensive view of team performance, helping them take timely actions.
Jeopardy and Compliance Alerts
Clear indicators for direct reports in jeopardy or those nearing non-compliance were requested. Managers suggested implementing visual cues, such as flags for overdue items, courses nearing deadlines, and automatic escalations for compliance issues to allow for quick resolution and follow-up.
Key Findings and Outcomes
Navigation Challenges
Some managers found it difficult to navigate to key information. Issues like being unable to click on certain direct reports or not knowing their compliance status after clicking through led to confusion and inefficiency.
Key Findings and Outcomes
Improved Reporting and Customization
Managers noted that the current reports lacked detailed insights, especially when dealing with nested teams. They expressed the need for more customizable reports showing a complete view of team performance, including JSON plus signatures for compliance verification.
Progress Tracking and Alerts
A 30-day reminder system for overdue courses was suggested, with automatic triggers based on user inactivity.
Key Findings and Outcomes
Actionable Icons and Filters
Managers asked for icons to be added for marking tasks and filtering options by various criteria such as overdue items, course start dates, and required actions. This would enable them to prioritize tasks more effectively.
Key Findings and Outcomes
Additional Actions and Bulk Operations
The ability to send emails to users, enroll them in courses, and export reports for direct reports was highlighted as an area for improvement. Managers also requested the capability to perform these actions in bulk, especially sending reminders and reviewing team metrics across multiple direct reports.
Next Steps
We held a debrief session with the Product Owner and Product Designer to share the results. The Product Designer applied the feedback, while the Product Owner helped prioritize enhancements based on business goals and user needs.
By embedding this feedback into future iterations, the Manager Direct Reports Page will evolve to better meet the needs of our managerial users, improving both usability and user satisfaction.
