User Reports
If you have an in-house data labeling team, you can stay on top of your labeling team's efficiency through our User Reports. Summaries and charts can help you find your high-performing labelers and under-performing labelers. In the case in which labelers are paid based on the amount of labels approved, User Reports can reduce the administrative burden of your payroll team.

Where to View User Reports

  1. 1.
    Navigate to the project page where you want to see analytics reports.
  2. 2.
    Click the User Reports tab in the Project sidebar.
  3. 3.
    When you click the topmost dropdown menu, you can now view both the applied filter status and filter properties (Filter by submitted/Filter by in progress) along with the requested date.

Key Statistics in User Reports

Annotation Summary

  • User name and email
  • Total number of labels each user submitted, as well as the total number of objects and categories contained within these labels
  • Total amount of time each user spent in the labeling tool
  • Total number of objects per each annotation type and object class
  • Total number of Approved, Rejected and Unreviewed labels
  • Rate and average of Rejected Ratio, Reviewed Ratio, and Avg Review Round
Here are some additional actions you can take on the Annotation Summary table:
A. View Past User Reports You can load user reports that were created in the past. Select the user report you'd like to view from the drop-down list. Any previously defined custom filters will persist.
B. Customize User Reports You can customize a user report using several filter options. Click on the Customize button at the top-right, and then select from the list of customizable filter options such as label status, dataset name, label tag, and assignee.
C. View Labels Submitted by Each User When you hover your mouse over each row of the Annotation Summary table, a View button will appear. Click on each row to move to the Labels list page and see the list of labels the selected user has submitted.

Label Counts by Status

You can check the following on the Label Count by Status chart (bar graph).
  • Total number of Submitted, In Progress, and Skipped labels for each user
Related Manual:
Any other questions? E-mail us at [email protected].