JP-RouteBench Pilot
Project dashboard
Total Targets
772
Total Annotations
2341
Active Schemas
3
Pending Reviews
12
Annotation Progress
68%Completed 576Assigned 134Expired 28Skipped 15
Inter-Annotator Agreement
Route Classification v23x overlap156 targets
87%Route Category
92%
Complexity
84%
Language Quality
79%
κ(Route Category)= 0.81κ(Complexity)= 0.72κ(Language Quality)= 0.65
State Distribution
Raw42
Ingested23
Normalized89
Judged285
Silver Candidate312
Needs Review12
Excluded9
Recent Activity
Judged→Silver Candidate
judge_pipelineAgreement threshold met (92%)Apr 4, 06:15 PM JSTSilver Candidate→Needs Review
manual_escalationby Saki T.Ambiguous route classificationApr 4, 05:42 PM JSTNeeds Review→Silver Candidate
review_approvedby Kenji M.Apr 4, 02:30 AM JSTNormalized→Judged
judge_pipelineBatch run completedApr 3, 11:50 PM JSTRaw→Excluded
auto_filterDuplicate detectedApr 3, 08:20 PM JST