Confidential · Darrin only

Evaluator packet viewer

Review the answer key, rubric, and interview extension without extracting the ZIP. Original files remain available individually.

Evaluator-only material. Do not share this page or its files with candidates.
READ_ME_FIRST_Evaluator_Guide.pdf · Browser preview

Evaluator guide

Download original

Open evaluator guide

Evaluator_Answer_Key.xlsx · Excel workbook · rendered as HTML

Answer key

Download original

Expected Shipments

shipment_idnormalized_containerbooking_referencepo_numbersexpected_statusexpected_eta_or_availabilityexpected_prioritykey_issuesrecommended_action
SHP-1001MSCU6639871BK-8801PO-26-001Arrived / awaiting terminal workflow2026-09-14HighArrival date earlier than ERP | High-priority drayage coordinationMonitor; refresh stale/conflicting data where noted
SHP-1002OOLU7215245BK-8802PO-26-002, PO-26-003In transit2026-09-21MediumContainer number formatting | ETA slipped 3 days | Multiple POs in one containerMonitor; refresh stale/conflicting data where noted
SHP-1003CMAU3123456BK-8803PO-26-004Customs/document hold2026-09-20CriticalCustoms/document hold | Backorders waitingCorrect commercial-invoice detail and coordinate broker release
SHP-1004TGHU8492013BK-8804PO-26-005Discharged, not releasedUnknown — discharged, not releasedCriticalERP says delivered but terminal and ops say not releasedCorrect ERP status; confirm customs/terminal release
SHP-1005MAEU1234567BK-8805PO-26-006, PO-26-007Rebooked / in origin departure workflow2026-10-04CriticalERP ETA obsolete | Email supersedes blank spreadsheet ETA | Ops override conflicts with newer forwarder email | Customer commitment at risk | Multiple POsConfirm October 4 ETA; assess PO-26-006 dealer shortage and communicate risk
SHP-1006HLCU7654321BK-8806PO-26-008In transit; quantity discrepancy2026-09-29HighLoaded quantity 25 units short versus PO | ETA slipped 5 daysReconcile 25-unit short load with vendor and purchasing
SHP-1007COSU4412098BK-8807PO-26-009In transit; update stale2026-09-19 (stale)HighForwarder update older than 7 daysMonitor; refresh stale/conflicting data where noted
SHP-1008EGHU3098742BK-8808PO-26-010, PO-26-011Delayed — port congestion2026-10-03CriticalDuplicate forwarder update | ETA slipped 7 days | Port congestionPlan around October 3 arrival and Phoenix replenishment
SHP-1009TEMU5501289BK-8809PO-26-012In transit; update stale2026-09-20 (stale)HighForwarder update older than 3 daysMonitor; refresh stale/conflicting data where noted
SHP-1010FCIU9283410BK-8810PO-26-013, PO-26-014Booked2026-09-28LowMonitor; refresh stale/conflicting data where noted
SHP-1011SEGU4456721BK-8811PO-26-015In transit2026-09-25MediumOperations tracker uses letter I instead of digit 1 | ETA slipped 2 daysMonitor; refresh stale/conflicting data where noted
SHP-1012TRHU6723984BK-8812PO-26-016, PO-26-017Gate-in pending2026-10-04HighGate-in pending | ETA slipped 4 days | Multiple POsMonitor; refresh stale/conflicting data where noted
SHP-1013YMLU3098765BK-8813PO-26-018In transit; update stale2026-09-18 (stale)HighForwarder update older than 7 daysMonitor; refresh stale/conflicting data where noted
SHP-1014ONEU7263419BK-8814PO-26-019In transit2026-09-29MediumETA slipped 2 daysMonitor; refresh stale/conflicting data where noted
SHP-1015APZU4918273BK-8815PO-26-020, PO-26-021Booked2026-10-01LowMonitor; refresh stale/conflicting data where noted
SHP-1016BMOU3309812BK-8816PO-26-022Booking cancelled / not departedUnknown — booking cancelledCriticalBooking cancelled | No reliable ETD or ETASecure replacement booking and publish new dates

Planted Issues

issue_idcategorysource_filesaffected_recordsexpected_handlingseverity
I01Duplicate ERP row02_erp_shipments.csvSHP-1007 association repeatedDeduplicate without losing legitimate multi-PO rowsMedium
I02Container normalizationMultipleSpaces/hyphens and SEGU...I typoNormalize cautiously; typo should be flagged or matched with evidenceHigh
I03Unmatched malformed record03_forwarder_updates.xlsxFU-016 / BK-9999 / ZZZU12345Leave unresolved; do not force-matchHigh
I04Duplicate forwarder update03_forwarder_updates.xlsxFU-008 and FU-018Treat as duplicate eventMedium
I05ERP delivered contradictionERP, ops, terminal emailTGHU8492013Do not present as delivered; flag release uncertaintyCritical
I06Email supersedes portalForwarder workbook and emailMAEU1234567Use October 4 from newer email; note ops says October 6 and confirmCritical
I07Quantity shortPO lines and ERPHLCU7654321 / PO-26-008Identify 25-unit short loadHigh
I08Stale updatesForwarder workbookCOSU4412098, TEMU5501289, YMLU3098765Flag based on documented thresholdHigh
I09Multiple POs per containerERPSeveralPreserve many-to-many relationshipHigh
I10Mixed datesPO and shipment sourcesSeveralParse without swapping month/dayMedium
I11Vendor aliasesPO headersSummit Valve; Blue RiverNormalize by vendor_id, not name aloneMedium
I12Unknown datesEmail and forwarderBMOU3309812Do not invent ETA after cancellationCritical
Scoring_Rubric.xlsx · Excel workbook · rendered as HTML

Scoring rubric

Download original

Rubric

categorypointsfull-credit evidencewarning signsScore AwardedEvaluator Notes
Business interpretation20Answers the operational questions; prioritizes action; distinguishes ETA, arrival, discharge, and release.Dashboard-first response with weak operational reasoning.
Data model and reconciliation20Correct grain; preserves PO↔container relationships; normalizes identifiers; handles duplicate and alias records.Joins inflate counts; legitimate multi-PO rows are deleted.
Accuracy and validation15Finds critical contradictions, short quantity, cancelled booking, stale updates; documents checks.Invented ETA; delivered contradiction missed; no reconciliation totals.
AI and tool fluency15Uses tools to accelerate work, can explain outputs, and validates generated logic.Cannot explain solution; pastes opaque generated output.
Exception handling and prioritization15Critical records are obvious and actions are specific; uncertainty remains visible.Everything is labeled urgent or all conflicts are silently resolved.
Communication and usability10Darrin can understand priorities in under five minutes; output is navigable and concise.Technically dense output with no decision layer.
Automation judgment5Proposes staged ingestion/reconciliation with controls, provenance, retries, and human review.Claims an autonomous agent should update ERP without approval or observability.
TOTAL=SUM(G2:G8)
RecommendationStrong Hire / Hire / Mixed / No Hire
Interview_Extension_Guide.pdf + customer_orders.csv · PDF and CSV · rendered in browser

Customer-order interview extension

Download original

Open extension guide

Customer-order dataset

sales_ordercustomerskuquantity_requiredquantity_on_handpromised_ship_datelinked_popriority_tier
SO-7001Westline DealersVALVE-1IN50102026-09-25PO-26-006A
SO-7002Desert Water GroupMETER-DIG90152026-09-24PO-26-010A
SO-7003Coastal Plumbing SupplyFITTING-KIT60702026-09-22PO-26-004B
SO-7004Mesa Treatment PartnersFILTER-20110352026-09-30PO-26-008A
SO-7005North County InstallersVALVE-1IN45102026-09-29PO-26-018B
SO-7006Valley Home SystemsMETER-DIG801002026-10-03PO-26-022C
All companies, contacts, and records are synthetic.