QA Automation Engineer (Senior) at Data Wow Co., Ltd.
Build evaluation suites for LLM and ML features: curated test sets, scoring against reference answers, LLM-as-judge where it is justified, and human review where it is not.
Define what "good enough" means with the delivery team before launch, in numbers a client can accept, and hold releases to it.
Test retrieval pipelines end to end, covering chunking and indexing, retrieval quality, grounding of the final answer, and behaviour when the right document is simply not there.
Write regression tests that tolerate non-deterministic output, using semantic similarity, structured-output validation,…
Apply · View on CareerAgent