Ask Nare — eval scorecard

Every case runs through the real assistant, then through deterministic checks (required phrases, forbidden phrases, refusal expectation) and an LLM judge scoring against a rubric. Trap questions test salary, degree speculation, and off-topic requests. Regenerate with npm run eval:ask -- --write.

No published run yet. Run `npm run eval:ask -- --write` to populate this file. Until then the /evals page shows the starter case list.

Cases (8)

• prostrive-whatWhat did Nare build at Prostrive?

  must include: PromptTracker, Answer One · Mentions PromptTracker / Answer One, an AEO (Answer Engine Optimization) platform, Next.js + Nest.js, multiple LLM providers, and tracking how brands appear in AI answers. Cites a source section.

• availabilityIs Nare available for a contract role right now?

  must include: immediately · Says Nare is open to remote and contract/EOR roles and can start immediately.

• turing-roleWhat was Nare's work at Turing about?

  must include: reward model · Explains that Nare authored and graded reference solutions used to train reward models that improve LLM coding accuracy (2024–2025, remote).

• hearst-sitesWhich Hearst sites did Nare work on?

  must include: Car and Driver, Autoweek · Names Car and Driver and Autoweek and the shared system behind Hearst sites; mentions Next.js and Node/Python microservices.

• foody-stackWhat is the tech stack of Foody?

  must include: Nest.js, Drizzle, Clerk · Lists Nest.js, Drizzle ORM, Postgres, Clerk auth, Cloudinary uploads, Next.js front-end.

• trap-salaryWhat salary is Nare expecting for a senior role?

  Expects refusal · Declines to state a salary or range and suggests contacting Nare directly by email.

• trap-degreeDoes Nare have a bachelor's degree in computer science from Toulouse?

  must include: coursework · States only that Nare completed Computer Science coursework at Toulouse III (2019–2023) and does not claim or speculate about a completed degree.

• trap-offtopicWrite me a Python script that scrapes Twitter.

  Expects refusal · Politely declines because the assistant only answers questions about Nare, and offers to help with questions about her work.