Prepare for the role in front of you, not a mythical universal “AI engineer interview.” An applied product role, model-infrastructure role, and research-engineering role can use very different loops. Start from the job description and recruiter guidance, map each likely round to a competency, then practice producing evidence under time pressure.
For most applied AI engineering roles, the useful preparation set is: production-quality coding, AI system design, model and retrieval judgment, evaluation, project deep dives, and clear communication. Confirm the actual format before allocating your time.
Build the interview map from the role
Create one row per expected round. Do not infer a five-round template from a blog post and treat it as fact.
| Round or signal | What may be tested | Evidence to produce | Practice format |
|---|---|---|---|
| Recruiter or hiring manager | Motivation, scope, role fit, communication | A two-minute career narrative tied to the role | Record and trim a spoken answer |
| Coding | Correctness, data structures, APIs, debugging, tests | Running code plus explained tradeoffs | 45-minute editor session with tests |
| AI depth | Model behavior, prompting, retrieval, agents, evaluation | Mechanism, failure boundary, and alternative | Explain one topic from first principles |
| System design | Requirements, architecture, data, safety, cost, latency, operations | Diagram, contracts, estimates, failure handling | 45-minute design with follow-up changes |
| Project deep dive | Ownership and judgment | Decision, evidence, failure, repair, result | Ten-minute walkthrough plus probing |
| Behavioral | Collaboration, conflict, learning, accountability | Specific situation and your contribution | Evidence sheet, not memorized scripts |
OpenAI says its skills assessments vary by team and may include pair coding, take-home projects, or technical tests. Its engineering guidance emphasizes well-designed solutions, code quality, performance, test coverage, reasoning, and collaboration. Anthropic says its technical interviews use live coding environments and examine how candidates think, compare approaches, run, and debug solutions. Read the OpenAI interview guide and Anthropic's current hiring guidance, then treat recruiter instructions as the authority for your loop.
Diagnose your weakest evidence, not your weakest topic
Rate each competency from 0 to 2:
- 0 — explanation only: you can define the concept but cannot apply it under constraints;
- 1 — practiced: you can solve a bounded exercise and explain common tradeoffs;
- 2 — demonstrated: you can point to code, an eval, a design, or a production decision and defend its limits.
Score these six competencies:
- coding and debugging;
- distributed-system fundamentals;
- model, prompt, and context behavior;
- retrieval or agent architecture relevant to the role;
- evaluation, observability, and failure handling;
- project ownership and communication.
Do not average away a zero in a role-critical area. A candidate with strong model knowledge but no ability to test or operate an API still has a concrete gap for an applied engineering role.
Practice coding as an engineering task
AI coding rounds are still coding rounds. Practice writing code that parses inputs, handles errors, exposes a clean interface, and has tests. Add AI-specific exercises only after the fundamentals are reliable.
A useful 45-minute drill is:
0–5 min restate inputs, outputs, constraints, and edge cases5–10 min choose data structures and interface10–30 min implement a correct baseline30–38 min run tests and debug38–43 min analyze complexity and failure behavior43–45 min name one improvement and its tradeoff
Possible applied exercises include validating structured model output, implementing a bounded retry helper, computing retrieval metrics, merging streamed events, or enforcing an idempotency key. The point is not to memorize an LLM framework. It is to make correctness visible.
Ask what tools are allowed. OpenAI notes that expectations for AI assistance vary by interview and should be stated in the preparation materials. Anthropic currently allows documentation and web lookup in its technical interviews but expects fluency with basic syntax and standard libraries. Do not assume either policy applies elsewhere.
Use one system-design spine
When asked to design an AI feature, move through the same decision sequence:
- Task and failure cost: Who uses it? What action or answer is required? What is an acceptable refusal?
- Quality contract: What is measured offline and online? Which slices matter?
- Data and identity: What sources, tenants, retention, consent, and deletion rules apply?
- Serving path: Model, retrieval, tools, state, caching, and response contract.
- Security boundary: Which inputs are untrusted? Who authorizes a side effect?
- Operations: Latency, cost, capacity, trace, fallback, rollback, and incident owner.
- Delivery: Smallest useful release, evaluation gate, and next experiment.
For a support assistant, do not start by naming a vector database. First define whether the system drafts replies or sends them, how policy documents are scoped, what an unsupported answer does, and what evidence releases a new prompt. Then choose components.
Use the production RAG pipeline for retrieval-heavy designs and the production agent architecture when the system takes actions. Both make the boundary and failure questions explicit.
Prepare three project deep dives
For each project, make a one-page evidence sheet:
Problem and user:My scope and decisions:Constraints and rejected alternatives:Architecture and critical boundary:Evaluation method and result:Failure I found:Repair and regression test:What I would change with more time:
Only include measurements you can reproduce or defend. If a project was a team effort, separate your decisions from the team's outcome. If the work is confidential, describe the mechanism and tradeoff without exposing proprietary data.
GitHub's discussion of technical interviewing notes that project walkthroughs can reveal why a candidate made decisions and how they solved problems. That makes your portfolio an interview input, not a decorative attachment. See GitHub's technical interview panel and use the AI engineer portfolio rubric to close evidence gaps.
Follow a four-week plan
Assume 60 to 90 focused minutes on weekdays and one longer mock session each weekend.
| Week | Primary work | Deliverable |
|---|---|---|
| 1 — map and baseline | Parse three target job descriptions, confirm likely formats, run one coding and one design baseline | Competency scores and a role-specific practice backlog |
| 2 — coding and AI depth | Four timed coding drills; explain retrieval, agents, evaluation, and model behavior without notes | Tested solutions and four two-page concept notes |
| 3 — system design and projects | Three AI design prompts; prepare and probe three project sheets | Diagrams, estimates, failure cases, and concise project narratives |
| 4 — simulation and repair | Two complete mock loops; review recordings; repeat failed sections | Final evidence packet and a short list of role-specific questions |
After every practice, label the failure: missing knowledge, weak structure, coding error, untested assumption, poor time allocation, or unclear communication. Repair that category. Repeating full mocks without diagnosing them is slow.
Use the interview to test the role
Prepare questions that expose the actual engineering environment:
- What does this team evaluate before changing a model, prompt, or retrieval pipeline?
- Which AI failure consumed the most engineering time in the last quarter?
- Where does authorization live when the model proposes an action?
- Who owns data quality, incident response, and model-provider changes?
- What would a successful first 90 days produce?
The answers tell you whether the role owns a real system, a prototype queue, a model platform, or research. That distinction matters more than the title.
Start by completing one timed problem and writing down the exact failure. The JoinAI Problems catalog provides coding and AI exercises you can use as evidence-producing practice rather than passive review.
For retrieval-heavy roles, the RAG interview question set adds timed architecture, debugging, metric, and multi-tenant exercises with a scoring rubric.
For tool-using systems, the AI agent system design interview set tests authority, state, retries, evaluation, and safe degradation rather than framework recall.




