Skip to content

0.3 AI Full-Stack Capability Map

AI Full-Stack Capability Map

Read the picture first. The course is one engineering path:

toolsPythondatamodelsLLMRAGAgentspecialization/runtime delivery

You do not need every detail now. Just remember:

If the problem isGo back to
running codetools and Python
messy inputsdata
unreliable answersevaluation and RAG
uncontrolled actionsAgent traces and permissions
LayerCourse chaptersFirst visible evidenceDeeper question
Tools1A reproducible project folder and Git historyCan another person rerun it?
Python2Small scripts with clear inputs and outputsIs the code readable, typed, and testable?
Data3Clean tables, charts, and notesDo you know where the data is wrong or biased?
Models4-6Trained or inspected model experimentsWhat metric would change your decision?
LLM7Prompt, tokens, embeddings, Transformer intuitionWhich behavior comes from data, decoding, or context?
RAG8Retrieval trace and answer evaluationDid the answer use the right evidence?
Agent9Tool traces, permissions, memory notes, deployment notesWhat can fail when users, files, and actions are real?
Specialization / runtime delivery10-13 and electivesVision/NLP/multimodal/open-source LLM demos, exported assets, deployment notesWhich domain and runtime constraints change the product decision?

The course is not a pile of topics. It is a debugging stack and a portfolio stack. When an AI application behaves badly, the cause may live several layers below the feature you are looking at. When a reviewer asks what you built, your evidence should show which layers you controlled.

A strong career-transition project can start as one small assistant or automation and become more credible chapter by chapter.

LayerPortfolio evidence to add
ToolsRepository, README command, screenshots, and clean file layout
PythonCLI or script with visible inputs, outputs, errors, and tests
DataSample dataset, cleaning notes, charts, and edge cases
ModelsBaseline, metric table, comparison, and failure samples
LLMPrompt variants, structured output, token/cost notes, and limitations
RAGDocuments, chunks, retrieval trace, citation check, and answer evaluation
AgentTool permission boundary, action trace, memory rule, and rollback note
Specialization / runtime deliveryVision, NLP, multimodal, open-source LLM runtime, deployment, or product-specific review evidence

Use Chapters 1-9 as the default main line. After Chapter 9, you should be able to build a small LLM/RAG/Agent project with evidence, logs, and a safety boundary.

Then choose Chapters 10-13 by product need:

NeedChooseWhy
Images, cameras, OCR, detection, segmentationChapter 10 Computer VisionThe output is visual: labels, boxes, masks, text, or video events
Text labels, extraction, summaries, linguistic evaluationChapter 11 NLPThe output is a text task with labels, fields, spans, or generated text
Images, PDFs, audio, video, creative assets, multimodal RAGChapter 12 Multimodal/AIGCThe workflow mixes modalities and needs source, prompt, review, and export records
Open-source model hosting, private deployment, runtime ownershipChapter 13 Open-Source LLM DeploymentThe project must control model files, serving API, licenses, cost, and fine-tuning decisions
Deployment, advanced Python, classic ML depthElectivesThe main project needs a specific engineering or algorithmic side skill

Before starting a project, mark the highest-risk layer. For example, a PDF question-answering app usually fails first in data cleaning and retrieval, not in the chat UI. An automation agent usually fails first in tool permissions, state, and evaluation, not in the prompt wording.

During each chapter, keep one artifact that proves the layer works. Screenshots are useful, but logs, README commands, small datasets, metric tables, and failure notes are stronger because they help you debug later.

Optional background: if you want the history behind these layers, skim the 15-stage AI development map.

Next, plan how you will pace the main route.

You pass this map when you can mark your current layer, the highest-risk next layer, and one portfolio artifact that will prove progress.

Keep this page’s proof of learning as a small evidence card:

Capability Map
tools, Python, data, math, ML, DL, LLM, RAG, Agent, specialization, and runtime links
Project Thread
one assistant, automation, analysis, or multimodal project idea
Current Position
what you already know and what you will postpone
Next Step
one concrete chapter or workshop to start next
Risk Check
learning everything at once, skipping evidence, or losing the main route
Expected Output
a marked personal course map with one project thread and one immediate action