1. Layers of AI

    Trace the conceptual hierarchy from artificial intelligence and machine learning to deep learning, language models, and AI engineering.

  2. Language Models (LM)

    Explore probabilistic language modeling, tokens and vocabularies, and the difference between masked and autoregressive models.

  3. Large Language Models (LLM)

    Follow how large language models are built, from data preparation and architecture to training, inference, scaling, and optimization.

  4. Foundation Models

    Understand foundation models and survey representative models for text, images, speech, and other modalities.

  5. AI Engineering

    Examine why AI engineering emerged, how it differs from conventional software development, and what its application stack involves.

  6. Traditional Software Development

    Review the conventional software delivery lifecycle, from requirements and research to implementation, testing, performance, and operations.

  7. Retrieval-Augmented Generation (RAG)

    A structured guide to retrieval-augmented generation: motivation, indexing, retrieval, context assembly, optimization, and evaluation.

  8. AI Agents

    Understand AI agents through tool use, planning, the ReAct pattern, and the challenges of reliable multi-step execution.

  9. Fine-Tuning

    Examine when fine-tuning helps, how it compares with prompting and RAG, and how to train, optimize, and evaluate adapted models.

  10. Prompt Engineering

    Explore prompt structure, context, examples, constraints, security risks, and practical ways to improve model instructions.

  11. Memory

    Distinguish model knowledge, short-term context, and long-term memory, with an emphasis on storage, retrieval, and lifecycle management.

  12. Evaluation

    Organize practical AI evaluation around criteria, measurement methods, model selection, and evidence-based decisions.

  13. Dataset Engineering

    Survey the dataset engineering lifecycle: requirements, acquisition, synthesis, cleaning, validation, and quality control.

  14. AI Engineering Architecture and User Feedback

    Connect gateways, context engineering, guardrails, caching, agents, and observability with a user-feedback loop.

  15. Inference Optimization

    Study inference optimization through latency, throughput, memory use, and cost across models, runtimes, and serving systems.

  16. AI Technology Stack

    Map the AI technology stack into four layers: compute infrastructure, models, application platforms, and AI applications.