Course Overview

Welcome to TAC 459: Generative AI and Natural Language Processing, the capstone course of the USC Artificial Intelligence Minor at the University of Southern California. Co-instructed by Allen Bolourchi and Reza Jafarkhani, the course connects technical foundations, industry analysis, and hands-on AI product development through three complementary components.

Technical Foundations. Students explore how generative AI works and how frontier models are built, adapted, and evaluated. Topics include transformers and attention, prompting, RAG, efficient fine-tuning with LoRA and QLoRA, alignment, RLHF and PPO, model evaluation and benchmarks, and AI safety. Hands-on work connects these concepts to many use cases including conversational AI, text generation and summarization, machine translation, and multimodal applications.

AI Company Overview. Midway through the semester, teams investigate emerging AI companies backed by YC or elite VCs. Students analyze the products, underlying technology, customers, market opportunity, and business models, then present the company and a concrete GenAI use case to the class.

AI Capstone Product. Over nine weeks, teams apply class concepts across the AI product lifecycle: ideation, a shared minimum viable product, multiple prototypes, and a complete application built with APIs to frontier models. Students begin with course code and progressively use AI-assisted coding tools to build and refine their products. The course culminates in a working product demonstration and a startup-style launch pitch connecting the technical architecture with the user problem, product value, and business opportunity.

3 course components15 weeks of class content5 technical modules9-week AI product build

01

Generative AI, Frontier Model Foundations, and NLP

Technical core · Throughout the semester

Build the technical foundations of generative AI and natural language processing, from text processing and machine learning to transformers and frontier models. Connect these concepts with speech, alignment, and advanced generative AI applications.

02

AI Company Overview

Midsemester · Industry case study

Study an emerging AI company backed by YC or elite VCs through its product, underlying technology, customers, and market opportunity. Present the company and a concrete GenAI use case to the class.

03

AI Capstone Product

Nine-week build · Ideas to a working product

Apply class concepts to a product built from the ground up. Progress from ideas and a shared MVP to multiple prototypes, then select, refine, and demonstrate a complete AI product with a frontier-model API feature, built with vibe coding using Codex, Claude, or Muse Code.

Prof. Allen Bolourchi

Prof. Allen Bolourchi

AI Research, Product and Program Management at Meta Superintelligence Labs, FAIR

Allen Bolourchi leads AI research and product at Meta Superintelligence Labs (MSL), Fundamental AI Research (FAIR), and is an Adjunct Professor of Generative AI and NLP at the USC Viterbi School of Engineering, where he directs the capstone of the USC AI Minor (TAC 459), which he designed from the ground up. At Meta, his work spans frontier models, agentic AI, world models, computer-use agents, and multimodal intelligence. He also co-leads the development of Meta's open-weight model Muse Glimmer and has co-authored research with Yann LeCun and other FAIR researchers. Previously, he led AI/ML personalization for the App Store and Apple Arcade at Apple.

Prof. Reza Jafarkhani

Prof. Reza Jafarkhani

Senior Lecturer of Technology and Applied Computing

Reza Jafarkhani is a Senior Lecturer of Technology and Applied Computing at the USC Viterbi School of Engineering, specializing in machine learning, artificial intelligence, and data analytics. He teaches all courses in the USC AI Minor, helping students build AI capabilities from foundational concepts to advanced applications. With extensive experience teaching students across the program, he connects technical theory with practical implementation and guides learners as they develop their AI skills. He co-instructs TAC 459 with Professor Allen Bolourchi, bringing this broad teaching experience to the course's technical foundations and hands-on AI product development.

Learning Assistants

Dylan Chen

Dylan Chen

Learning Assistant · Major: Business Administration, Applied Data Science

Dylan Chen is a USC student graduating in Spring 2027 with a B.S. in Business Administration, a Minor in AI Applications, and an M.S. in Applied Data Science. During his 2026 internship at Meta, he built Meta FinTech's offline feature platform behind personalized shopping and ad badges, serving all Meta users across a variety of domains, plus MLOps tooling and a semantic layer for the org.

Arvin Duh

Arvin Duh

Learning Assistant · Major: AI for Business

Arvin Duh is a USC student graduating in Spring 2027 with a B.S. in AI for Business. During his 2026 internship at Google, he built an agent-eval framework that cut evaluation time from 6 hours to 20 minutes, a 30-agent swarm mapping 3,000+ CFO Org profiles, a document parser, a rebuilt LoC tool, and a CL auto-review dashboard.

Technical Class Content

Core concepts and deeper applications

Module 1 Introduction to Generative AI, NLP, and Text ProcessingDeliverables

Week1

Introduction to NLP, Generative AI, and Text Processing

-
Core concepts
  • Course Overview
  • Historical Evolution of AI and NLP
  • Basic Text Processing and Language Understanding
Applications & deeper topics
  • Key Concepts in Machine Learning and NLP
  • Overview of NLP Applications in Various Domains
  • Challenges and Limitations in NLP
Week2

Text Cleaning and Preprocessing

Assignment 1 Due
Core concepts
  • Text Cleaning and Preprocessing
  • Text Normalization and Tokenization
  • Lemmatization and Stemming
  • Regular Expressions in Text Processing
  • Overview of python libraries such as NLTK, Spacy, regex etc.
Applications & deeper topics
  • Techniques for Noise Reduction
  • Co-occurrence Matrix in Text Analysis
  • Feature Extraction from Text
  • Basic Overview of Word Embeddings

Module 2 Fundamentals of Generative AI, Transformers, and Machine Learning for NLP

Week3

Fundamentals of Machine Learning for NLP and Metrics

Assignment 2 Due
Core concepts
  • Training, Validation, and Test Sets in Model Development
  • Overfitting and Underfitting in NLP
  • Introduction to Python ML Libraries
Applications & deeper topics
  • Supervised Learning and Unsupervised Learning - Key Algorithms for NLP
  • Evaluation Metrics for NLP Models
  • Cross-Validation Techniques
Week4

Neural Networks and Deep Learning in NLP

Assignment 3 Due
Core concepts
  • Neural Networks and Deep Learning in NLP
  • Activation Functions and Network Topologies
  • Backpropagation and Gradient Descent
  • Challenges in Deep Learning for NLP
Applications & deeper topics
  • CNNs and RNNs for NLP
  • Advanced RNNs: LSTM and GRU
  • Sequence Modeling in NLP
  • Case Studies in Deep Learning for NLP
Week5

Transformer Models and Attention Mechanisms

Assignment 4 Due
Core concepts
  • Transformer Models and Attention Mechanisms
  • Understanding the Transformer Architecture
  • Overview of BERT, GPT, and Transformer Variants
Applications & deeper topics
  • Concepts of Self-Attention and Positional Encoding
  • Applications of Transformer Models in NLP
  • Training Transformer Models for NLP Tasks
  • Challenges and Solutions with Transformer Models

Module 3 Generative AI and Applications

Week6

Syntax, Parsing, Word Embeddings, and POS Tagging

Assignment 5 Due
Core concepts
  • Syntax, Parsing, Word Embeddings, and POS Tagging
  • Syntax in Natural Language Processing
  • Word2Vec, GloVe, and FastText Embeddings
  • Part-of-Speech (POS) Tagging: Importance, Methods, and Tools
Applications & deeper topics
  • Dependency and Constituency Parsing
  • Deep Dive into Word Embeddings
  • Using Embeddings in NLP Tasks
  • Practical Parsing, Embedding, and POS Tagging Techniques
  • Vector Database
Week7

Semantic Analysis, Language Models, and Question Answering

Assignment 6 Due
Core concepts
  • Semantic Analysis, Language Models, and Question Answering
  • Semantic Role Labeling (SRL)
  • Overview of Language Models in NLP
  • Word Sense Disambiguation Techniques
Applications & deeper topics
  • Knowledge Graphs in Semantic Analysis
  • Advances in Contextual Embeddings
  • Introduction to Question Answering System and Utilizing Language Models
  • Challenges in QA and Semantic Analysis
Week8

Text Classification and Machine Translation + Midterm Exam

-
Core concepts
  • MidTerm Exams!!
  • Text Classification and Machine Translation
  • Fundamentals of Text Classification
  • Introduction to Machine Translation
Applications & deeper topics
  • Techniques and Algorithms for Classification
  • Neural Machine Translation (NMT) models
  • Challenges and Evaluation Metrics for MT
  • Practical Implementation of MT Systems

Module 4 Techniques in Speech and NLP

Week9

Advanced Topics in Machine Learning and NLP

Assignment 7 Due
Core concepts
  • Advanced Topics in Machine Learning and NLP
  • Strategies for Addressing Data Imbalance
  • Utilizing Pre-Trained NLP Models
Applications & deeper topics
  • Deep Transfer Learning in NLP
  • Model Interpretability and Explainability in NLP
  • Advanced Optimization Techniques in NLP
  • Case Studies of Advanced ML in NLP
Week10

Named Entity Recognition, Information Retrieval and Search

Assignment 8 Due
Core concepts
  • Named Entity Recognition, Information Retrieval and Search
  • Fundamentals of Information Retrieval
  • Deep Dive into TF-IDF and Co-occurrence Matrix
  • Evaluation Metrics in Information Retrieval
Applications & deeper topics
  • Advanced Techniques in NER
  • Contextual NER and Its Applications
  • Search Engines and Indexing Techniques
  • Case Studies and Real-World Applications
Week11

Advanced Machine Translation and Summarization

Assignment 9 Due
Core concepts
  • Advanced Machine Translation and Summarization
  • Text Summarization
  • Extractive vs. Abstractive Summarization
  • Challenges in Summarization
Applications & deeper topics
  • Advanced Techniques in Machine Translation
  • Handling Low-Resource Languages in MT
  • Evaluation of Summarization Techniques
  • Current Trends in MT and Summarization
Week12

Speech Processing and Conversational AI

Assignment 10 Due
Core concepts
  • Speech Processing and Conversational AI
  • Basics of Speech Recognition
  • Evaluating Dialogue Systems in Conversational AI
  • Natural Language Understanding in Conversational AI
Applications & deeper topics
  • Challenges in Automatic Speech Recognition (ASR)
  • Design and Development of Conversational Agents
  • Multimodal Interaction in Conversational AI
  • Case Studies in Speech Processing and Conversational AI

Module 5 Frontier Models, Alignment, and Advanced Generative AI Topics

Week13

Generative AI, Products, Techniques, APIs, and Ethical Considerations

Assignment 11 Due
Core concepts
  • Generative AI, Products, Techniques, APIs, and Ethical Considerations
  • Generative Models in NLP (ChatGPT, BARD, Gemini, Llama)
  • Business Intelligence, Marketing, Analytics, and Brand Analysis Use Cases
  • Introduction to Product Management and Business Considerations
Applications & deeper topics
  • Advanced Prompt Engineering: Few-shot, Chain-of-thought, and Self-Consistency
  • Expanding LLM Capabilities: Knowledge Generation Prompting and Program-aided (PAL)
  • Developing an API with MongoDB and ngrok, and interfacing via Postman
  • LLM Safety: Prompt Injection, Prompt Leaking, Jailbreaking
  • Responsible AI, Data Privacy, Ethical Considerations, and Governance in AI
Week14

Training and Fine-Tuning LLMs, Hugging Face, LangChain, and RAG

Assignment 12 Due
Core concepts
  • Training and Fine-Tuning LLMs, Hugging Face, LangChain, and RAG
  • Fine Tuning LLMs, Best Practices and Challenges
  • Overview and Practical Use of Hugging Face in NLP Based Products
  • Utilizing LangChain and Llama for Customized Language Models
Applications & deeper topics
  • RAG: Retrieval Augmented Generation
  • Training of Chat GPT with Reinforcement Learning, HITL, and Proximal Policy Optimization
  • Evaluation of LLMs: MMLU, HellaSwag Benchmark, ARC, WinoGrade, GSM-8k, Truthful QA, PIQA
  • LoRA and QLoRA for Efficient Model Adaptation
  • Fine-Tuned LLMs Application
Week15

Course Review, Future Trends, and Project Presentations + Final Exam

AI Capstone Product Deliverables Due
Core concepts
  • Course Review, Future Trends, and Project Presentations + Final Exam
  • Recap of Key NLP and Generative AI Concepts
  • Resources for Advanced Learning
  • Closing Remarks and Course Evaluation
Applications & deeper topics
  • Discussion on the Future Trends in NLP and Generative AI
  • Student Project Presentations
  • Feedback and Review of Projects

AI Company Overview

Midsemester industry case study

The AI Company Overview connects the technical material with the products and businesses being built around generative AI. Teams investigate an emerging company, explain why its technology matters, and use that analysis to inform their own product ideas.

Presentation: November 2, 2026 · 12:00 PM · In person

AI Company Overview presentation upload (presentation day only)

Select an emerging company

Form a team of six; four teams may have seven members. Select a company at the pre-seed, seed, Series A, or Series B stage with an emerging GenAI application. Y Combinator companies are preferred; other selections require professor approval. Discuss the choice with the professor before preparing the overview.

Explain the product and technology

Cover the problem, product, generative AI technology, target customers, practical use case, differentiation, and market opportunity. Include one or two concrete GenAI examples so the class can understand how the product works and what makes it distinctive.

Present and connect to your product

Prepare a 10-minute company overview and a two-minute Q&A, with every team member participating. Add one slide and a one-minute pitch for each proposed capstone product idea. Upload the presentation to Brightspace. Teams are also encouraged to contact a founder, executive, or employee; a 15–20 minute guest segment is optional if the company participates.

The AI Capstone Product turns course concepts into a working application over nine weeks. The same team moves from a problem and product idea to one shared minimum viable product (MVP), develops multiple prototypes, and selects a direction to refine into the complete product. Each product must use a frontier-model API for at least one feature.

Class concepts & ideasOne team MVPMultiple prototypesComplete product

AI Capstone Roadmap (Link to full roadmap)Deliverables

  1. Week 1 · , 2026

    Form teams of 6–7

    Use the same team as the AI Company Overview.

    Week 1 deliverables

    • Add your team members’ names to the class sheet.
    • Meet with the professor. Schedule on Calendly; the link will be shared on Piazza.

    Add team members to the class sheet

    No file upload required; update the class sheet and schedule your professor meeting.

  2. Week 2 · , 2026

    Propose product ideas

    Develop initial product ideas grounded in class concepts and a clear user problem. Discuss possible applications and the value each idea could offer with teammates.

    Week 2 deliverables

    • Develop initial product ideas for the team.
    • Optional: meet with a learning assistant to brainstorm.

    No upload required this week.

  3. Week 3 · , 2026

    Prepare product idea pitches

    Prepare one slide and a one-minute pitch for each proposed product idea, to present after the AI Company Overview on November 2.

    Week 3 deliverables

    • Prepare product-idea pitch slides.

    No upload required this week.

    Preparation milestone; no separate upload deadline this week.

  4. Week 4 · , 2026

    Pitch your ideas and create the product roadmap

    Present each product idea after the company overview, then define your product roadmap and the scope of one shared MVP. Meet with a learning assistant to enhance the roadmap and MVP.

    Week 4 deliverables

    • : present one slide and a one-minute pitch per product idea; upload the combined company overview presentation to Brightspace.
    • Meet with a learning assistant to review the roadmap and MVP.

    AI Company Overview presentation upload (presentation day only)

  5. Week 5 · , 2026

    Build one shared MVP

    Use course code and class concepts to create one minimum viable product for the team. Establish the core user experience and technical foundation for the prototypes that follow.

    Week 5 deliverables

    • : upload the product roadmap to Brightspace.
  6. Week 6 · , 2026

    Enhance the MVP and start multiple prototypes

    Improve the shared MVP and explore alternative product directions through multiple prototypes. Apply class concepts and incorporate a frontier-model API feature.

    Week 6 deliverables

    • Meet with the professor and share your MVP and prototypes.

    No upload required this week.

  7. Week 7 · , 2026

    Develop multiple prototypes

    Create prototypes in groups of two. For teams of seven, one group may have three members. Explore and compare different implementations before choosing a product direction.

    Week 7 deliverables

    • Working prototypes from the smaller groups.

    No upload required this week.

    Progress milestone; no separate submission deadline in the roadmap.

  8. Week 8 · , 2026

    Select and refine the complete product

    Choose a prototype, enhance it, and bring the team’s work together into a complete application. Refine the chosen direction and prepare it for demonstration.

    Week 8 deliverables

    • A selected, enhanced prototype developed into the complete product.
    • : upload prototype code and design to Brightspace.
  9. Week 9 · , 2026

    Demonstrate the product and prepare the launch pitch

    Finalize your application and prepare a startup-style presentation connecting the user problem, product value, business opportunity, and technical architecture. Show the progression from the MVP through prototypes to the complete product. The roadmap schedules the in-person presentation for December 11 at 5:00 PM, subject to confirmation of exam conflicts. The presentation format will be shared.

    Week 9 deliverables

    • : present the MVP, prototypes, and complete product; upload the presentation to Brightspace.

    AI Capstone Product presentation upload (presentation day only)

· Complete product submission

  • Upload final presentations to Brightspace.
  • Upload all product files.
  • Share your public GitHub repository.

Office Hours

Instructor / Learning AssistantDay & TimeLocationLink
Reza JafarkhaniTuesday · 2:30 PM - 3:30 PMRRB 211 / ZoomPiazza
Allen BolourchiAnnounced on PiazzaZoomPiazza
Dylan ChenAnnounced on PiazzaTBAPiazza
Arvin DuhAnnounced on PiazzaTBAPiazza

Previous Semesters & AI Capstone Product

Class Photos

TAC 459 class, Spring 2025
Spring 2025
TAC 459 class, Fall 2024
Fall 2024
TAC 459 class, Spring 2024
Spring 2024