Exam Theory: RAG and Optimization
This exam theory focuses on assessing the concepts of Retrieval-Augmented Generation (RAG) and its optimization techniques, from basic foundations to more advanced topics.
| No. | Training Unit | Lecture | Training content | Question | Level | Mark | Answer | Answer Option A | Answer Option B | Answer Option C | Answer Option D | Explanation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Unit 1: RAG and Optimization | Lec 1 | RAG Architecture | What are the two main components of a Retrieval-Augmented Generation (RAG) system? | Easy | 1 | A | The retriever and the generator | The encoder and the decoder | The indexer and the parser | The database and the prompt | A RAG (retrieval-augmented generation) system has two main components: the retriever and the generator. |
| 2 | Unit 1: RAG and Optimization | Lec 1 | RAG Architecture | What is the primary function of the retriever in a RAG system? | Easy | 1 | C | To format the output text based on formatting rules | To generate responses using internal knowledge | To search for and collect relevant information from external sources | To filter out sensitive information from the user prompt | The retriever searches for and collects relevant information from external sources, like databases, documents, or websites. |
| 3 | Unit 1: RAG and Optimization | Lec 1 | RAG Architecture | What is the primary function of the generator in a RAG system? | Easy | 1 | B | To index the knowledge base | To use retrieved information to create clear and accurate text | To collect user feedback | To convert text into dense embeddings | The generator, usually an advanced language model, uses the retrieved information to create clear and accurate text. |
| 4 | Unit 1: RAG and Optimization | Lec 1 | Benefits of RAG | Why is relying only on an LLM’s internal knowledge a limitation? | Easy | 1 | A | The system is limited to what it was trained on, which could be outdated or lacking detail. | It relies too heavily on internet connections. | Internal knowledge is always biased and cannot be trusted. | It causes the LLM to process queries much slower. | If you rely only on an LLM’s built-in knowledge, the system is limited to what it was trained on, which could be outdated or lacking detail. |
| 5 | Unit 1: RAG and Optimization | Lec 1 | Benefits of RAG | How does a RAG system help reduce "hallucinations"? | Easy | 1 | B | By shutting down the model when it detects an error | By grounding answers based on real, retrieved data from external sources | By using a secondary LLM strictly for fact-checking | By forcing the user to provide correct context in the prompt | RAG reduces hallucinations because the answers are based on real, fetched data rather than the model making up facts. |
| 6 | Unit 1: RAG and Optimization | Lec 1 | RAG Applications | How does RAG improve customer support chatbots? | Easy | 1 | C | By automatically refunding angry customers | By generating code to fix customer issues directly | By retrieving up-to-date documentation or FAQs to generate accurate answers | By translating customer queries into multiple languages | RAG powers customer support by pulling current policy info or product details to ensure customer queries are resolved with the latest information. |
| 7 | Unit 1: RAG and Optimization | Lec 1 | RAG Applications | In conversational agents (e.g., healthcare or finance chatbots), what role does RAG play? | Easy | 1 | D | It completely replaces human agents. | It manages the backend server infrastructure. | It encrypts all user conversations. | It provides factual, context-aware responses by fetching relevant facts on the fly. | By fetching relevant facts on the fly, a conversational agent can give informed answers grounded in credible sources. |
| 8 | Unit 1: RAG and Optimization | Lec 1 | RAG Applications | How can RAG assist in content generation and summarization? | Medium | 1 | B | It replaces the need for original writers entirely. | It retrieves parts of articles/papers and produces verified summaries against source data. | It auto-publishes content to social media platforms. | It generates clickbait titles for articles. | RAG retrieves parts of news articles or research papers and then produces summaries or reports that are coherent and fact-checked against source data. |
| 9 | Unit 1: RAG and Optimization | Lec 1 | RAG Applications | Why is RAG useful for domain-specific research like law or medicine? | Easy | 1 | A | It pulls from domain-specific databases (e.g., case law, medical journals) to ground output in reliable knowledge. | It generates artificial legal cases or medical data for practice. | It is cheaper than hiring domain experts. | It can diagnose diseases directly from images. | RAG systems assist by pulling from domain-specific databases to answer complex queries, ensuring the model's output is reliable domain knowledge. |
| 10 | Unit 1: RAG and Optimization | Lec 1 | Knowledge Sources | Which of the following is an example of a structured knowledge source used by RAG? | Easy | 1 | C | A collection of PDF documents | Website archives | A database or knowledge graph | Audio transcripts | Structured sources include databases, APIs, or knowledge graphs, where data is organized and easy to search. |
| 11 | Unit 1: RAG and Optimization | Lec 1 | Knowledge Sources | Which of the following best describes an unstructured knowledge source? | Easy | 1 | A | Large collections of text, such as documents or websites, requiring NLU | A SQL database with strictly typed tables | A REST API returning JSON formatted data | A spreadsheet containing categorized numerical data | Unstructured sources consist of large collections of text, such as documents, websites, or archives, where the information needs to be processed using NLU. |
| 12 | Unit 1: RAG and Optimization | Lec 1 | Prompt Engineering | Why does prompt engineering matter in a RAG system? | Medium | 1 | B | It dictates what database the retriever uses explicitly. | It guides the language model to provide high-quality, relevant responses using the retrieved info. | It controls the speed of the dense embeddings generation. | It allows users to bypass security measures. | Prompt engineering helps language models provide high-quality responses using the retrieved info. Designing a prompt affects output relevance and clarity. |
| 13 | Unit 1: RAG and Optimization | Lec 1 | Prompt Engineering | What is the purpose of a specific system prompt like "Answer the question based only on the context provided"? | Medium | 1 | A | It gives explicitly instructions to reduce the probability of hallucinations. | It ensures the model provides the longest possible answer. | It tells the system to bypass the vector database. | It allows the model to mix internal knowledge creatively. | It gives the model explicit instructions to only use the provided context, which reduces the probability of hallucinations. |
| 14 | Unit 1: RAG and Optimization | Lec 1 | Prompt Engineering | What does few-shot prompting involve in the context of RAG? | Medium | 1 | C | Prompting the model multiple times until it gets the answer right. | Breaking the database into a few specific shots. | Giving the model a few example responses before it generates its own. | Using only a few words in the user prompt to save tokens. | Few-shot prompting involves giving the model a few example responses before asking it to generate its own to guide the type of response you want. |
| 15 | Unit 1: RAG and Optimization | Lec 1 | Prompt Engineering | How does chain-of-thought prompting benefit RAG handling complex questions? | Medium | 1 | D | It chains multiple databases together. | It quickly skips the reasoning phase to provide faster answers. | It prevents the user from asking complex questions. | It encourages the model to explain its reasoning step-by-step before answering. | Chain-of-thought prompting breaks down complex questions by encouraging the model to explain its reasoning step-by-step before answering. |
| 16 | Unit 1: RAG and Optimization | Lec 1 | Retrieval Methods | What is sparse retrieval in a RAG system? | Easy | 1 | A | Matching keywords using methods like TF-IDF or BM25. | Representing documents as numerical vectors in a shared space. | Retrieving files only from limited sparse datasets. | Searching only the metadata of documents. | Sparse retrieval matches keywords (e.g., TF-IDF or BM25). It is simple but may not capture the deeper meaning behind the words. |
| 17 | Unit 1: RAG and Optimization | Lec 1 | Retrieval Methods | What is a common limitation of sparse retrieval? | Medium | 1 | B | It requires massive computational power compared to dense retrieval. | It may not capture the deeper meaning behind the words. | It cannot be used with structured data. | It generates unpredictable hallucinated documents. | While simple, sparse keyword matching may not capture the deeper contextual meaning behind the words in the query. |
| 18 | Unit 1: RAG and Optimization | Lec 1 | Retrieval Methods | What is dense retrieval? | Medium | 1 | C | Retrieving the most dense, text-heavy documents first. | Matching highly frequent exact keywords. | Using neural embeddings to understand the meaning of documents and queries. | Searching through heavily compressed ZIP files. | Dense retrieval uses neural embeddings to understand the meaning of documents and queries across a shared vector space. |
| 19 | Unit 1: RAG and Optimization | Lec 1 | Retrieval Methods | Which of the following methods are typically used for dense retrieval? | Medium | 1 | D | BM25 and TF-IDF | Inverted Indices and Hashing | SQL and GraphQL | BERT or Dense Passage Retrieval (DPR) | Methods like BERT or Dense Passage Retrieval (DPR) represent documents as vectors in a shared space, making dense retrieval more accurate. |
| 20 | Unit 1: RAG and Optimization | Lec 1 | Integration Challenges | What challenge arises if irrelevant data is retrieved and passed to the generator? | Medium | 1 | A | Irrelevant data can confuse the model and reduce the quality of the response. | The model will automatically delete the irrelevant data. | The vector database will crash. | It will significantly speed up the response generation. | The retrieved data must be highly relevant because irrelevant data can confuse the model and reduce the quality of the response. |
| 21 | Unit 1: RAG and Optimization | Lec 1 | Integration Challenges | What can happen if retrieved information conflicts directly with an LLM's internal knowledge? | Medium | 1 | C | The LLM will always overwrite the retrieved database. | The retriever will automatically trigger a self-correction mechanism. | It can create confusing or inaccurate answers. | The query will be entirely rejected by the generator. | If retrieved information conflicts with the model’s internal knowledge, it can create confusing or inaccurate answers. Resolving these conflicts is crucial. |
| 22 | Unit 1: RAG and Optimization | Lec 1 | Integration Challenges | Why might the formatting of retrieved data pose a challenge in RAG? | Hard | 1 | B | Because all retrieved data must be strictly formatted in JSON. | The style and format of retrieved data might not match the model's usual writing, making integration difficult. | Formatting heavily impacts semantic chunking. | Generators cannot process tabular formatting. | The style and format of retrieved data might not always match the model's usual writing or formatting, making it hard to integrate smoothly. |
| 23 | Unit 1: RAG and Optimization | Lec 1 | Vector Database | What are dense embeddings stored in a vector database? | Medium | 1 | D | Structured SQL commands | HTML representations of text | Plain text matched to keywords | Numerical representations that capture the meaning of words and phrases | Embeddings are numerical representations that capture the meaning of words and phrases, created by models like BERT or OpenAI. |
| 24 | Unit 1: RAG and Optimization | Lec 1 | Vector Database | How does a vector database find similar documents when a query is made? | Medium | 1 | A | Its query embedding is compared to the stored embeddings in the DB. | It parses the query for keywords and matches them to a string index. | It runs a fast SQL SELECT command. | It prompts the language model to write a similar document. | When a query is made, its embedding is compared to the stored ones in the vector database to find semantically similar documents. |
| 25 | Unit 1: RAG and Optimization | Lec 1 | System Evaluation | When evaluating a retriever, what does precision measure? | Medium | 1 | C | How many answers the generator made up. | How many user queries were successfully parsed. | How many of the retrieved documents are actually relevant. | How fast the retriever returned the results. | For the retriever, precision measures how many of the retrieved documents are relevant to the query. |
| 26 | Unit 1: RAG and Optimization | Lec 1 | System Evaluation | When evaluating a retriever, what does recall measure? | Medium | 1 | D | How well the generator remembered past conversations. | How many generated tokens matched the source. | How fast the retriever fetched data. | How many of the total relevant documents were actually found. | Recall is used to assess how many of the total relevant documents existing in the knowledge base were successfully found by the retriever. |
| 27 | Unit 1: RAG and Optimization | Lec 1 | System Evaluation | Which metrics are commonly used to evaluate the generator component in a RAG system? | Hard | 1 | C | Throughput and Latency | Precision and Recall | BLEU and ROUGE | TF-IDF and BM25 | For the generator, metrics like BLEU and ROUGE are used to compare the generated text to human-written examples to gauge textual quality. |
| 28 | Unit 1: RAG and Optimization | Lec 1 | System Evaluation | For downstream tasks like question-answering, what metrics can evaluate the overall RAG system? | Medium | 1 | B | Uptime and ping times | F1 score, precision, and recall | Epoch losses | Memory utilization | For downstream tasks like question-answering, evaluating the overall system can be done with metrics like F1 score, precision, and recall. |
| 29 | Unit 1: RAG and Optimization | Lec 1 | Handling Ambiguity | In a RAG system, what is query refinement? | Medium | 1 | A | Automatically suggesting clarifications or reformulating an ambiguous query. | Deleting queries that are not perfectly structured. | Limiting the query to a maximum character count. | Using SQL to join multiple tables based on the query. | Query refinement automatically suggests clarifications or reformulates ambiguous queries into more precise ones based on patterns or history. |
| 30 | Unit 1: RAG and Optimization | Lec 1 | Handling Ambiguity | Why might retrieving a diverse set of documents help handle incomplete queries? | Medium | 1 | C | It trains the vector database on a diverse topic set. | It saves computational costs over time. | It ensures that even if the query is vague, some relevant information is likely included. | It guarantees the generator will output a short response. | Retrieving a diverse set of documents ensures that even for vague queries covering multiple interpretations, relevant info is likely included. |
| 31 | Unit 1: RAG and Optimization | Lec 1 | Handling Ambiguity | How can Natural Language Understanding (NLU) assist with incomplete queries? | Hard | 1 | B | It automatically terminates failed queries. | It infers user intent from incomplete queries and refines the retrieval process. | It translates queries directly into Python code. | It generates database records based on the user's IP. | NLU models can infer the user intent from incomplete queries in order to refine the retrieval process and fetch accurate results. |
| 32 | Unit 1: RAG and Optimization | Lec 2 | Choosing Retrievers | Which type of retrieval is best for complex queries that need deep understanding of word meaning? | Easy | 1 | A | Dense retrieval | Sparse retrieval | Keyword mapping | Inverted Indices | Dense retrieval methods (e.g., BERT, DPR) capture context and deeper meanings, making them ideal for complex queries. |
| 33 | Unit 1: RAG and Optimization | Lec 2 | Choosing Retrievers | When might a sparse retrieval method (like BM25) be more suitable than dense retrieval? | Medium | 1 | B | When queries rely heavily on unstated context | When tasks revolve around simple keyword matching and computational resources are limited | When documents are highly abstract research papers | When processing unstructured video files | Sparse retrieval is quicker, easier to set up, and better when tasks revolve around keyword matching or computational power is limited. |
| 34 | Unit 1: RAG and Optimization | Lec 2 | Choosing Retrievers | What is the main trade-off between dense and sparse retrieval methods? | Medium | 1 | C | Security versus Privacy | Format compatibility versus Speed | Accuracy versus Computational cost | Text limit versus Context limit | The main trade-off when choosing between dense and sparse methods is the accuracy of understanding meaning versus the computational cost required. |
| 35 | Unit 1: RAG and Optimization | Lec 2 | Hybrid Search | What exactly does a hybrid search combine? | Easy | 1 | D | External databases and local text files | SQL operations and NoSQL operations | Text generators and Image generators | The strengths of both dense and sparse retrieval methods | Hybrid search combines sparse retrieval (for speed) and dense retrieval (for accuracy) to balance performance and efficiency. |
| 36 | Unit 1: RAG and Optimization | Lec 2 | Hybrid Search | In a typical hybrid search pipeline, what is a common sequence of operations? | Hard | 1 | A | Use sparse method (like BM25) to quickly find documents, then use dense method (like BERT) to re-rank them. | Use dense method to summarize documents, then use sparse method to find keywords. | Use dense method exclusively, and use sparse method only as a failover. | Merge the vector embeddings with the sparse inverted indices directly. | A typical hybrid flow uses sparse methods to quickly fetch broad keywords, and dense methods to re-rank and understand context of those fetched results. |
| 37 | Unit 1: RAG and Optimization | Lec 2 | Vector DB Alternatives | Is a vector database always necessary to implement a RAG system? | Easy | 1 | C | Yes, RAG cannot function without one. | Yes, but only for cloud-based setups. | No, alternatives exist like traditional relational/NoSQL DBs or file systems. | No, RAG models always have vector databases integrated natively. | While great for embeddings, vector DBs are not strictly necessary. Relational/NoSQL databases or inverted indices can work for structured/sparse tasks. |
| 38 | Unit 1: RAG and Optimization | Lec 2 | Vector DB Alternatives | When are traditional databases like MongoDB or Elasticsearch appropriate in RAG? | Medium | 1 | B | For cutting-edge dense semantic searches. | For handling unstructured data and full-text keyword searches without deep semantic search. | For hosting the generative language model itself. | For creating neural network embeddings. | They are good for handling unstructured data and full-text searches, though they typically lack deep semantic search capabilities out of the box. |
| 39 | Unit 1: RAG and Optimization | Lec 2 | Vector DB Alternatives | What is a limitation of using inverted indices instead of vector databases? | Medium | 1 | A | They map keywords fast but don't capture the semantic meaning behind the words. | They are significantly slower than vector databases. | They require advanced neural networks to map text. | They consume far more memory than vector embeddings. | Inverted indices map keywords to documents for fast searches, but they do not capture the underlying meaning or context behind the keywords. |
| 40 | Unit 1: RAG and Optimization | Lec 2 | Optimizing Retrieval | How does curating high-quality knowledge bases impact retrieved information? | Easy | 1 | D | It increases the latency of retrieval. | It allows the LLM to access the public internet. | It removes the need for checking metrics like F1 score. | It ensures the information is reliable and fits the exact needs of the application. | Having a curated knowledge base directly controls what the retriever can find, ensuring results are reliable and suited to the app's needs. |
| 41 | Unit 1: RAG and Optimization | Lec 2 | Optimizing Retrieval | What does it mean to re-rank results in a RAG system? | Medium | 1 | B | Randomizing results to ensure high diversity. | Sorting initial retrieved results based on detailed relevance checking to get the most accurate info. | Removing duplicate keywords from the prompt. | Changing the priority queue of the inference engine. | Re-ranking involves taking a retrieved set of results and sorting them based on a deeper check of how well they actually match the query context. |
| 42 | Unit 1: RAG and Optimization | Lec 2 | Handling Long Docs | What does the chunking technique refer to in RAG? | Easy | 1 | C | Removing chunks of the LLM's memory to save space. | Processing multiple user queries at once in large chunks. | Breaking long documents into smaller, more manageable sections for easier search and retrieval. | Compressing final outputs into bite-sized summaries. | Chunking means breaking massive documents into smaller segments to help the system retrieve relevant parts without processing the entire source text. |
| 43 | Unit 1: RAG and Optimization | Lec 2 | Handling Long Docs | How does the hierarchical retrieval approach help manage large knowledge bases? | Hard | 1 | A | Using a two-step approach: first searching broad categories, then narrowing down to specific details. | Storing data in a strict tree structure based on file creation dates. | Replacing long documents with single-sentence summaries. | Elevating administrator queries above standard user queries. | Hierarchical retrieval uses a multi-step search, starting broad and then narrowing down, helping systems handle large amounts of data efficiently. |
| 44 | Unit 1: RAG and Optimization | Lec 2 | Optimizing Efficiency | How can caching optimize the performance of a RAG system? | Medium | 1 | C | It automatically retrains the LLM overnight. | It converts all sparse queries into dense ones. | It stores frequently accessed data so it doesn’t have to be retrieved repeatedly, speeding up responses. | It deletes old conversational history to save memory. | By caching frequently accessed info, a RAG system skips the retrieval process for common queries, greatly improving response efficiency. |
| 45 | Unit 1: RAG and Optimization | Lec 2 | Maintaining Context | How can conversation history be used to maintain context in multi-turn interactions? | Medium | 1 | B | By manually saving transcripts locally for users. | By passing previous dialogue turns as part of the LLM's input context or using it to refine new queries. | By preventing users from asking follow-up questions. | By completely re-indexing the database after every query. | RAG systems add prior turns to refine fetching info, and pass the conversation history into the generator's context so it remembers prior details. |
| 46 | Unit 1: RAG and Optimization | Lec 2 | Advanced Chunking | What is a disadvantage of fixed-length chunking? | Medium | 1 | D | It is the slowest parsing method available. | It relies heavily on natural language understanding APIs. | It requires documents to be pre-formatted perfectly. | Chunks may not align with logical breaks, potentially splitting important info or including irrelevant content. | While easy to implement, fixed chunks just slice data arbitrarily, potentially cutting sentences or ideas in half and losing crucial context. |
| 47 | Unit 1: RAG and Optimization | Lec 2 | Advanced Chunking | What is an advantage of sentence-based chunking? | Medium | 1 | A | It keeps complete sentences intact, which is great for detailed analysis. | It uses the lowest amount of metadata. | It perfectly summarizes entire paragraphs. | It guarantees chunks are perfectly equal data sizes. | By splitting by sentences, it preserves the basic grammatical and logical unit, which aids in highly granular detail-oriented retrieval. |
| 48 | Unit 1: RAG and Optimization | Lec 2 | Advanced Chunking | Why is semantic chunking harder to implement? | Hard | 1 | B | Because there are no libraries available for it yet. | It requires advanced text analysis to chunk based on meaning (sections/topics) rather than simple text markers. | It works exclusively with codebases and not natural text. | It requires manual human review of every document chunk. | Grouping text by logical meaning instead of fixed characters or periods requires deeper ML tools and NLP analysis, making it harder to code. |
| 49 | Unit 1: RAG and Optimization | Lec 2 | Advanced Chunking | How does a sliding window chunking method operate? | Medium | 1 | C | It only indexes the first and last chunk of a document. | It dynamically resizes chunks based on user latency limits. | Chunks overlap by sliding over the text, ensuring important info isn't missed at boundaries. | It slides inactive chunks into cold storage databases. | Sliding window chunking means sequential chunks overlap somewhat. This avoids losing context right at the boundary between chunks. |
| 50 | Unit 1: RAG and Optimization | Lec 2 | Advanced Chunking | What is a potential issue with large chunks vs small chunks? | Medium | 1 | A | Large chunks dilute specific information, while small chunks lose long-range context across the text. | Smaller chunks increase hallucination by 100%. | Large chunks require completely different vector databases. | Smaller chunks are impossible to index effectively. | Small chunks risk losing broader dependencies, while large chunks can obscure specific details when encoded into a single dense vector. |
| 51 | Unit 1: RAG and Optimization | Lec 2 | Late Chunking | What fundamental difference separates late chunking from traditional methods? | Hard | 1 | B | Late chunking forces the language model to write chunks. | It applies the embedding model's transformer layer to the full text before pooling the chunks. | It waits 24 hours before indexing fetched chunks. | It completely ignores sentence boundaries across all chunks. | Traditional chunking cuts text, then embeds. Late chunking embeds the entire document first to absorb context, then pools tokens into chunks. |
| 52 | Unit 1: RAG and Optimization | Lec 2 | Late Chunking | How does late chunking solve the "loss of long-distance dependencies" problem? | Hard | 1 | C | By merging all queries into one giant prompt. | By running queries twice for good measure. | Chunk embeddings are generated conditionally based on the full document context analyzed by the transformer. | By sending the text to an API for grammar checking. | Because the entire text is run through the transformer first, each token embedding inherently "knows" about the rest of the document's context. |
| 53 | Unit 1: RAG and Optimization | Lec 2 | Contextualization | What role does contextualization play in RAG? | Medium | 1 | A | Making sure retrieved info is strictly aligned and highly relevant to the query to produce better answers. | Expanding the user's prompt organically. | Encrypting API keys for database security. | Identifying the geography of the user asking the question. | Contextualization means validating and aligning retrieved data tightly with the query so answers fit the user's explicit needs. |
| 54 | Unit 1: RAG and Optimization | Lec 2 | Addressing Biases | How can potential biases in retrieved information be addressed? | Hard | 1 | D | By shutting off the retriever and using only the LLM's core weights. | By making sure chunks are exactly 500 words long. | By increasing the temperature setting on the LLM to maximum. | By filtering knowledge bases for objective content or employing a specific agent to check for biases in text. | You must actively curate/filter the database for objectivity, and potentially utilize a dedicated LLM agent task to check output neutrality. |
| 55 | Unit 1: RAG and Optimization | Lec 2 | Dynamic Knowledge Bases | What is a major challenge in handling a dynamic/evolving knowledge base? | Medium | 1 | B | Vectors eventually degrade and lose data. | Keeping indexed data constantly up-to-date and using version control to manage changing info. | The generator model forgets how to process text over time. | It is impossible to cache evolving knowledge. | If knowledge changes often, the indexes must be updated rapidly (without constant heavy retraining), requiring robust ingestion/versioning workflows. |
| 56 | Unit 1: RAG and Optimization | Lec 2 | CAG vs RAG | What does CAG stand for? | Easy | 1 | A | Cache-Augmented Generation | Computed Array Graph | Contextually Altered Grammar | Consolidated Active Generator | CAG stands for Cache-Augmented Generation, an evolution where documents are summarized/compressed before generating text. |
| 57 | Unit 1: RAG and Optimization | Lec 2 | CAG vs RAG | When is CAG preferred over traditional RAG? | Hard | 1 | C | When handling live, real-time Twitter feeds. | When working entirely without internet access on untrusted devices. | For static datasets where data can be pre-compressed, and when token efficiency is critical. | When accuracy doesn't matter, but speed is paramount. | CAG is ideal for stable text (papers, catalogs) that can be summarized/cached beforehand, which saves costly context window tokens during live queries. |
| 58 | Unit 1: RAG and Optimization | Lec 2 | Advanced Systems | What makes Adaptive RAG unique? | Hard | 1 | D | It exclusively uses SQL instead of vector stores. | It generates its own training data while idling. | It deletes unused documents automatically to save space. | It adjusts its approach in real-time, deciding between no retrieval, single-shot, or iterative RAG based on the query. | Adaptive RAG is dynamic; it analyzes the query complexity and selectively applies the right level of retrieval (or skips it if not needed). |
| 59 | Unit 1: RAG and Optimization | Lec 2 | Advanced Systems | How does Agentic RAG operate? | Hard | 1 | B | It hires human experts via crowd-sourcing APIs. | It uses retrieval agents that let the LM decide autonomously if and when it needs to pull external info. | It generates multiple answers and makes them argue. | It parses the codebase to fix system bugs automatically. | Agentic RAG gives the language model tools to autonomously act as a 'decision-maker' on whether to consult the database or search the web. |
| 60 | Unit 1: RAG and Optimization | Lec 2 | Data Privacy | What is a "zero-trust" approach to data ingestion in a RAG system? | Hard | 1 | A | Redacting/anonymizing personally identifiable info (PII) before it even enters the database. | Never storing any embeddings. | Using biometric scans to log users in. | Disconnecting the server from all networks. | A zero-trust approach involves sanitizing and removing sensitive PII immediately during ingestion, so no confidential data even exists in the retrieved context. |