General AI
The ability of a computer or other machine to perform activities that are normally thought to require intelligence.
What is artificial intelligence?
The correct output or target variable for a given observation in a dataset that is used to train the model.
What is a label?
A technique used to group data points that have similar characteristics without using labeled data.
What is clustering?
A type of GenAI model that can create a picture from a character-based description.
What is text-to-image?
A type of intelligent agent that is distinguished by its ability to operate autonomously in a complex environment.
What is an AI agent?
The agent, the environment, the reward signal, and the policy.
What are the components of a RL system?
The type of machine learning that can play games such as Chess and Go.
What is reinforcement learning?
A branch of artificial intelligence concerned with the development and study of statistical algorithms that can learn from data and generalize to unseen data, and thus perform tasks without explicit instructions.
What is machine learning?
A variable that represents a distinct category or group rather than a numerical value.
What is a categorical variable?
An unsupervised machine learning algorithm that groups similar data points into clusters based on their proximity to a central point, called a centroid.
What is k-means?
A message or command that is input to a GenAI tool to ask it a question or tell it what to do.
What is a prompt?
An open, standard, open-source framework introduced by Anthropic in November 2024 to standardize the way artificial intelligence systems like large language models integrate and share data with external tools, systems, and data sources.
What is the The Model Context Protocol (MCP)?
A numerical value given to an agent after it takes an action in a specific state, indicating how good or bad that action was.
What is a reward?
What is a prompt?
The process of acquiring new knowledge, skills, behaviors, or attitudes through experience, study, or instruction.
What is learning?
An application of supervised learning in which the relationship between a dependent variable and one or more independent variables is analyzed. It is used to predict how changes in the independent variable(s) affect the dependent variable.
What is regression?
A technique used to reduce the dimensionality of a large dataset while retaining most of the original information. It transforms correlated variables into a smaller set of uncorrelated variables that capture the most variance in the data.
What is Principal Component Analysis (PCA)?
The smallest unit of data that a model can process. It can represent a character, word, or a larger chunk of text.
What is a token?
A software framework that helps facilitate the integration of large language models into applications.
What is LangChain?
Exploration refers to the act of seeking new opportunities or knowledge, often involving risk and uncertainty, while exploitation focuses on utilizing existing resources or strategies to maximize immediate benefits. These need to be balanced in a RL strategy.
What is exploration vs exploitation?
A machine learning technique that uses feedback from humans to train AI models, helping them learn to align their actions with human preferences.
What is reinforcement learning from human feedback (RLHF)?
Originally called the imitation game, this test, introduced in 1950, evaluates a machine's ability to exhibit intelligent behavior equivalent to that of a human.
What is the Turing Test?
A separate portion of data not used for training, but used to evaluate the model's performance.
What is the validation dataset?
A method that groups data points into a tree-like structure called a dendrogram, which shows how clusters merge or split based on their similarities
What is hierarchical clustering?
By analyzing the input text and using patterns it learned from a vast amount of training data. It calculates the probabilities of possible next words and selects the one that is most likely to follow.
How does a GenAI model predict the next word?
Memory, Reasoning Engine, Tool Use, Communication Layer, Environment Interface.
What are the primary components of an AI agent?
The set of all possible actions that an agent can take in a given environment. It defines the choices available to the agent as it interacts with the environment to maximize its rewards.
What is the action space?
Voice assistants, transcribing meetings, robotic surgery, self-driving cars, and chatbots.
What are some applications of AI?
The use of artificial intelligence technologies to enhance various aspects of the software development process, such as automating code generation, improving testing and debugging, optimizing project management, and streamlining DevOps workflows
What is AI for software engineering?
A phenomenon that occurs when a model learns the training data too well, including its noise and outliers, resulting in poor performance on new, unseen data.
A technique used in unsupervised learning, particularly in k-means clustering, to determine the optimal number of clusters (k) by plotting the within-cluster sum of squares (WCSS) against different k values
What is the elbow method?
A technique that prevents a model from accessing future tokens during text generation.
What is masking?
Designing, developing, testing, and maintaining software systems that utilize artificial intelligence to perform tasks autonomously.
What is software engineering for AI agents?
It requires a large number of interactions with the environment to learn effective policies, leading to high computational costs and time-intensive training. Additionally, RL can be unstable and may need extensive resources to achieve consistent performance, especially in complex environments.
Why is RL more costly than other types of ML?
A software tool that analyzes content to determine whether it was generated by artificial intelligence or written by a human.
What is AI detection?