Everything Phoenix
LLM Tidbits
Old Skool ML
Arize Company Trivia
San Francisco/Bay Area
100

What is the pip package name to install Arize Phoenix (exact string)?

what is "arize-phoenix"?

100

Why might good engineers criticize LangChain? Give 2 reasons

What are bad abstraction, spaghetti code, inefficient performance, hard to debug and lack of scalability

100

This type of machine learning model is used to predict a categorical outcome, such as spam or not spam.

What is a classification model?

100

What year was Arize founded?

2020

100

This iconic bridge, painted in International Orange, connects San Francisco to Marin County.

What is the Golden Gate Bridge?

200

Arize Phoenix allows programmatic access via these 2 technologies?

REST & GraphQL

200

In the context of LLM Retrieval-Augmented Generation (RAG), these three mathematical measures are commonly used to compare the similarity between high-dimensional vectors.

What are cosine similarity, Euclidean distance, and dot product?



200

This regression technique aims to minimize the sum of the squares of the differences between observed and predicted values.

What is ordinary least squares (OLS) regression?

200

Who was on the original founding team (not including Aparna)?

Who is Jason, Gabe, Michael, Mike Downs?

200

This San Francisco island was once a notorious federal penitentiary and is now a popular tourist destination.

What is Alcatraz Island?

300

Name 5 Autoinstrumenters in Arize Phoenix

What are 

  • LlamaIndex

  • LangChain

  • OpenAI

  • MistralAI

  • DSPy

  • Bedrock

  • AutoGen

300

Name 4 companies that provide non open-sourced LLM model

OpenAi, Anthropic, Cohere, Google, etc..

300

This classification algorithm constructs a series of decision rules from the data, often visualized as a tree structure.

What is a decision tree?

300

What was the name of the two companies the Founders came from?

What is TubeMogul & Uber?

300

This San Francisco neighborhood is known for its colorful Victorian houses called the "Painted Ladies."

What is Alamo Square?

400

What are the two persistent stores in dockerized Phoenix?

what is SQL Lite, and PostGres SQL?

400

Name 2 specific LLM open source models (not companies)?

internet check

400

In ranking models what does NDCG stand for?

what is Normalized Discounted Cumulative Gain (NDCG)

400

What is the name of another observability company is Arize Ai modeled after?

DataDog

400

This San Francisco district was the epicenter of the 1967 Summer of Love, known for its counterculture movement (hippie movement).

What is Haight-Ashbury?

500

Arize AI built Open Inference, which is compatible with OpenTelemetry. For LLM-based trace data, these standardized guidelines (specs) ensure consistent and meaningful trace information.

What are semantic conventions?

500

This component of OpenTelemetry is responsible for transforming and sending telemetry data to various backends, while this other component collects, processes, and exports telemetry data from multiple sources.

What are the exporter and the collector?

500

Name 2 performance metrics that only requires prediction score and an actual label

AUC, LogLoss

500

What are 5 technologies that are utilized in the Arize deployment infrastructure?

What are Gazzette, Spark, Apache Druid, PostGres, GraphQL, Kubernetes, etc..

500

This San Francisco landmark, completed in 1972, was the tallest building in the city until 2018.

What is the Transamerica Pyramid?