Aparna Dhinakaran – Medium

Aparna Dhinakaran

Published in

Should I Use the Same Model for My Eval as My Agent?

Examining Self-Evaluation Bias of Major LLMs

Oct 8

Should I Use the Same Model for My Eval as My Agent?

Oct 8

Published in

LLM-as-a-Judge: When to Use Reasoning, CoT, and Explanations

A guide on what to use where — and why

Aug 20

LLM-as-a-Judge: When to Use Reasoning, CoT, and Explanations

Aug 20

Published in

What Is Prompt Learning?

Prompts, like models, should improve with feedback — not stay static.

Aug 1

What Is Prompt Learning?

Aug 1

Published in

Choosing Between LLM Agent Frameworks

The tradeoffs between building bespoke code-based agents and the major agent frameworks.

Sep 21, 2024

Choosing Between LLM Agent Frameworks

Sep 21, 2024

Published in

Navigating the New Types of LLM Agents and Architectures

The failure of ReAct agents gives way to a new generation of agents — and possibilities

Aug 30, 2024

Navigating the New Types of LLM Agents and Architectures

Aug 30, 2024

Published in

Evaluating SQL Generation with LLM as a Judge

Results point to a promising approach

Jul 31, 2024

Evaluating SQL Generation with LLM as a Judge

Jul 31, 2024

Published in

Large Language Model Performance in Time Series Analysis

How do major LLMs stack up at detecting anomalies or movements in the data when given a large set of time series data within the context…

May 1, 2024

Large Language Model Performance in Time Series Analysis

May 1, 2024

Published in

Tips for Getting the Generation Part Right in Retrieval Augmented Generation

Results from experiments to evaluate and compare GPT-4, Claude 2.1, and Claude 3.0 Opus

Apr 6, 2024

Tips for Getting the Generation Part Right in Retrieval Augmented Generation

Apr 6, 2024

Published in

Model Evaluations Versus Task Evaluations

Understanding the difference for LLM applications

Mar 26, 2024

Model Evaluations Versus Task Evaluations

Mar 26, 2024

Published in

Why You Should Not Use Numeric Evals For LLM As a Judge

Testing major LLMs on how well they conduct numeric evaluations

Mar 8, 2024

Why You Should Not Use Numeric Evals For LLM As a Judge

Mar 8, 2024

Aparna Dhinakaran

Aparna Dhinakaran

Co-Founder and CPO of Arize AI. Formerly Computer Vision PhD at Cornell, Uber Machine Learning, UC Berkeley AI Research.

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech