Agentic topics

satya - 7/24/2024, 12:04:31 PM

Langchain on agentic planning

Langchain on agentic planning

satya - 7/24/2024, 12:59:47 PM

Different names

  1. function calling
  2. agents
  3. planning
  4. Take a number of actions in sequence
  5. Agent takes more and more actions, the results of those actions are fed back to the LLM

satya - 7/24/2024, 2:32:48 PM

General observation

  1. Planning and reasoning is still not at the level it?s needed to be for real-world tasks.

satya - 7/24/2024, 2:40:44 PM

Issues

  1. prompt being passed into the LLM simply does not contain enough information for the LLM to make a reasonable decision
  2. Lack of visibility to see intermediate data easily to evaluate what is not working
  3. Test data sets that can be evaluated to understand the calculated flows because the underlying mechanism is brittle
  4. randomness and unpredictability.

satya - 7/24/2024, 2:41:29 PM

LangGraph a link

LangGraph a link

satya - 7/24/2024, 2:51:09 PM

Cognitive Architecture

  1. It is a term that is used to "describe" the "body" or "brain" of your "genai" application.
  2. Particularly used in agentic systems as there is "reasoning" by LLM using a number of strategies including Prompt directing the LLM decisions to call which step next.
  3. It is a way stemming from the desire to classify what kind of logic your have in your genai app and give it a name.

satya - 7/24/2024, 2:51:46 PM

Examples

  1. Straight forward question answer
  2. basic RAG (no agentic)
  3. Manual flows to control multiple calls to LLMs
  4. Agentic RAG where "the routing logic is in the prompt" with multiple calls to the LLM and the APIs
  5. Long term planning with goals

satya - 7/24/2024, 3:11:36 PM

Few Advanced Cognitive architectures

  1. Plan and Solve
  2. Reflexion architecture
  3. Or in combination with Domain specific "controlled" flows/architectures

satya - 7/24/2024, 3:12:15 PM

Plan and Solve Prompting

Plan and Solve Prompting

satya - 7/24/2024, 3:14:19 PM

Agentic Reflexion

Agentic Reflexion

satya - 7/24/2024, 3:19:38 PM

GenAI Agentic tool

ReACT:Search On Web

SayCan:Search On Web

ToolFormer:Search On Web

HuggingGPT:Search On Web

generative Agents:Search On Web

WebGPT:Search On Web

satya - 7/24/2024, 3:26:13 PM

Domain specific cognitive architecture: A manual (graph) flow in other words

  1. And rather than tell the LLM to do in the prompt
  2. - where it may ignore it, not understand it, not have all the details -
  3. they told the system to do it
  4. by constructing a domain specific cognitive architecture.

satya - 7/24/2024, 10:00:10 PM

Understand the ReACT approach

Understand the ReACT approach

satya - 7/24/2024, 10:01:14 PM

Essentials

  1. Takes LangChain as an example
  2. Explains: Reason + Act
  3. Introduces "Thought, Action, Observation"
  4. A good article