The Orchestrator Building Block
Orchestrator as the name suggests is the glue which connects all other building blockchain our System Architecture RExcellence pillar. It enables smooth data flow among the core pillars namely LLM, Prompt Engineering and the Embedding storage. It also helps put the supporting pillars like content moderation or Archival for compliance in place to make the AI product more scalable and robust. Before a user input in passed to the LLM, orchestrator can perform the following activities
- identify the intent of the user input and delegate to appropriate handler
- filter unwanted sensitive data as well as biased content
- generate embedding
- construct meaningful prompts
- invoke LLM/FM and capture the generated output
- provide traces of the request flow till...