Data flow/interactions
- Data from documents, NoSQL databases, and transactional databases are pulled using Azure Data Factory and stored in an Azure Storage account.
- Any change to the Azure Storage triggers an event that runs an Azure Function App.
- The Azure Function App calls various processing APIs, such as translation and chunking, before calling the embedding model to convert it into a vector. These vectors are then stored in an Azure Redis Cache vector database.
- Semantic Kernel interacts with and runs queries on the Azure Redis Cache vector database and searches for content with semantic similarity. Semantic Kernel can also use Azure Redis Cache to store chat history for context and memory:
- Semantic Kernel also interacts with other plugins, such as Bing search, ChatGPT, or content filters.
- The chatbot user interface, which is hosted on Azure App Service, calls Semantic Kernel with queries that have been submitted by the user and returns the response.
- The...