Advanced RAG for a Complex Schema
Previously, we had developed a simple chatbot by creating an Information Tool
. This Information Tool
would dynamically generate a Cypher Query and fetch information from the Neo4j Database.
We are using a technique called Retrieval-Augmented Generation (RAG) to enhance responses by integrating data from Neo4j. The chatbot utilizes LangChain to manage language models and workflow orchestration.
We hit a roadblock in terms of cost and performance as our schema became more complex. In order to overcome this challenge, we've made significant changes to our approach. Now, we are using two tools instead of one Information Tool
to retrieve the data. We will discuss these changes in more detail in the below post.