mem0/embedchain/notebooks/gpt4all.ipynb

Cookbook for using GPT4All with Embedchain

Step-1: Install embedchain package

In [ ]:

!pip install embedchain[opensource]

Step-2: Set GPT4ALL related environment variables

GPT4All is free for all and doesn't require any API Key to use it. So you can use it for free!

In [ ]:

from embedchain import App

Step-3 Create embedchain app and define your config

In [ ]:

app = App.from_config(config={
    "llm": {
        "provider": "gpt4all",
        "config": {
            "model": "orca-mini-3b-gguf2-q4_0.gguf",
            "temperature": 0.5,
            "max_tokens": 1000,
            "top_p": 1,
            "stream": False
        }
    },
    "embedder": {
        "provider": "gpt4all",
        "config": {
            "model": "all-MiniLM-L6-v2"
        }
    }
})

Step-4: Add data sources to your app

In [ ]:

app.add("https://www.forbes.com/profile/elon-musk")

Step-5: All set. Now start asking questions related to your data

In [ ]:

while(True):
    question = input("Enter question: ")
    if question in ['q', 'exit', 'quit']:
        break
    answer = app.query(question)
    print(answer)