when trying to load 10 pdfs with my_knowledge_qna.py, it took more than 1hr 35 mins to create vector database which is too long. Sometimes even my system is getting slow and hanging up. What are the hardware requirements for achieving localchatgpt with many docs.
My system configuration is.
Operating system: Windows 11
Ram: 8GB
Disk: SSD

Hi there

I followed exact instructions from here:
https://artificialcorner.com/gpt4all-is-the-local-chatgpt-for-your-documents-and-it-is-free-df1016bc335

Ran all tests fine.

I uploaded only 1 document in docs folder. This document is my leasing document for the apartment I am renting. The document has clear information on end date OR lease term or duration.

After all hard work, when I asked the question, what is the end date? whats the term of the lease, the GPT4ALL cannot answer it.

Any help app....

I encountered this from 'pip install -r requirements'.

ERROR: Cannot install -r requirements.txt (line 41) and SQLAlchemy==2.0.12 because these package versions have conflicting dependencies.

The conflict is caused by:
The user requested SQLAlchemy==2.0.12
langchain 0.0.142 depends on SQLAlchemy<2 and >=1

Any idea on how to resolve the conflict between langchain 0.0.142 and SQLAlchemy 2.0.12 ?

Keep on getting this error
llama.cpp: loading model from ./models/ggml-model-q4_0.bin
error loading model: unexpectedly reached end of file
llama_init_from_file: failed to load model

Downloaded the model several times in case it was corrupted. Same result. Environment is Ubuntu in WSL2 (files downloaded in Windows and then copied into WSL environment).

I follow you instruction.
I got what i want, thank you somuch.
But if i have a lot of pdf pages.I think i should have to use GPU.How?

On a AMD x86, windows machine, using VS code, llama-cpp-python fails to install, regardless of methods of installation (pip, pip with parameters no-cached, etc...):
[1/4] Building C object vendor\llama.cpp\CMakeFiles\ggml.dir\ggml.c.obj
FAILED: vendor/llama.cpp/CMakeFiles/ggml.dir/ggml.c.obj
C:\PROGRA2\MICROS1\2017\BUILDT1\VC\Tools\MSVC\14161.270\bin\Hostx86\x64\cl.exe /nologo -D_CRT_SECURE_NO_WARNINGS -IC:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp. /DWIN32 /D_WINDOWS /O2 /Ob2 /DNDEBUG -MD /arch:AVX2 /showIncludes /Fovendor\llama.cpp\CMakeFiles\ggml.dir\ggml.c.obj /Fdvendor\llama.cpp\CMakeFiles\ggml.dir\ /FS -c C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(912): error C2146: syntax error: missing ')' before identifier 'x'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(912): error C2061: syntax error: identifier 'x'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(912): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(912): error C2059: syntax error: ','
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(912): error C2059: syntax error: ')'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(913): error C2146: syntax error: missing ')' before identifier 'x'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(913): error C2061: syntax error: identifier 'x'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(913): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(913): error C2059: syntax error: ','
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(913): error C2059: syntax error: ')'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(914): error C2146: syntax error: missing ')' before identifier 's'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(914): error C2061: syntax error: identifier 's'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(914): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(914): error C2059: syntax error: ','
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(914): error C2059: syntax error: ')'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(917): error C2061: syntax error: identifier 'dequantize_row_q_t'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(918): error C2061: syntax error: identifier 'quantize_row_q'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(918): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(919): error C2061: syntax error: identifier 'quantize_row_q_reference'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(919): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(920): error C2061: syntax error: identifier 'quantize_row_q_dot'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(920): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(921): error C2061: syntax error: identifier 'vec_dot_q'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(921): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(923): error C2059: syntax error: '}'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(925): error C2061: syntax error: identifier 'ggml_internal_get_quantize_fn'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(925): error C2059: syntax error: ';'
c:\users\marti\appdata\local\temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.h(925): error C2059: syntax error: ''
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(776): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(776): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(776): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(776): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(776): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(816): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(816): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(816): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(816): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(816): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1120): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1120): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1120): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1120): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1120): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1161): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1161): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1161): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1161): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1161): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1285): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1285): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1285): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1285): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1285): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1323): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1323): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1323): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1323): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1323): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1331): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1331): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1331): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1331): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1331): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1372): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1372): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1372): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1372): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1372): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1380): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1380): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1380): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1380): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1380): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1420): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1420): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1420): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1420): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1420): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1429): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1429): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1429): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1429): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1429): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1454): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1454): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1454): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1454): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1454): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1463): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1463): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1463): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1463): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1463): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1499): error C2146: syntax error: missing ')' before identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1499): error C2061: syntax error: identifier 'x'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1499): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1499): error C2059: syntax error: ','
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1499): error C2059: syntax error: ')'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1661): error C2146: syntax error: missing ')' before identifier 'vx'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1661): error C2061: syntax error: identifier 'vx'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1661): error C2059: syntax error: ';'
C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\vendor\llama.cpp\ggml.c(1661): fatal error C1003: error count exceeds 100; stopping compilation
[2/4] Building CXX object vendor\llama.cpp\CMakeFiles\llama.dir\llama.cpp.obj
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "C:\Users\marti\AppData\Local\Temp\pip-build-env-7ukk7cu2\overlay\Lib\site-packages\skbuild\setuptools_wrap.py", line 674, in setup
cmkr.make(make_args, install_target=cmake_install_target, env=env)
File "C:\Users\marti\AppData\Local\Temp\pip-build-env-7ukk7cu2\overlay\Lib\site-packages\skbuild\cmaker.py", line 697, in make
self.make_impl(clargs=clargs, config=config, source_dir=source_dir, install_target=install_target, env=env)
File "C:\Users\marti\AppData\Local\Temp\pip-build-env-7ukk7cu2\overlay\Lib\site-packages\skbuild\cmaker.py", line 742, in make_impl
raise SKBuildError(msg)

  An error occurred while building with CMake.
    Command:
      'C:\Users\marti\AppData\Local\Temp\pip-build-env-7ukk7cu2\overlay\Lib\site-packages\cmake\data\bin/cmake.exe' --build . --target install --config Release --
    Install target:
      install
    Source directory:
      C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c
    Working directory:
      C:\Users\marti\AppData\Local\Temp\pip-install-sgkbueos\llama-cpp-python_e84ae100af75437f9f96d19468274b7c\_skbuild\win-amd64-3.11\cmake-build
  Please check the install target is valid and see CMake's output for more information.

  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for llama-cpp-python
Building wheel for nomic (pyproject.toml) ... done
Created wheel for nomic: filename=nomic-1.1.6-py3-none-any.whl size=31776 sha256=9bc6be3b0223a2da961e4e6d9925c1b18609c6ce0a46492b97f24f81018ae523
Stored in directory: c:\users\marti\appdata\local\pip\cache\wheels\1e\2f\1f\3cb6a5f01429493fa6b86e9cc00e70685fdc1bc623d0e214cc
Successfully built nomic
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects

Hi,

I get a an error saying that there's an unexpected end to the ggml q4_0.bin file.

(.venv) ➜ GPT4all-mh python my_knowledge_qna.py

llama.cpp: loading model from ./models/ggml-model-q4_0.bin
libc++abi: terminating due to uncaught exception of type std::runtime_error: unexpectedly reached end of file
[1] 99899 abort python my_knowledge_qna.py
(.venv) ➜ GPT4all-mh

Used the link in you medium post. After some reading up, could this have anything too do with a breaking update in ggerganov/llama.cpp#1508 ?

Getting a core dump while loading my_knowledge_qna.py

python my_knowledge_qna.py

llama.cpp: loading model from ./models/ggml-model-q4_0.bin
Aborted (core dumped)

Running on a virtual machine with 49437012 kB of memory and 16vCPUs

Hi,

I got the following error when loading the converted model from https://huggingface.co/mrgaang/aira/blob/main/gpt4all-converted.bin in your first test file (on windows):

Traceback (most recent call last):
File "pygtl4all_test.py", line 9, in
model = GPT4All(path)
File "gpt4all.py", line 64, in init
super(GPT4All, self).init(model_path=model_path,
TypeError: Model.init() got an unexpected keyword argument 'n_parts'
Exception ignored in: <function Model.del at 0x0000027ECA587490>
Traceback (most recent call last):
File ".conda\envs\GPT4ALL\lib\site-packages\pyllamacpp\model.py", line 402, in del
if self._ctx:
AttributeError: 'GPT4All' object has no attribute '_ctx'

I tried to provide the absolute (windows) path as suggested in oobabooga/text-generation-webui#1615 but with the same error.

Any suggestions?

Cheers, RB

While executing db_loading.py code , I am passing a prompt as input (question), instead of fetching the answer to the prompt I have got "UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe2 in position 0: unexpected end of data". I have already tried to manually change the encoding of file to utf-8 and I have also tried text =text.decode(). But both of them are not working. Please help to solve the problem.

Hello All

I have question

Is it possible to train my model exclusively on new data and have it disregard the previously trained data?
Despite following the suggested approach of training the model on fresh data, it continues to provide answers based on the old data it was trained on.

Thanks

I've gone as far as running "python3 pygpt4all_test.py" on terminal but it returns zsh: illegal hardware instruction python3 pygpt4all_test.py. What should I do please help. Thank you