PrivateGPT is a production-ready AI project that allows you to inquire about your documents using Large Language Models (LLMs) with offline support.

PrivateGPT uses Qdrant as the default vectorstore for ingesting and retrieving documents.


Qdrant settings can be configured by setting values to the qdrant property in the settings.yaml file. By default, Qdrant tries to connect to an instance at http://localhost:3000.


    url: ""
    api_key: "<your-api-key>"

The available configuration options are:

locationIf :memory: - use in-memory Qdrant instance.
If str - use it as a url parameter.
urlEither host or str of Optional[scheme], host, Optional[port], Optional[prefix].
Eg. http://localhost:6333
portPort of the REST API interface. Default: 6333
grpc_portPort of the gRPC interface. Default: 6334
prefer_grpcIf true - use gRPC interface whenever possible in custom methods.
httpsIf true - use HTTPS(SSL) protocol.
api_keyAPI key for authentication in Qdrant Cloud.
prefixIf set, add prefix to the REST URL path.
Example: service/v1 will result in http://localhost:6333/service/v1/{qdrant-endpoint} for REST API.
timeoutTimeout for REST and gRPC API requests.
Default: 5.0 seconds for REST and unlimited for gRPC
hostHost name of Qdrant service. If url and host are not set, defaults to ’localhost'.
pathPersistence path for QdrantLocal. Eg. local_data/private_gpt/qdrant
force_disable_check_same_threadForce disable check_same_thread for QdrantLocal sqlite connection.

Next steps

Find the PrivateGPT docs here.