Back to all templates

Fill vector database

Load a folder of documentation into a Pinecone vector database for RAG.

Description:

Lists all files in a local documentation directory recursively, then loops over each file, reads its contents, and loads it into a Pinecone vector database as a Markdown document, building a searchable knowledge base for retrieval-augmented generation.

Key Features:
  • Recursive filesystem listing of a documentation directory
  • Per-file loop over the discovered files
  • Pinecone vector ingestion of each file
  • Markdown document type handling
Prerequisites:
  • Local filesystem access to the documentation directory
  • A Pinecone connection and index
Ideal For:

Teams building a RAG knowledge base from a folder of Markdown documentation.

STEPS
  1. List all files in the documentation directory recursively.
  2. Loop over each file: read its contents and load it into the Pinecone vector database.
COMPONENTS
Filesystem
Pinecone
CATEGORYAI

How ByteChef works?

Focus on what matters,
automate the rest.

ByteChef