Blog Post

Microsoft Developer Community Blog
11 MIN READ

Building RAG on Phi-3 locally using embeddings on VS Code AI Toolkit

vinayakh's avatar
vinayakh
Icon for Microsoft rankMicrosoft
Sep 23, 2024
In the previous tutorial we created embeddings and added them to the opensource vector database ChromaDB. This is one of the prerequisites for creating any retrieval augmented generation (RAG) applic...
Updated Sep 19, 2024
Version 1.0
onnx
python
rag
retrieval augmented generation
vs code
peterwbizz's avatar
peterwbizz
Copper Contributor
Dec 31, 2024

Nice piece of work, however when I run this command: 
resp=chain.invoke("What is Fine tuning")
an error occurs: 
ConnectionError: [Errno 111] Connection Refused

should I have started a server on the 127.0.0.1 endpoint or what am I missing
environment : visual studio / ubuntu/ laptop  ( no GPU) 

  • vinayakh's avatar
    vinayakh
    Icon for Microsoft rankMicrosoft
    Jan 21, 2025

    Have you trid making the port Public and have the right port no?