Skip to main content

Optimum-intel

All functionality related to the optimum-intel and IPEX.

Installation​

Install using optimum-intel and ipex using:

pip install optimum[neural-compressor]
pip install intel_extension_for_pytorch

Please follow the installation instructions as specified below:

  • Install optimum-intel as shown here.
  • Install IPEX as shown here.

Embedding Models​

See a usage example. We also offer a full tutorial notebook "rag_with_quantized_embeddings.ipynb" for using the embedder in a RAG pipeline in the cookbook dir.

from langchain_community.embeddings import QuantizedBiEncoderEmbeddings

Help us out by providing feedback on this documentation page: