Polish Massive Text Embedding Benchmark

💻 Installation

git clone https://github.com/rafalposwiata/pl-mteb
cd pl-mteb
pip install -r requirements.txt

🔨 Usage

python run_evaluation.py --model <MODEL>
or
python run_evaluation.py --models <PATH_TO_FILE_WITH_MODELS> # e.g. configs/models.txt

Example:
python run_evaluation.py --model sdadas/mmlw-roberta-large

📜 Citation

@article{poswiata2024plmteb,
    title={PL-MTEB: Polish Massive Text Embedding Benchmark},
    author={Rafał Poświata and Sławomir Dadas and Michał Perełkiewicz},
    journal={arXiv preprint arXiv:2405.10138},
    year={2024}
}