chore: add instruction to sift dataset (#1860)

lancedb · Jan 23, 2024 · 8d8472b · 8d8472b
1 parent 4af4a1d
commit 8d8472b
Show file tree

Hide file tree

Showing 2 changed files with 17 additions and 0 deletions.
diff --git a/benchmarks/sift/README.md b/benchmarks/sift/README.md
@@ -24,12 +24,26 @@ tar -xzf sift.tar.gz
 
 Generate Lance datasets using the `datagen.py` script:
 
+Prepare a python virtual environment first.
+
+```
+python3 -m venv venv
+. ./venv/bin/activate
+pip install -r requirements.txt
+```
+
 #### Database vectors
 
 ```sh
 ./datagen.py ./sift/sift_base.fvecs ./.lancedb/sift1m.lance -d 128
 ```
 
+#### Generate Ground Truth
+
+```sh
+./gt.py ./.lancedb/sift1m.lance -o ./.lancedb/ground_truth.lance
+```
+
 #### Query vectors
 
 ```sh

diff --git a/benchmarks/sift/requirements.txt b/benchmarks/sift/requirements.txt
@@ -0,0 +1,3 @@
+torch
+tdqm
+pylance