Commit efd85074 authored by Lars Dalby's avatar Lars Dalby
Browse files

Update HTTP EXIF benchmark with Ubuntu desktop data (500k images)

parent 603aa37b
Loading
Loading
Loading
Loading
+1 −1
Original line number Diff line number Diff line
@@ -35,7 +35,7 @@ The three entry-point scripts cover different trade-offs between speed, disk usa

### HTTP EXIF (`read_exif_http.R`)

- Benchmarked against `onestop/2025/romania`: 7 folders, 12,835 images processed in ~6 minutes (~2,100 images/min)
- Benchmarked at ~2,000–2,900 images/min depending on folder size (MBP: 12,835 images in ~6 min; Ubuntu desktop: 500k images in ~183 min)
- Fetches only the first 128 KB per image via HTTP Range requests (enough for EXIF headers); no full file downloads
- 100-URL batches via `curl::multi_download()`, each batch downloads + reads EXIF + deletes temp files
- Very low failure rate (<0.01% of downloads) under normal conditions