Submitted by RingoCatKeeper t3_zypzrv in MachineLearning
learn-deeply t1_j28hirz wrote
Reply to comment by londons_explorer in [P]Run CLIP on your iPhone to Search Photos offline. by RingoCatKeeper
Is that calculation taking into account memory (RAM/SSD) access latencies?
londons_explorer t1_j28kvqp wrote
There is no latency constraint - it's a pure streaming operation, and total data to be transferred is 1 gigabyte for the whole set of vectors - which is well within the read performance of apples ssd's.
This is also the naive approach - there are probably smarter approaches by doing an approximate search with very low resolution vectors (eg. 3 bit depth), and then a 2nd pass of the high resolution vectors of only the most promising few thousand results.
Viewing a single comment thread. View all comments