Commit graph

1640 commits

Author SHA1 Message Date
vishnukvmd 739ef4c21e Refactor code 2023-11-14 13:41:32 +05:30
vishnukvmd ea76fd2ce8 Warm up the text encoder 2023-11-14 13:34:28 +05:30
vishnukvmd b54f082cb6 Move from SQLite to ObjectBox for storing embeddings 2023-11-14 13:26:54 +05:30
vishnukvmd b9cd9cf9cd Fix bug when 0 embeddings are returned 2023-11-14 12:12:58 +05:30
vishnukvmd 289fbc8a11 Move entire score computation to an isolate 2023-11-14 10:14:54 +05:30
vishnukvmd 3d0fefb715 Merge branch 'main' into clip 2023-11-14 09:35:41 +05:30
vishnukvmd 4278dcc102 Show option to contact support when verification fails 2023-11-11 19:13:09 +05:30
ashilkn 7b2810391c remove shuffling of results in some search secitons for better UI 2023-11-11 10:20:39 +05:30
ashilkn 70ca1f1eac add hero animation for location section 2023-11-10 17:30:17 +05:30
ashilkn b4b4080149 resolve conflicts and merge main 2023-11-07 18:24:07 +05:30
ashilkn e5180034ff add support for searching sharer to see all items of sharer 2023-11-07 17:55:32 +05:30
ashilkn 12051e8003 rename method 2023-11-07 17:41:16 +05:30
ashilkn b39efa03c8 minor change 2023-11-07 13:17:32 +05:30
ashilkn 7b53b906b2 fix: bug in moments search section when there aren't results for at least one moments 2023-11-07 13:15:35 +05:30
ashilkn 3f1778460f show a 'date' example in 'moments' search section 2023-11-07 12:33:45 +05:30
ashilkn 5cf9c30b5f bug fix + handle possible errors with try catch 2023-11-07 10:31:43 +05:30
vishnukvmd 4d095208f6 Load embeddings in a batch 2023-11-06 19:00:08 +05:30
Neeraj Gupta 37192e0396 Add optional field for referral source 2023-11-06 17:33:33 +05:30
ashilkn 7021dfea73 bug fix + optimise code + use better variables 2023-11-06 16:53:35 +05:30
ashilkn 7c912c2d02 Fix bug in description section results 2023-11-06 16:40:52 +05:30
ashilkn dc595edc50 added more smartness on deciding which sub descriptions of all descriptions to show 2023-11-06 10:30:44 +05:30
ashilkn 522468580c Resolve conflicts and merge main 2023-11-03 14:34:56 +05:30
vishnukvmd 71234dfa7e Cache local embeddings 2023-10-28 17:47:17 +05:30
vishnukvmd e971bf6bc5 Ensure that each entry within an embedding is cast to double 2023-10-28 17:37:24 +05:30
vishnukvmd fb07b954a5 Simplify how low quality results are filtered out 2023-10-28 16:25:06 +05:30
vishnukvmd e6c5bf0bbe Update method name 2023-10-28 16:23:48 +05:30
vishnukvmd 1a01fbd5d9 Index the latest item first 2023-10-28 16:15:42 +05:30
vishnukvmd 4c593e097a Clear the queue when indexing is disabled 2023-10-28 16:15:10 +05:30
vishnukvmd 89e7606d7a Update score threshold 2023-10-27 13:04:31 +05:30
vishnukvmd c0b1667962 Return empty results if magic search hasn't been enabled 2023-10-27 13:04:31 +05:30
vishnukvmd b7e434c5ec Disable semantic search on iOS 2023-10-27 13:04:31 +05:30
vishnukvmd 2827bf238a Ignore if embedding lengths don't match 2023-10-27 13:04:31 +05:30
vishnukvmd e36ec7cc94 Use ChaCha to encrypt embeddings 2023-10-27 13:04:31 +05:30
vishnukvmd 54a78555d8 Deal with JSONified strings instead of FloatArray buffers 2023-10-27 13:04:31 +05:30
vishnukvmd 6acb2951b9 Remove batching 2023-10-27 13:04:31 +05:30
vishnukvmd 5b86080910 Minor refactor 2023-10-27 13:04:30 +05:30
vishnukvmd d25938aeac Pull model from remote 2023-10-27 13:04:30 +05:30
vishnukvmd 3dda5af52a Fix issue with the ordering of fetched embeddings 2023-10-27 13:04:30 +05:30
vishnukvmd 6f251a80a2 Load models in a separate isolate 2023-10-27 13:04:30 +05:30
vishnukvmd 638ff0547e Update dependency on clip_ggml 2023-10-27 13:04:30 +05:30
vishnukvmd 720ac428db Fix attribute name for remote embeddings 2023-10-27 13:04:30 +05:30
vishnukvmd ce1d6c0805 Ignore items not owned by the user 2023-10-27 13:04:30 +05:30
vishnukvmd 53fa9c6830 Load models separately 2023-10-27 13:04:29 +05:30
vishnukvmd a2f66f1e4e Switch to using uploaded IDs 2023-10-27 13:04:29 +05:30
vishnukvmd 4ea80d391b Display index status within the UI 2023-10-27 13:04:29 +05:30
vishnukvmd 804178e03d Fire an event once a files are indexed 2023-10-27 13:04:29 +05:30
vishnukvmd eb0bd4516b Minor fixes 2023-10-27 13:04:29 +05:30
vishnukvmd baee39438d Push pending embeddings to remote on app start 2023-10-27 13:04:29 +05:30
vishnukvmd 9163cbf26d Compute embedding whenever a file is uploaded 2023-10-27 13:04:28 +05:30
vishnukvmd 5ee2ab14f2 Use a queue to backfill 2023-10-27 13:04:28 +05:30
vishnukvmd f112fdd06e Minor refactor 2023-10-27 13:04:28 +05:30
vishnukvmd 4dcd9a8f68 Minor refactor 2023-10-27 13:04:28 +05:30
vishnukvmd 3411d250a7 Push computed embeddings upstream 2023-10-27 13:04:28 +05:30
vishnukvmd 57df32762a Persist the last sync time 2023-10-27 13:04:28 +05:30
vishnukvmd fea2057c85 Add API to push embeddings to remote 2023-10-27 13:04:28 +05:30
vishnukvmd 4ecf4bcf87 Remove direct dependency on Sodium to make reviews easier 2023-10-27 13:04:28 +05:30
vishnukvmd 01b155a172 Persist fetched embeddings 2023-10-27 13:04:28 +05:30
vishnukvmd c21867cdc6 Fetch embeddings until server has no more 2023-10-27 13:04:28 +05:30
vishnukvmd dedbca36f5 Fetch embeddings from server 2023-10-27 13:04:28 +05:30
vishnukvmd 32a5adb6d8 Pull embeddings once diff sync is done 2023-10-27 13:04:28 +05:30
vishnukvmd eb4daf331a Publish event when remote diff has been synced 2023-10-27 13:04:28 +05:30
vishnukvmd 58ff6aeaaf Compute time more accurately 2023-10-27 13:04:27 +05:30
vishnukvmd 55fc094324 Update SSS 2023-10-27 13:04:27 +05:30
vishnukvmd dc6d3e2111 Integrate batch inference API 2023-10-27 13:04:27 +05:30
vishnukvmd 71f372256e Update SSS 2023-10-27 13:04:26 +05:30
vishnukvmd 884e3eb30b Hook semantic search to UI 2023-10-27 13:04:26 +05:30
vishnukvmd 54881e0309 Implement search 2023-10-27 13:04:26 +05:30
vishnukvmd 17fd2c8b14 Compute embeddings for unindexed files 2023-10-27 13:04:26 +05:30
vishnukvmd a5e2fff272 Fetch and cache embeddings 2023-10-27 13:04:25 +05:30
vishnukvmd 5b5fba8ecf Minor refactor 2023-10-27 13:04:25 +05:30
vishnukvmd 61c4d69dbe Run inference on a separate isolate 2023-10-27 13:04:25 +05:30
vishnukvmd 94ab10315b Integrate static APIs 2023-10-27 13:04:25 +05:30
vishnukvmd 2dde47b576 Update method to fetch embedding 2023-10-27 13:04:25 +05:30
vishnukvmd 10ab2c53b0 Setup semantic search service 2023-10-27 13:04:25 +05:30
Neeraj Gupta c513957056 Format
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-10-27 09:21:04 +05:30
Neeraj Gupta 9b87b6c835 Fix: Avoid pushing duplicate HomeWidget during login
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-10-27 09:20:26 +05:30
ashilkn 19cf283b87 fix bug in fileTypes and Extension search section's limit on results to be shown 2023-10-17 06:32:51 +05:30
ashilkn a33eff40a8 fix bug in description search section result 2023-10-16 16:40:00 +05:30
ashilkn 40cc0ed70f Show people search section examples (people as in people who have shared items) 2023-10-16 16:37:36 +05:30
ashilkn f7b32ec9bb fix incorrect use of limit in fileDescriptionSearch used in search section 2023-10-14 17:25:31 +05:30
ashilkn 0d378b838a do case insensitive matching of descriptions in search section 2023-10-14 16:57:17 +05:30
ashilkn cef2d08917 fix: use set instead of list to avoid showing duplicate files in fileType search section results 2023-10-14 16:39:18 +05:30
ashilkn 821159d57e fix incorrect use of limit in getAllFileTypesAndExtensionsResults() 2023-10-13 17:18:45 +05:30
ashilkn 933aa24e33 Show a random holiday in moments search example section 2023-10-13 13:04:16 +05:30
ashilkn 0ee892d7ce Show random month + random year in moments search example section 2023-10-13 12:53:31 +05:30
ashilkn 13ec5ab8c3 Show first random month that has items in 'moments' search example section 2023-10-13 12:25:45 +05:30
ashilkn 8945d33b5b Reorder 2023-10-12 18:44:48 +05:30
ashilkn d2958b3bec Remove descriptions that end with a connect word 2023-10-12 18:15:18 +05:30
ashilkn bc64668390 Add comment 2023-10-12 18:02:06 +05:30
ashilkn 93dd535226 Remove descriptions that have connect words as all of it's words 2023-10-12 17:59:20 +05:30
ashilkn 9d31007fc7 add functionality to limit the number of search results returned from description search. Randomized the results from a decent pool of results too 2023-10-12 16:06:43 +05:30
ashilkn 97dd621d67 fix bug in getAllFileTypesAndExtensionsResults 2023-10-12 15:32:17 +05:30
ashilkn cde9d0aacc Show photo description search results in search section. Get all possible substrings from all descriptions and search 2023-10-12 13:46:37 +05:30
ashilkn 8b201b3455 fix: exclude files that do not have an extension from coming up in the File types and extensions search section 2023-10-10 11:09:46 +05:30
ashilkn 2ac00481ef fix: return all results when limit is null in getAllFileTypesAndExtensionsResults 2023-10-10 10:34:25 +05:30
ashilkn 45a4a8cc51 Show fileTypes and extensions examples in search section 2023-10-09 19:52:37 +05:30
ashilkn b42d845ce3 Show album examples in search section + refactor 2023-10-09 12:42:51 +05:30
ashilkn 84554929d2 Create new method in search service to get all location tags 2023-10-06 18:01:36 +05:30
ashilkn 7529a8ee22 Merge branch 'main' into search_screens 2023-10-06 12:58:17 +05:30
ashilkn 044e82b96f Indentation changes 2023-10-04 09:48:27 +05:30