Commit graph

1748 commits

Author SHA1 Message Date
Neeraj Gupta 844fa75bcd Ignore files that are already marked for reupload 2023-12-06 09:20:28 +05:30
Neeraj Gupta 1d9d96faf1 Improve live photos change check 2023-12-06 09:14:33 +05:30
Neeraj Gupta f0d9b27397 Enhance logs 2023-12-06 08:53:34 +05:30
Neeraj Gupta eabcded25e Fix: Swallow InvalidFileError during upload session
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-12-06 08:46:01 +05:30
vishnukvmd 75704f0687 Update logger name 2023-12-05 22:37:56 +05:30
vishnukvmd 708b1c8d23 Refactor ML framework 2023-12-05 22:36:02 +05:30
vishnukvmd 05ba553ebc Define a dummy init method 2023-12-05 21:33:03 +05:30
vishnukvmd ac82f5b282 Create a generic EmbeddingService 2023-12-05 21:31:25 +05:30
vishnukvmd dc16c52ff6 Move score computation to app layer 2023-12-05 21:17:28 +05:30
vishnukvmd 54b553909f Merge branch 'main' into clip 2023-12-05 21:13:53 +05:30
ashilkn addac894e4 remove comment + fix lint error 2023-12-04 15:21:49 +05:30
Neeraj Gupta cd320d30dd
LocalFileUpdater: Process live photos (#1556)
* Import files that need to be checked for livePhoto upload

* Add logic to re-process live photos

* Update localFile check + bump version

Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>

---------

Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-12-04 10:25:17 +05:30
Neeraj Gupta f56191f70d
Warn for unawaited futures (#1559) 2023-12-02 17:12:52 +05:30
Neeraj Gupta fe2bcc0438
Fix only attempt to re-upload in owned collection (#1555) 2023-12-01 17:21:16 +05:30
Neeraj Gupta 1ec2b14df2 Make error field mandatory 2023-11-30 10:49:35 +05:30
Neeraj Gupta 7230d52dd2 ErrDialog: Surface network error & contact support 2023-11-30 10:37:38 +05:30
Neeraj Gupta 3cecdd201d Fix bug in local file update checker 2023-11-27 14:55:14 +05:30
Neeraj Gupta 4fba22f204 ChangePassword: Confirm before signing out from other devices 2023-11-26 16:18:15 +05:30
Neeraj Gupta 1abd0a3178
Handle loginKey and keyDerivation err during SRP based login (#1522) 2023-11-20 15:52:52 +05:30
ashilkn f25a4e59b4 fix: archived files which are not part of an archived album were coming up in moments 2023-11-20 14:27:01 +05:30
Neeraj Gupta f910da0964 Handle loginKey and keyDerivation err during SRP based login 2023-11-20 13:28:27 +05:30
vishnukvmd a0a5640e61 Add logs 2023-11-18 16:57:25 +05:30
vishnukvmd 1956a589d7 ping-pong 2023-11-17 17:26:02 +05:30
vishnukvmd 3949918440 Merge branch 'main' into clip 2023-11-17 16:41:39 +05:30
Vishnu Mohandas e99544e335
Update change log (#1511) 2023-11-17 16:38:54 +05:30
ashilkn b814fb0971 change people to contacts 2023-11-17 16:09:58 +05:30
vishnukvmd 6faa408204 Re-enable computation of image embedding 2023-11-17 15:44:16 +05:30
ashilkn 38ae3538e7 update change log version 2023-11-17 15:38:52 +05:30
vishnukvmd c683d37899 TODO: Localize these strings 2023-11-17 00:22:46 +05:30
vishnukvmd e1ebae3e9a Render the type as plural 2023-11-17 00:10:12 +05:30
vishnukvmd 31589c9470 Return human readable string for file types 2023-11-17 00:08:05 +05:30
vishnukvmd 824866a8ab Trim emails 2023-11-16 23:28:41 +05:30
vishnukvmd 6b7579da26 Merge branch 'main' into clip 2023-11-16 19:00:32 +05:30
ashilkn 7e15691c30 resolve conflicts and merge main 2023-11-16 13:41:39 +05:30
Neeraj Gupta bf08e938ff Allow folks with add_on to activate family 2023-11-15 20:14:48 +05:30
vishnukvmd f54d82be34 Perform no image embedding 2023-11-15 17:35:04 +05:30
ashilkn faede193b1 resolve conflicts and merge main 2023-11-15 15:48:31 +05:30
ashilkn b4a07d2b0d fix: hero animation not working between album's view all tile and collection screen 2023-11-15 13:57:03 +05:30
vishnukvmd cf3634f707 Ignore spurious requests to backfill 2023-11-15 10:50:48 +05:30
vishnukvmd 179dc0ce89 Minor refactor 2023-11-15 10:47:25 +05:30
vishnukvmd 4c2ec1da50 Wait until model is loaded 2023-11-15 10:42:03 +05:30
vishnukvmd 2e15d953f7 Ignore search if models haven't been loaded 2023-11-15 10:19:05 +05:30
vishnukvmd d64d3c4179 Reflect the correct index status 2023-11-15 02:17:53 +05:30
vishnukvmd df5c776dc8 Simplify state 2023-11-15 02:08:26 +05:30
vishnukvmd 76f3c43ae3 Use a different event to pull from server 2023-11-15 02:03:32 +05:30
vishnukvmd a28219807b Remove extra sync event 2023-11-15 01:36:14 +05:30
vishnukvmd 688b43c75a Listen to changes in the DB and update the cache 2023-11-15 01:16:17 +05:30
vishnukvmd 4740d723af Simplify scoring function 2023-11-15 00:16:49 +05:30
vishnukvmd ce2e034085 Play with an optimized computeScore method 2023-11-14 23:33:10 +05:30
vishnukvmd 6ad7911f1f Update indexing status in real time 2023-11-14 23:32:03 +05:30
vishnukvmd 98b1c1689d Update key 2023-11-14 22:48:03 +05:30
vishnukvmd ef5a5b7c40 Ignore files that have already been queued 2023-11-14 21:01:16 +05:30
vishnukvmd 7c2bf8bd97 Block back fill on remote sync 2023-11-14 20:50:46 +05:30
vishnukvmd 1f17e892c0 Disable search if magic search is disabled 2023-11-14 19:30:06 +05:30
vishnukvmd cd296373d2 Reorder methods 2023-11-14 14:34:42 +05:30
vishnukvmd 34028dc5d7 Reduce visibility of method 2023-11-14 14:33:16 +05:30
vishnukvmd 419467cfac Minor refactor 2023-11-14 14:31:48 +05:30
vishnukvmd e101462eee Decode fetched embeddings on a separate isolate 2023-11-14 14:18:22 +05:30
vishnukvmd 739ef4c21e Refactor code 2023-11-14 13:41:32 +05:30
vishnukvmd ea76fd2ce8 Warm up the text encoder 2023-11-14 13:34:28 +05:30
vishnukvmd b54f082cb6 Move from SQLite to ObjectBox for storing embeddings 2023-11-14 13:26:54 +05:30
vishnukvmd b9cd9cf9cd Fix bug when 0 embeddings are returned 2023-11-14 12:12:58 +05:30
vishnukvmd 289fbc8a11 Move entire score computation to an isolate 2023-11-14 10:14:54 +05:30
vishnukvmd 3d0fefb715 Merge branch 'main' into clip 2023-11-14 09:35:41 +05:30
vishnukvmd 4278dcc102 Show option to contact support when verification fails 2023-11-11 19:13:09 +05:30
ashilkn 7b2810391c remove shuffling of results in some search secitons for better UI 2023-11-11 10:20:39 +05:30
ashilkn 70ca1f1eac add hero animation for location section 2023-11-10 17:30:17 +05:30
ashilkn b4b4080149 resolve conflicts and merge main 2023-11-07 18:24:07 +05:30
ashilkn e5180034ff add support for searching sharer to see all items of sharer 2023-11-07 17:55:32 +05:30
ashilkn 12051e8003 rename method 2023-11-07 17:41:16 +05:30
ashilkn b39efa03c8 minor change 2023-11-07 13:17:32 +05:30
ashilkn 7b53b906b2 fix: bug in moments search section when there aren't results for at least one moments 2023-11-07 13:15:35 +05:30
ashilkn 3f1778460f show a 'date' example in 'moments' search section 2023-11-07 12:33:45 +05:30
ashilkn 5cf9c30b5f bug fix + handle possible errors with try catch 2023-11-07 10:31:43 +05:30
vishnukvmd 4d095208f6 Load embeddings in a batch 2023-11-06 19:00:08 +05:30
Neeraj Gupta 37192e0396 Add optional field for referral source 2023-11-06 17:33:33 +05:30
ashilkn 7021dfea73 bug fix + optimise code + use better variables 2023-11-06 16:53:35 +05:30
ashilkn 7c912c2d02 Fix bug in description section results 2023-11-06 16:40:52 +05:30
ashilkn dc595edc50 added more smartness on deciding which sub descriptions of all descriptions to show 2023-11-06 10:30:44 +05:30
ashilkn 522468580c Resolve conflicts and merge main 2023-11-03 14:34:56 +05:30
vishnukvmd 71234dfa7e Cache local embeddings 2023-10-28 17:47:17 +05:30
vishnukvmd e971bf6bc5 Ensure that each entry within an embedding is cast to double 2023-10-28 17:37:24 +05:30
vishnukvmd fb07b954a5 Simplify how low quality results are filtered out 2023-10-28 16:25:06 +05:30
vishnukvmd e6c5bf0bbe Update method name 2023-10-28 16:23:48 +05:30
vishnukvmd 1a01fbd5d9 Index the latest item first 2023-10-28 16:15:42 +05:30
vishnukvmd 4c593e097a Clear the queue when indexing is disabled 2023-10-28 16:15:10 +05:30
vishnukvmd 89e7606d7a Update score threshold 2023-10-27 13:04:31 +05:30
vishnukvmd c0b1667962 Return empty results if magic search hasn't been enabled 2023-10-27 13:04:31 +05:30
vishnukvmd b7e434c5ec Disable semantic search on iOS 2023-10-27 13:04:31 +05:30
vishnukvmd 2827bf238a Ignore if embedding lengths don't match 2023-10-27 13:04:31 +05:30
vishnukvmd e36ec7cc94 Use ChaCha to encrypt embeddings 2023-10-27 13:04:31 +05:30
vishnukvmd 54a78555d8 Deal with JSONified strings instead of FloatArray buffers 2023-10-27 13:04:31 +05:30
vishnukvmd 6acb2951b9 Remove batching 2023-10-27 13:04:31 +05:30
vishnukvmd 5b86080910 Minor refactor 2023-10-27 13:04:30 +05:30
vishnukvmd d25938aeac Pull model from remote 2023-10-27 13:04:30 +05:30
vishnukvmd 3dda5af52a Fix issue with the ordering of fetched embeddings 2023-10-27 13:04:30 +05:30
vishnukvmd 6f251a80a2 Load models in a separate isolate 2023-10-27 13:04:30 +05:30
vishnukvmd 638ff0547e Update dependency on clip_ggml 2023-10-27 13:04:30 +05:30
vishnukvmd 720ac428db Fix attribute name for remote embeddings 2023-10-27 13:04:30 +05:30
vishnukvmd ce1d6c0805 Ignore items not owned by the user 2023-10-27 13:04:30 +05:30
vishnukvmd 53fa9c6830 Load models separately 2023-10-27 13:04:29 +05:30
vishnukvmd a2f66f1e4e Switch to using uploaded IDs 2023-10-27 13:04:29 +05:30
vishnukvmd 4ea80d391b Display index status within the UI 2023-10-27 13:04:29 +05:30
vishnukvmd 804178e03d Fire an event once a files are indexed 2023-10-27 13:04:29 +05:30
vishnukvmd eb0bd4516b Minor fixes 2023-10-27 13:04:29 +05:30
vishnukvmd baee39438d Push pending embeddings to remote on app start 2023-10-27 13:04:29 +05:30
vishnukvmd 9163cbf26d Compute embedding whenever a file is uploaded 2023-10-27 13:04:28 +05:30
vishnukvmd 5ee2ab14f2 Use a queue to backfill 2023-10-27 13:04:28 +05:30
vishnukvmd f112fdd06e Minor refactor 2023-10-27 13:04:28 +05:30
vishnukvmd 4dcd9a8f68 Minor refactor 2023-10-27 13:04:28 +05:30
vishnukvmd 3411d250a7 Push computed embeddings upstream 2023-10-27 13:04:28 +05:30
vishnukvmd 57df32762a Persist the last sync time 2023-10-27 13:04:28 +05:30
vishnukvmd fea2057c85 Add API to push embeddings to remote 2023-10-27 13:04:28 +05:30
vishnukvmd 4ecf4bcf87 Remove direct dependency on Sodium to make reviews easier 2023-10-27 13:04:28 +05:30
vishnukvmd 01b155a172 Persist fetched embeddings 2023-10-27 13:04:28 +05:30
vishnukvmd c21867cdc6 Fetch embeddings until server has no more 2023-10-27 13:04:28 +05:30
vishnukvmd dedbca36f5 Fetch embeddings from server 2023-10-27 13:04:28 +05:30
vishnukvmd 32a5adb6d8 Pull embeddings once diff sync is done 2023-10-27 13:04:28 +05:30
vishnukvmd eb4daf331a Publish event when remote diff has been synced 2023-10-27 13:04:28 +05:30
vishnukvmd 58ff6aeaaf Compute time more accurately 2023-10-27 13:04:27 +05:30
vishnukvmd 55fc094324 Update SSS 2023-10-27 13:04:27 +05:30
vishnukvmd dc6d3e2111 Integrate batch inference API 2023-10-27 13:04:27 +05:30
vishnukvmd 71f372256e Update SSS 2023-10-27 13:04:26 +05:30
vishnukvmd 884e3eb30b Hook semantic search to UI 2023-10-27 13:04:26 +05:30
vishnukvmd 54881e0309 Implement search 2023-10-27 13:04:26 +05:30
vishnukvmd 17fd2c8b14 Compute embeddings for unindexed files 2023-10-27 13:04:26 +05:30
vishnukvmd a5e2fff272 Fetch and cache embeddings 2023-10-27 13:04:25 +05:30
vishnukvmd 5b5fba8ecf Minor refactor 2023-10-27 13:04:25 +05:30
vishnukvmd 61c4d69dbe Run inference on a separate isolate 2023-10-27 13:04:25 +05:30
vishnukvmd 94ab10315b Integrate static APIs 2023-10-27 13:04:25 +05:30
vishnukvmd 2dde47b576 Update method to fetch embedding 2023-10-27 13:04:25 +05:30
vishnukvmd 10ab2c53b0 Setup semantic search service 2023-10-27 13:04:25 +05:30
Neeraj Gupta c513957056 Format
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-10-27 09:21:04 +05:30
Neeraj Gupta 9b87b6c835 Fix: Avoid pushing duplicate HomeWidget during login
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-10-27 09:20:26 +05:30
ashilkn 19cf283b87 fix bug in fileTypes and Extension search section's limit on results to be shown 2023-10-17 06:32:51 +05:30
ashilkn a33eff40a8 fix bug in description search section result 2023-10-16 16:40:00 +05:30
ashilkn 40cc0ed70f Show people search section examples (people as in people who have shared items) 2023-10-16 16:37:36 +05:30
ashilkn f7b32ec9bb fix incorrect use of limit in fileDescriptionSearch used in search section 2023-10-14 17:25:31 +05:30
ashilkn 0d378b838a do case insensitive matching of descriptions in search section 2023-10-14 16:57:17 +05:30
ashilkn cef2d08917 fix: use set instead of list to avoid showing duplicate files in fileType search section results 2023-10-14 16:39:18 +05:30
ashilkn 821159d57e fix incorrect use of limit in getAllFileTypesAndExtensionsResults() 2023-10-13 17:18:45 +05:30
ashilkn 933aa24e33 Show a random holiday in moments search example section 2023-10-13 13:04:16 +05:30
ashilkn 0ee892d7ce Show random month + random year in moments search example section 2023-10-13 12:53:31 +05:30
ashilkn 13ec5ab8c3 Show first random month that has items in 'moments' search example section 2023-10-13 12:25:45 +05:30
ashilkn 8945d33b5b Reorder 2023-10-12 18:44:48 +05:30
ashilkn d2958b3bec Remove descriptions that end with a connect word 2023-10-12 18:15:18 +05:30
ashilkn bc64668390 Add comment 2023-10-12 18:02:06 +05:30
ashilkn 93dd535226 Remove descriptions that have connect words as all of it's words 2023-10-12 17:59:20 +05:30
ashilkn 9d31007fc7 add functionality to limit the number of search results returned from description search. Randomized the results from a decent pool of results too 2023-10-12 16:06:43 +05:30
ashilkn 97dd621d67 fix bug in getAllFileTypesAndExtensionsResults 2023-10-12 15:32:17 +05:30