vishnukvmd
03f471623b
Temporarily parse model from assets
2023-12-14 11:31:01 +05:30
vishnukvmd
c35ee381d3
Add ability to clear local embeddings
2023-12-14 11:30:09 +05:30
vishnukvmd
1c488e86a5
Increase batch size for caching thumbs
2023-12-14 11:25:16 +05:30
Neeraj Gupta
664952c1ed
Refactor: Reduce duplicate logic in dedupe grouping
2023-12-14 11:07:19 +05:30
Neeraj Gupta
665c378197
Dedupe: Pull up hash clubbing logic
2023-12-14 09:40:50 +05:30
Neeraj Gupta
08930a4e69
Rename
2023-12-14 08:58:12 +05:30
ashilkn
3c00672aef
Add support for resetting location data to original location data from exif or removing location data for files without location data in exif
2023-12-14 06:15:48 +05:30
vishnukvmd
7bbcdb0010
Increase batch size for caching thumbnails
2023-12-13 19:08:05 +05:30
vishnukvmd
f5b7897838
Fix thumbnail caching logic
2023-12-13 17:24:27 +05:30
vishnukvmd
ad8f7cbccd
Cache all thumbnails first
2023-12-13 15:16:34 +05:30
vishnukvmd
e1ea9530f1
Remove score threshold
2023-12-13 15:02:35 +05:30
vishnukvmd
bbee1c0e41
Fetch only relevant embeddings from disk
2023-12-13 14:56:08 +05:30
vishnukvmd
3ea8fca2f2
Retrieve OrtSession from cached address
2023-12-13 14:55:51 +05:30
vishnukvmd
14acf95a15
Disable embedding push
2023-12-13 14:55:13 +05:30
vishnukvmd
01c82eaf82
Store framework name along with the model name
2023-12-13 14:42:02 +05:30
vishnukvmd
1c0ff2f10c
Use the cached address to retrieve the encoder
2023-12-13 14:39:18 +05:30
vishnukvmd
b2f9dd2c8b
Initialize tokenizer outside the isolate
2023-12-13 14:38:24 +05:30
vishnukvmd
f0f4f7f429
Fix logger name
2023-12-13 14:37:36 +05:30
vishnukvmd
de3db565f5
Fix asset path
2023-12-13 14:37:26 +05:30
vishnukvmd
b59e928a1a
Pass final file path to model loader
2023-12-13 12:54:03 +05:30
vishnukvmd
dd846d7920
Split ONNX framework into multiple files
2023-12-13 12:46:07 +05:30
vishnukvmd
4ed3720906
Fix compilation
2023-12-13 12:39:08 +05:30
vishnukvmd
4c44fc521c
Fix warnings
2023-12-13 12:36:14 +05:30
0nullpointer
d7cacce1d8
Add bpePath to CLIPTokenizer
2023-12-13 12:33:28 +05:30
0nullpointer
02114efc2b
[WIP] onnx local test
2023-12-13 12:28:04 +05:30
Muhammed Ayimen
d74c1421a6
Changed: archiveSharedItems name to archiveSharedAlbums
2023-12-13 15:20:08 +09:00
Muhammed Ayimen
56a287e284
Updated: Logic for hiding the incoming shared items
2023-12-13 14:48:46 +09:00
Muhammed Ayimen
e9138c719e
Chnaged: hideSharedItems name to archiveSharedItems
2023-12-13 14:44:10 +09:00
Neeraj Gupta
56d8173510
Fix: Dismiss dialog before navigation
2023-12-13 08:51:12 +05:30
0nullpointer
f7859cdb7f
[WIP] semantic search with onnx
2023-12-12 21:53:59 +05:30
0nullpointer
e2c7cdf9f8
Add initial onnx framework
2023-12-12 21:39:35 +05:30
ashilkn
e2f9ce717a
wrote service method to update location data
2023-12-12 15:46:53 +05:30
Neeraj Gupta
c8d3ab8dc6
Merge branch 'main' into more_improvements
2023-12-06 13:35:58 +05:30
Neeraj Gupta
d833ba31ed
Add support for early validation of photo
...
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-12-06 13:32:11 +05:30
Neeraj Gupta
034d9e9914
Enhance re-processing of live photos ( #1570 )
...
* Improve live photos change check
* Ignore files that are already marked for reupload
2023-12-06 12:56:26 +05:30
Neeraj Gupta
21b9905a6f
Run check in small chunk
2023-12-06 12:34:06 +05:30
Neeraj Gupta
844fa75bcd
Ignore files that are already marked for reupload
2023-12-06 09:20:28 +05:30
Neeraj Gupta
1d9d96faf1
Improve live photos change check
2023-12-06 09:14:33 +05:30
Neeraj Gupta
f0d9b27397
Enhance logs
2023-12-06 08:53:34 +05:30
Neeraj Gupta
eabcded25e
Fix: Swallow InvalidFileError during upload session
...
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-12-06 08:46:01 +05:30
vishnukvmd
75704f0687
Update logger name
2023-12-05 22:37:56 +05:30
vishnukvmd
708b1c8d23
Refactor ML framework
2023-12-05 22:36:02 +05:30
vishnukvmd
05ba553ebc
Define a dummy init method
2023-12-05 21:33:03 +05:30
vishnukvmd
ac82f5b282
Create a generic EmbeddingService
2023-12-05 21:31:25 +05:30
vishnukvmd
dc16c52ff6
Move score computation to app layer
2023-12-05 21:17:28 +05:30
vishnukvmd
54b553909f
Merge branch 'main' into clip
2023-12-05 21:13:53 +05:30
ashilkn
addac894e4
remove comment + fix lint error
2023-12-04 15:21:49 +05:30
Neeraj Gupta
cd320d30dd
LocalFileUpdater: Process live photos ( #1556 )
...
* Import files that need to be checked for livePhoto upload
* Add logic to re-process live photos
* Update localFile check + bump version
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
---------
Signed-off-by: Neeraj Gupta <254676+ua741@users.noreply.github.com>
2023-12-04 10:25:17 +05:30
Neeraj Gupta
f56191f70d
Warn for unawaited futures ( #1559 )
2023-12-02 17:12:52 +05:30
Neeraj Gupta
fe2bcc0438
Fix only attempt to re-upload in owned collection ( #1555 )
2023-12-01 17:21:16 +05:30
Neeraj Gupta
1ec2b14df2
Make error field mandatory
2023-11-30 10:49:35 +05:30
Neeraj Gupta
7230d52dd2
ErrDialog: Surface network error & contact support
2023-11-30 10:37:38 +05:30
Neeraj Gupta
3cecdd201d
Fix bug in local file update checker
2023-11-27 14:55:14 +05:30
Neeraj Gupta
4fba22f204
ChangePassword: Confirm before signing out from other devices
2023-11-26 16:18:15 +05:30
Neeraj Gupta
1abd0a3178
Handle loginKey and keyDerivation err during SRP based login ( #1522 )
2023-11-20 15:52:52 +05:30
ashilkn
f25a4e59b4
fix: archived files which are not part of an archived album were coming up in moments
2023-11-20 14:27:01 +05:30
Neeraj Gupta
f910da0964
Handle loginKey and keyDerivation err during SRP based login
2023-11-20 13:28:27 +05:30
vishnukvmd
a0a5640e61
Add logs
2023-11-18 16:57:25 +05:30
vishnukvmd
1956a589d7
ping-pong
2023-11-17 17:26:02 +05:30
vishnukvmd
3949918440
Merge branch 'main' into clip
2023-11-17 16:41:39 +05:30
Vishnu Mohandas
e99544e335
Update change log ( #1511 )
2023-11-17 16:38:54 +05:30
ashilkn
b814fb0971
change people to contacts
2023-11-17 16:09:58 +05:30
vishnukvmd
6faa408204
Re-enable computation of image embedding
2023-11-17 15:44:16 +05:30
ashilkn
38ae3538e7
update change log version
2023-11-17 15:38:52 +05:30
vishnukvmd
c683d37899
TODO: Localize these strings
2023-11-17 00:22:46 +05:30
vishnukvmd
e1ebae3e9a
Render the type as plural
2023-11-17 00:10:12 +05:30
vishnukvmd
31589c9470
Return human readable string for file types
2023-11-17 00:08:05 +05:30
vishnukvmd
824866a8ab
Trim emails
2023-11-16 23:28:41 +05:30
vishnukvmd
6b7579da26
Merge branch 'main' into clip
2023-11-16 19:00:32 +05:30
ashilkn
7e15691c30
resolve conflicts and merge main
2023-11-16 13:41:39 +05:30
Neeraj Gupta
bf08e938ff
Allow folks with add_on to activate family
2023-11-15 20:14:48 +05:30
vishnukvmd
f54d82be34
Perform no image embedding
2023-11-15 17:35:04 +05:30
ashilkn
faede193b1
resolve conflicts and merge main
2023-11-15 15:48:31 +05:30
ashilkn
b4a07d2b0d
fix: hero animation not working between album's view all tile and collection screen
2023-11-15 13:57:03 +05:30
vishnukvmd
cf3634f707
Ignore spurious requests to backfill
2023-11-15 10:50:48 +05:30
vishnukvmd
179dc0ce89
Minor refactor
2023-11-15 10:47:25 +05:30
vishnukvmd
4c2ec1da50
Wait until model is loaded
2023-11-15 10:42:03 +05:30
vishnukvmd
2e15d953f7
Ignore search if models haven't been loaded
2023-11-15 10:19:05 +05:30
vishnukvmd
d64d3c4179
Reflect the correct index status
2023-11-15 02:17:53 +05:30
vishnukvmd
df5c776dc8
Simplify state
2023-11-15 02:08:26 +05:30
vishnukvmd
76f3c43ae3
Use a different event to pull from server
2023-11-15 02:03:32 +05:30
vishnukvmd
a28219807b
Remove extra sync event
2023-11-15 01:36:14 +05:30
vishnukvmd
688b43c75a
Listen to changes in the DB and update the cache
2023-11-15 01:16:17 +05:30
vishnukvmd
4740d723af
Simplify scoring function
2023-11-15 00:16:49 +05:30
vishnukvmd
ce2e034085
Play with an optimized computeScore method
2023-11-14 23:33:10 +05:30
vishnukvmd
6ad7911f1f
Update indexing status in real time
2023-11-14 23:32:03 +05:30
vishnukvmd
98b1c1689d
Update key
2023-11-14 22:48:03 +05:30
vishnukvmd
ef5a5b7c40
Ignore files that have already been queued
2023-11-14 21:01:16 +05:30
vishnukvmd
7c2bf8bd97
Block back fill on remote sync
2023-11-14 20:50:46 +05:30
vishnukvmd
1f17e892c0
Disable search if magic search is disabled
2023-11-14 19:30:06 +05:30
vishnukvmd
cd296373d2
Reorder methods
2023-11-14 14:34:42 +05:30
vishnukvmd
34028dc5d7
Reduce visibility of method
2023-11-14 14:33:16 +05:30
vishnukvmd
419467cfac
Minor refactor
2023-11-14 14:31:48 +05:30
vishnukvmd
e101462eee
Decode fetched embeddings on a separate isolate
2023-11-14 14:18:22 +05:30
vishnukvmd
739ef4c21e
Refactor code
2023-11-14 13:41:32 +05:30
vishnukvmd
ea76fd2ce8
Warm up the text encoder
2023-11-14 13:34:28 +05:30
vishnukvmd
b54f082cb6
Move from SQLite to ObjectBox for storing embeddings
2023-11-14 13:26:54 +05:30
vishnukvmd
b9cd9cf9cd
Fix bug when 0 embeddings are returned
2023-11-14 12:12:58 +05:30
vishnukvmd
289fbc8a11
Move entire score computation to an isolate
2023-11-14 10:14:54 +05:30
vishnukvmd
3d0fefb715
Merge branch 'main' into clip
2023-11-14 09:35:41 +05:30
vishnukvmd
4278dcc102
Show option to contact support when verification fails
2023-11-11 19:13:09 +05:30
ashilkn
7b2810391c
remove shuffling of results in some search secitons for better UI
2023-11-11 10:20:39 +05:30
ashilkn
70ca1f1eac
add hero animation for location section
2023-11-10 17:30:17 +05:30
ashilkn
b4b4080149
resolve conflicts and merge main
2023-11-07 18:24:07 +05:30
ashilkn
e5180034ff
add support for searching sharer to see all items of sharer
2023-11-07 17:55:32 +05:30
ashilkn
12051e8003
rename method
2023-11-07 17:41:16 +05:30
ashilkn
b39efa03c8
minor change
2023-11-07 13:17:32 +05:30
ashilkn
7b53b906b2
fix: bug in moments search section when there aren't results for at least one moments
2023-11-07 13:15:35 +05:30
ashilkn
3f1778460f
show a 'date' example in 'moments' search section
2023-11-07 12:33:45 +05:30
ashilkn
5cf9c30b5f
bug fix + handle possible errors with try catch
2023-11-07 10:31:43 +05:30
vishnukvmd
4d095208f6
Load embeddings in a batch
2023-11-06 19:00:08 +05:30
Neeraj Gupta
37192e0396
Add optional field for referral source
2023-11-06 17:33:33 +05:30
ashilkn
7021dfea73
bug fix + optimise code + use better variables
2023-11-06 16:53:35 +05:30
ashilkn
7c912c2d02
Fix bug in description section results
2023-11-06 16:40:52 +05:30
ashilkn
dc595edc50
added more smartness on deciding which sub descriptions of all descriptions to show
2023-11-06 10:30:44 +05:30
ashilkn
522468580c
Resolve conflicts and merge main
2023-11-03 14:34:56 +05:30
vishnukvmd
71234dfa7e
Cache local embeddings
2023-10-28 17:47:17 +05:30
vishnukvmd
e971bf6bc5
Ensure that each entry within an embedding is cast to double
2023-10-28 17:37:24 +05:30
vishnukvmd
fb07b954a5
Simplify how low quality results are filtered out
2023-10-28 16:25:06 +05:30
vishnukvmd
e6c5bf0bbe
Update method name
2023-10-28 16:23:48 +05:30
vishnukvmd
1a01fbd5d9
Index the latest item first
2023-10-28 16:15:42 +05:30
vishnukvmd
4c593e097a
Clear the queue when indexing is disabled
2023-10-28 16:15:10 +05:30
vishnukvmd
89e7606d7a
Update score threshold
2023-10-27 13:04:31 +05:30
vishnukvmd
c0b1667962
Return empty results if magic search hasn't been enabled
2023-10-27 13:04:31 +05:30
vishnukvmd
b7e434c5ec
Disable semantic search on iOS
2023-10-27 13:04:31 +05:30
vishnukvmd
2827bf238a
Ignore if embedding lengths don't match
2023-10-27 13:04:31 +05:30
vishnukvmd
e36ec7cc94
Use ChaCha to encrypt embeddings
2023-10-27 13:04:31 +05:30
vishnukvmd
54a78555d8
Deal with JSONified strings instead of FloatArray buffers
2023-10-27 13:04:31 +05:30
vishnukvmd
6acb2951b9
Remove batching
2023-10-27 13:04:31 +05:30
vishnukvmd
5b86080910
Minor refactor
2023-10-27 13:04:30 +05:30
vishnukvmd
d25938aeac
Pull model from remote
2023-10-27 13:04:30 +05:30
vishnukvmd
3dda5af52a
Fix issue with the ordering of fetched embeddings
2023-10-27 13:04:30 +05:30
vishnukvmd
6f251a80a2
Load models in a separate isolate
2023-10-27 13:04:30 +05:30
vishnukvmd
638ff0547e
Update dependency on clip_ggml
2023-10-27 13:04:30 +05:30
vishnukvmd
720ac428db
Fix attribute name for remote embeddings
2023-10-27 13:04:30 +05:30
vishnukvmd
ce1d6c0805
Ignore items not owned by the user
2023-10-27 13:04:30 +05:30
vishnukvmd
53fa9c6830
Load models separately
2023-10-27 13:04:29 +05:30
vishnukvmd
a2f66f1e4e
Switch to using uploaded IDs
2023-10-27 13:04:29 +05:30
vishnukvmd
4ea80d391b
Display index status within the UI
2023-10-27 13:04:29 +05:30
vishnukvmd
804178e03d
Fire an event once a files are indexed
2023-10-27 13:04:29 +05:30
vishnukvmd
eb0bd4516b
Minor fixes
2023-10-27 13:04:29 +05:30
vishnukvmd
baee39438d
Push pending embeddings to remote on app start
2023-10-27 13:04:29 +05:30
vishnukvmd
9163cbf26d
Compute embedding whenever a file is uploaded
2023-10-27 13:04:28 +05:30
vishnukvmd
5ee2ab14f2
Use a queue to backfill
2023-10-27 13:04:28 +05:30
vishnukvmd
f112fdd06e
Minor refactor
2023-10-27 13:04:28 +05:30
vishnukvmd
4dcd9a8f68
Minor refactor
2023-10-27 13:04:28 +05:30
vishnukvmd
3411d250a7
Push computed embeddings upstream
2023-10-27 13:04:28 +05:30
vishnukvmd
57df32762a
Persist the last sync time
2023-10-27 13:04:28 +05:30
vishnukvmd
fea2057c85
Add API to push embeddings to remote
2023-10-27 13:04:28 +05:30
vishnukvmd
4ecf4bcf87
Remove direct dependency on Sodium to make reviews easier
2023-10-27 13:04:28 +05:30
