Commit graph

295 commits

Author SHA1 Message Date
laurenspriem bd495c3860 [mob][photos] Assert that embeddings are always normalized 2024-05-06 17:16:58 +05:30
laurenspriem b4736fb1d6 [mob][photos] Normalize weighted embeddings for cluster summary 2024-05-06 17:03:06 +05:30
laurenspriem 71b572917e [mob][photos] More debug logging on clusters 2024-05-06 16:45:27 +05:30
laurenspriem 3c24345b68 [mob][photos] Add method for safe cosine distance 2024-05-06 16:38:19 +05:30
laurenspriem ea8846ee0c [mob][photos] Properly sort faces on fileCreationTime for clustering 2024-05-06 10:38:26 +05:30
laurenspriem ade70f40a9 [mob][photos] Use separate isIgnored getter instead of isHidden 2024-05-03 17:25:30 +05:30
laurenspriem 319dc055de [mob][photos] Rename "hidden" to "ignored" 2024-05-03 16:17:56 +05:30
laurenspriem 95ba8a368b [mob][photos] Show (hidden) in file info for hidden persons 2024-05-03 12:45:21 +05:30
laurenspriem 5c1bc220e9 [mob][photos] Method for hiding cluster 2024-05-03 12:07:23 +05:30
laurenspriem 6ea8b972bd [mob][photos] Put serialization for suggestions in computer 2024-05-02 17:01:10 +05:30
laurenspriem 793fc3aa46 [mob][photos] Cluster suggestion calculation in computer 2024-05-02 16:08:19 +05:30
laurenspriem 2e17e2b78d [mob][photos] Trailing comma 2024-05-02 12:38:05 +05:30
laurenspriem c6129c32da Merge remote-tracking branch 'origin/mobile_face' into mobile_face 2024-05-02 12:36:43 +05:30
laurenspriem d650bac501 [mob][photos] Small changes in suggestion calculation 2024-05-02 12:35:52 +05:30
laurenspriem 74ae4ea74f [mob][photos] Fix regression in suggestion calculation 2024-05-02 11:18:06 +05:30
Neeraj Gupta ca3172c33e [mobile] Add method to reconsile mappings 2024-05-02 07:04:31 +05:30
vishnukvmd bc32c89d77 Rename DB 2024-05-01 15:14:44 +05:30
vishnukvmd 348b784674 Remove Isar DB for Embeddings 2024-04-30 19:52:30 +05:30
laurenspriem 046a96f586 Merge remote-tracking branch 'origin/mobile_face' into mobile_face 2024-04-30 11:57:03 +05:30
laurenspriem c783735e86 [mob][photos] Log clustering time for each bucket 2024-04-30 11:24:06 +05:30
Neeraj Gupta cbf2a77d5b refactor 2024-04-30 11:06:41 +05:30
vishnukvmd 0f5007b8d2 Update key 2024-04-29 17:32:42 +05:30
vishnukvmd 64f2be09e6 Replace Isar with SQLite 2024-04-29 17:30:56 +05:30
laurenspriem a2023bd457 [mob][photos] Fix database issue 2024-04-27 13:38:34 +05:30
laurenspriem 44898415e7 [mob][photos] Index videos using thumbnails 2024-04-26 14:43:19 +05:30
laurenspriem b2a2078045 [mob][photos] Moving more methods to sqlite async 2024-04-25 17:06:40 +05:30
laurenspriem 3828fa328e [mob][photos] Increase conservative clustering threshold slightly 2024-04-25 16:41:23 +05:30
laurenspriem 52a7f2753e [mob][photos] Tiny change 2024-04-25 16:15:04 +05:30
laurenspriem 43cbfbfa33 [mob][photos] Automatically reject overlapping suggestions 2024-04-25 16:13:29 +05:30
laurenspriem 7b8816a4bf [mob][photos] Higher conservative clustering threshold 2024-04-25 10:54:49 +05:30
laurenspriem 7e00a470aa [mob][photos] Lower both hard and soft blur thresholds 2024-04-25 10:54:19 +05:30
laurenspriem 1ae4482fe5 [mob][photos] Always check big clusters first for suggestions 2024-04-25 10:53:42 +05:30
laurenspriem 6f6f976dec [mob][photos] Fix bug 2024-04-24 18:33:00 +05:30
laurenspriem 72ff6e2cf3 [mob][photos] Tiny change 2024-04-24 17:07:28 +05:30
laurenspriem e0fbb2620b [mob][photos] Correct suggestion logic again 2024-04-24 17:06:35 +05:30
laurenspriem 462d1d4854 [mob][photos] Use cosineDistanceSIMD 2024-04-24 16:37:39 +05:30
laurenspriem 05a4e9f90b [mob][photos] Remove redundant logging 2024-04-24 16:31:36 +05:30
laurenspriem 3806ee3232 [mob][photos] Use SIMD in sorting suggestions too 2024-04-24 16:19:10 +05:30
laurenspriem e829f7b62f [mob][photos] Use vectors everywhere in cluster suggestion 2024-04-24 16:01:03 +05:30
laurenspriem 4b6641d7d8 [mob][photos] Speed up suggestion calculation 2024-04-24 15:46:00 +05:30
laurenspriem 093f48fb63 [mob][photos] Sort found suggestions based on distance 2024-04-24 11:24:25 +05:30
laurenspriem 759c8aa404 [mob][photos] Extra check in sorting suggestions 2024-04-24 10:01:07 +05:30
laurenspriem c80208e754 [mob][photos] Fix in sorting suggestions 2024-04-24 09:53:42 +05:30
laurenspriem 7097ce3cf4 [mob][photos] Faster DB call when sorting suggestions 2024-04-24 09:06:20 +05:30
laurenspriem efb1170b44 [mob][photos] unawait network call when accepting suggestion 2024-04-24 08:39:45 +05:30
laurenspriem 7312633e02 [mob][photos] Only sort big suggestions 2024-04-23 14:26:30 +05:30
laurenspriem 3786c9def9 [mob][photos] Suggestions change parameters 2024-04-23 13:37:53 +05:30
laurenspriem 6fe8dc7c66 [mob][photos] Check big and medium clusters first for suggestions 2024-04-23 12:18:19 +05:30
laurenspriem 6a0a9bad1e [mob][photos] Clustering time logs 2024-04-23 09:56:46 +05:30
laurenspriem fa466d715f [mob][photos] Improve suggestions by improving speed and preferring big clusters 2024-04-22 16:40:31 +05:30
Neeraj Gupta cc682a0a09 Merge branch 'mobile_face' of https://github.com/ente-io/auth into mobile_face 2024-04-20 16:01:08 +05:30
Neeraj Gupta 864f8444d5 Merge branch 'main' into mobile_face 2024-04-20 15:59:36 +05:30
laurenspriem edf99385dc [mob][photos] Precompute cluster summaries incrementally during clustering 2024-04-20 14:38:46 +05:30
laurenspriem cde17441d6 [mob][photos] Forgot one import 2024-04-20 13:35:53 +05:30
laurenspriem 4ac295e1e2 [mob][photos] Remove ClusterResult old deprecated code 2024-04-20 13:35:02 +05:30
laurenspriem a0502886b6 [mob] Minimum size argument for getting all cluster summaries 2024-04-20 13:26:47 +05:30
laurenspriem 7be1b63822 [mob] Clean up linear clustering method 2024-04-20 12:24:20 +05:30
laurenspriem 4095b14589 [mob] Conservative threshold for combination of low score and blur 2024-04-19 15:57:11 +05:30
laurenspriem a92081e703 [mob] Only analyze clustering in debugMode 2024-04-19 15:20:29 +05:30
laurenspriem f3f85e81ca [mob] Rename constant 2024-04-19 15:08:10 +05:30
laurenspriem ecc1bc9980 [mob] Use more conservative cluster threshold for sideways faces 2024-04-19 14:58:52 +05:30
laurenspriem a9ca8a4a24 [mob] Better handling of cluster update 2024-04-19 12:19:10 +05:30
laurenspriem ab0a99cf76 [mob] Make sure cluster page is updated after file removal 2024-04-19 11:42:39 +05:30
laurenspriem e20f13f02b [mob] Re-cluster when removing file from person/cluster 2024-04-18 17:57:14 +05:30
laurenspriem 79e763bf16 [mob] Small changes 2024-04-18 15:29:02 +05:30
laurenspriem afbb1c69c2 [mob] More clustering methods in Computer within cluster 2024-04-18 15:20:28 +05:30
laurenspriem 417c5eab1c [mob] Rename cluster method to clarify use of Computer 2024-04-18 14:48:57 +05:30
laurenspriem ba58ac1358 [mob] Add merges to predictComplete method 2024-04-18 14:44:12 +05:30
laurenspriem 7a5e1263e0 [mob] Use complete clustering for breaking up clusters 2024-04-18 11:26:24 +05:30
laurenspriem 45d18b187c [mob] Add completeClustering functionality 2024-04-18 11:25:48 +05:30
laurenspriem e3fd836901 [mob] clustering make it difficult for good faces to link to bad faces 2024-04-17 17:46:53 +05:30
laurenspriem 51d15cc441 [mob] Clustering with dynamic threshold based on face blur and score 2024-04-17 16:38:47 +05:30
laurenspriem 6f26901073 [mob] Minor refactor of clustering methods 2024-04-17 14:54:31 +05:30
laurenspriem f61a5f91b6 [mob] Debug option to get clusters of blur values 2024-04-16 19:22:27 +05:30
laurenspriem d4d9253f1a [mob] Minor changes 2024-04-16 15:22:59 +05:30
laurenspriem b1eb6c11b2 [mob] Show face direction in face widget in debug mode 2024-04-16 15:11:51 +05:30
laurenspriem 618b152f17 [mob] FaceMlService static method for full pipeline 2024-04-16 15:04:15 +05:30
laurenspriem e3b8d8975f [mob] Better blur detection handling background noise 2024-04-16 14:51:23 +05:30
laurenspriem 624a06c3f8 [mob] Deprecate methods 2024-04-16 14:37:56 +05:30
laurenspriem e3b1cb8014 [mob] Debug log blur values of cluster when opening cluster page 2024-04-16 14:33:13 +05:30
Neeraj Gupta 5bac629c2b [mob][photos] Fix connectivityResult check 2024-04-15 15:21:43 +05:30
Neeraj Gupta 223a4ffcfd [mob][photos] Upgrade connectivity_plus pkg 2024-04-15 15:00:59 +05:30
laurenspriem ef4135f378 [mob] tiny change 2024-04-13 16:41:51 +05:30
laurenspriem 7d414a7b7d [mob] Increase activity timer of cluster isolate 2024-04-13 15:55:04 +05:30
laurenspriem 2ce078e173 [mob] Fix too many clustering rounds/buckets 2024-04-13 15:54:36 +05:30
laurenspriem 8801dc1a7a [mob] Show clustered percentage in UI 2024-04-13 15:11:12 +05:30
laurenspriem 5cf10c9c9b [mob] Rename face clustering service 2024-04-13 13:10:20 +05:30
laurenspriem c58a8dc773 [mob] Better face clustering logging 2024-04-13 13:08:34 +05:30
laurenspriem c67a1fa52a [mob] Make clustering in buckets the default 2024-04-13 11:32:03 +05:30
laurenspriem da7302b677 [mob] Remove incorrect log 2024-04-12 18:12:31 +05:30
laurenspriem d65264e8e8 [mob] move fetching related code inside fetching block 2024-04-12 17:46:12 +05:30
Neeraj Gupta 5fec61fc1b [mob] Persist setting for disabling remote fetch 2024-04-12 16:20:09 +05:30
Neeraj Gupta 2302b930d3 [mob] Remove unsued section 2024-04-12 16:08:18 +05:30
laurenspriem 21451efa6b Merge remote-tracking branch 'origin/mobile_face' into mobile_face 2024-04-12 15:11:15 +05:30
laurenspriem 481410f183 [mob] Increase inactivity counter for clustering isolate 2024-04-12 14:38:36 +05:30
laurenspriem ba107c2d25 [mob] Fix in clustering without buckets 2024-04-12 12:01:17 +05:30
Neeraj Gupta f3647df1e9 [mob]Improve handling of multiple assignment of same faceID to different clusters 2024-04-12 11:49:40 +05:30
laurenspriem 01914ed3ce [mob] Option for indexing without fetching 2024-04-12 11:49:38 +05:30
Neeraj Gupta 5710cb2d35 Merge branch 'main' into mobile_face 2024-04-12 10:38:14 +05:30
laurenspriem b90aed0b4b [mob] Switch from FlutterIsolate to DartUiIsolate 2024-04-11 16:43:52 +05:30
Neeraj Gupta de96f108c2 [mob] Clean up + rethrow remote fetch error 2024-04-11 15:40:31 +05:30
Neeraj Gupta ff4e64819b [mob] Clean up code 2024-04-11 15:31:11 +05:30
Neeraj Gupta 1cc188dd9c [mob][clip] Simplify semantic search + fix infinite search loader 2024-04-11 15:27:22 +05:30
Neeraj Gupta b8417d1fcc [mob] Skip backfill if remote fetch fails 2024-04-11 14:09:31 +05:30
laurenspriem c902f24e63 [mob] Better organization of face detection code. 2024-04-11 11:42:31 +05:30
laurenspriem aad0a5a1d4 [mob] More documentation 2024-04-11 11:15:37 +05:30
laurenspriem 21adb91c2f [mob] Rename face embedding service 2024-04-11 11:03:43 +05:30
laurenspriem d4086357ec [mob] Remove all tflite models 2024-04-11 11:01:22 +05:30
laurenspriem 222716f6f9 [mob] Make methods private 2024-04-10 14:44:08 +05:30
laurenspriem f3d18edf98 [mob] Better logging of face landmarks 2024-04-10 12:21:15 +05:30
Neeraj Gupta fac087c81b [mob] Fix person entity update 2024-04-10 10:59:27 +05:30
Neeraj Gupta c920aacd1b [mob] Reduce noise in the logs 2024-04-10 10:59:18 +05:30
Neeraj Gupta e82cda1e82 [mob] Fix bug in discarding remote embedding 2024-04-10 10:10:53 +05:30
Neeraj Gupta c8154784f1 [mob] Minor fixes 2024-04-09 16:37:54 +05:30
Neeraj Gupta 52038b8972 [mob] Sync removed clusters from a person 2024-04-09 15:00:57 +05:30
Neeraj Gupta d43ed15cdf [mob] Add support for syncing multile clusters for a person 2024-04-09 14:48:05 +05:30
Neeraj Gupta 24f7b191b4 [mob] reduce clustering threshold 2024-04-09 09:04:07 +05:30
laurenspriem 4cb15268e9 [mob] Cleaner handling of decoded image dimensions 2024-04-08 15:24:14 +05:30
laurenspriem eeedf8b3c2 [mob] Trailing commas 2024-04-08 14:05:38 +05:30
Neeraj Gupta 0b08afdbe2 [mob] Use linear clustring for breaking up clusters 2024-04-08 08:52:00 +05:30
Neeraj Gupta 412e93c9fa [mob][face] Fix handling of case when noCluster id is assigned 2024-04-08 08:18:58 +05:30
Neeraj Gupta 2d58558737 [mob] Add support for removing people to cluster mapping 2024-04-08 07:43:08 +05:30
Neeraj Gupta 4a2b5fe27d [mob] Face: Ignore embeddings without image dims & bad landmarks 2024-04-07 16:12:59 +05:30
Neeraj Gupta cbc7034d47 [mob] Discard old fileEmbeddings 2024-04-06 04:00:48 +05:30
Neeraj Gupta d19d7ffe79 [mob][face] Storage width/height along with area and visibility 2024-04-06 03:49:03 +05:30
Neeraj Gupta 6c02b03426 [mob] Lint fixes 2024-04-06 01:50:45 +05:30
Neeraj Gupta 2ae37682e7 [mob] Fix bug in handling err for clustering 2024-04-05 18:49:01 +05:30
Neeraj Gupta bb3a37adf5 [mob] Fetch remote entities before running clustering 2024-04-05 16:04:58 +05:30
Neeraj Gupta 7c6001321f Merge branch 'mobile_face' into mobile_face_feedback_sync 2024-04-05 16:03:32 +05:30
Neeraj Gupta 1b9c81c50c Merge branch 'mobile_face' of https://github.com/ente-io/auth into mobile_face 2024-04-05 16:00:09 +05:30
Neeraj Gupta 1996d86835 [mob] Persist remote feedback before running clustering 2024-04-05 15:59:53 +05:30
laurenspriem 0c72fd2a69 [mob] Add more validation for clustering 2024-04-05 15:50:52 +05:30
laurenspriem 723253a12c [mob] Fix issue with random photo entering cluster 2024-04-05 15:49:35 +05:30
laurenspriem f1a7256a14 [mob] Fix wrong y-coordiantes being stored for faces 2024-04-05 14:01:26 +05:30
Neeraj Gupta 2456c02956 [mob] Remove personEntity dependency from faceDB 2024-04-05 12:52:01 +05:30
Neeraj Gupta 199dad3705 [mob] Make linter happy 2024-04-05 11:59:19 +05:30
Neeraj Gupta be06d45e3a [mob] Fix person custom avatar rendering 2024-04-05 07:21:48 +05:30
Neeraj Gupta 7429791a19 [mob] Persist person update on remote 2024-04-05 07:13:15 +05:30
Neeraj Gupta 3fb323ef29 [mob] Read person info from entity 2024-04-05 00:24:05 +05:30
Neeraj Gupta d8bf0ad2d5 [mob] Persist cluster information during person assignment 2024-04-04 22:04:19 +05:30
laurenspriem f1fd74b119 [mob] Option to add/remove face to cluster from file info 2024-04-04 18:47:09 +05:30
Neeraj Gupta f5a9679c0e [mob] Rename and add more attr to PersonEntity 2024-04-04 17:27:28 +05:30
laurenspriem 19007c38b5 [mob] await removal and fire event 2024-04-04 16:03:17 +05:30
Neeraj Gupta 2163201046 [mob] Increase the batch & bucket size 2024-04-04 14:46:56 +05:30
laurenspriem dd3b0be8f2 [mob] Tune analysis parameter 2024-04-04 13:17:43 +05:30
laurenspriem 0176b01fea [mob] Add basic debug UI for breaking up cluster 2024-04-04 12:14:18 +05:30
laurenspriem 15f9176208 [mob] More logs on breaking cluster 2024-04-03 21:31:16 +05:30
laurenspriem 744ded4922 [mob] Add DBSCAN clustering for intra-cluster analysis 2024-04-03 18:49:43 +05:30
laurenspriem b21466bf13 Merge remote-tracking branch 'origin/mobile_face' into mobile_face 2024-04-03 17:02:39 +05:30
laurenspriem 6a240ee030 Highlight relevant face 2024-04-03 16:59:38 +05:30