Shailesh Pandit
3d81ffd84b
Export and Import ml data from ml debug
2022-01-07 09:06:18 +05:30
Shailesh Pandit
943fa990cb
Migration for new Face interface
2022-01-06 15:05:00 +05:30
Shailesh Pandit
945139b758
Embedding service interface refactor
...
Use face imageBitmaps as input
Use Float32Array as output and for storage in db
2022-01-06 12:15:26 +05:30
Shailesh Pandit
2b5aafa0bc
Rename blazeface and mobilefacenet services
2022-01-06 07:22:05 +05:30
Shailesh Pandit
19c3654926
Rename tfjs face detection and embedding service files
2022-01-06 07:20:29 +05:30
Shailesh Pandit
19aae1a75b
Refactor interfaces
...
Use composition to store face analysis results
Add face id to stored face
2022-01-06 06:49:08 +05:30
Shailesh Pandit
1a41c7c194
Fix getUnidentifiedFaces for empty face crops
2022-01-05 14:43:25 +05:30
Shailesh Pandit
b88ccee6ed
Update files version after syncLocalFiles
2022-01-05 14:39:55 +05:30
Shailesh Pandit
be476995b2
Remove one time migration for face crops
2022-01-05 14:15:49 +05:30
Shailesh Pandit
2f3d06cb4d
Migrate face crops from indexdb to cache
2022-01-05 13:54:21 +05:30
Shailesh Pandit
2471a57b3b
Store face crops in cache to reduce io
...
when updating indexeddb
2022-01-05 12:12:24 +05:30
Shailesh Pandit
8ab7dc38e1
Ignore empty faces in AllFacesMap
2022-01-04 13:54:07 +05:30
Shailesh Pandit
68a976f628
Revert one time migration
2022-01-04 13:26:22 +05:30
Shailesh Pandit
86b2efbdd6
Fix migration for one time run
2022-01-04 13:07:34 +05:30
Shailesh Pandit
4cb552046a
Use IndexedDB without forage to use indexes
2022-01-04 11:26:16 +05:30
Shailesh Pandit
fa7453323d
Remove unnecessary sorting while getting out of sync files
...
Add timing logs to getPeopleList and getOutOfSyncFiles
2022-01-03 15:02:48 +05:30
Shailesh Pandit
fb402e9b69
Sync deleted files, remove ml data for them
...
Reset sync job backoff on local file updates
2022-01-03 10:06:30 +05:30
Shailesh Pandit
2cb9ebf402
Exponential back off for ml sync job
2022-01-03 08:05:00 +05:30
Shailesh Pandit
b9d32cc1e6
Dispose sync context in local file sync flow
2022-01-03 07:13:59 +05:30
Shailesh Pandit
fc459171f4
Fix typo
2022-01-02 22:33:40 +05:30
Shailesh Pandit
502a023fa3
Run ml sync concurrently
2022-01-02 22:27:42 +05:30
Shailesh Pandit
86052cc393
Run face clustering using configured method
...
Save face clustering results
Display noise faces on ml debug page
2021-12-31 12:08:50 +05:30
Shailesh Pandit
30f9088c81
Show face crops and images in rows
2021-12-29 18:45:47 +05:30
Shailesh Pandit
778431d01b
Normalize landmark and box thickness in ml debug
2021-12-29 17:11:46 +05:30
Shailesh Pandit
9d3bf5ce6f
Detected face transforms to and from face crop
2021-12-29 12:10:11 +05:30
Shailesh Pandit
162d760b80
Use transformation-matrix package for transforms
2021-12-29 10:32:01 +05:30
Shailesh Pandit
385acec1ab
Do 2nd pass of blazeface on close ups
...
for better accuracy
Transform utils
2021-12-28 20:30:52 +05:30
Shailesh Pandit
72b2a6ad8b
Handle empty faces in unidentified faces
2021-12-25 14:22:38 +05:30
Shailesh Pandit
8177cd336b
Show unidentified faces in info panel
...
Add local file debugging info to ml debug page
showing aligned face box and landmarks and face crops
2021-12-25 13:07:24 +05:30
Shailesh Pandit
91bd053cf5
Use face crops while calculating embeddings
...
Simulate mlVersion update requiring only embeddings to be recalculated
without downloading full image
2021-12-24 12:27:29 +05:30
Shailesh Pandit
7b06f5d8f8
imageSource not updated based on actual source
2021-12-23 23:59:49 +05:30
Shailesh Pandit
44f4362f0f
Store ml sync error count for a file, limit retry
...
Download original quality files for photos and live photos only
2021-12-23 23:40:21 +05:30
Shailesh Pandit
b4c31c5845
Store face crops, extract aligned faces from face crops
...
Align faces using center, size and rotation only, using this aligned faces can be extracted without whole image
2021-12-23 18:27:53 +05:30
Shailesh Pandit
4ebcddbb84
Provision to run ml sync on original images
...
To capture high resolution face images
Use ImageBitmap till tf models as tf manipulations on variable dimention images leads to gpu memory leak - https://github.com/tensorflow/tfjs/issues/604
2021-12-20 22:20:20 +05:30
Shailesh Pandit
0e366264a0
TF memory cleaned only with tf.dispose and tf.tidy
...
Remove usage of startScope and endScope, can be used for debugging
2021-12-15 17:20:07 +05:30
Shailesh Pandit
f5ca124fc9
Only sync updated ml methods for existing files
2021-12-14 19:44:13 +05:30
Shailesh Pandit
2d17dd30e9
For uploaded files use local files for ML Sync
...
Extract out ML work manager and sync job from worker
Start and stop ML Sync job on app start, login and logout
2021-12-12 23:12:18 +05:30
Shailesh Pandit
470f9fb931
Move machine learning types to types folder
2021-12-08 12:43:51 +05:30
Shailesh Pandit
4d89e7df96
Revert comented ffmpeg code
...
As not required after common upload types are extracted out
2021-12-08 12:22:12 +05:30
Shailesh Pandit
d65de21be5
Merge branch 'upload-types-refactor' into machine-learning
2021-12-08 11:59:07 +05:30
Shailesh Pandit
d5199acc43
Extract common types in upload service to upload types
...
Required for not including code required for upload service in other parts just requiring common types
e.g. ffmpegService is included in machine learning web worker while including downloadManager service
2021-12-08 11:53:34 +05:30
Shailesh Pandit
28b77bcf0a
Merge branch 'master' into machine-learning
2021-12-07 18:41:29 +05:30
abhinavkgrd
3b157731a8
Merge pull request #260 from ente-io/batch-edit-243
...
Enable batch edit of creation-time for 243
2021-12-03 12:16:41 +05:30
Vishnu Mohandas
79046cc694
Enable batch edit of creation-time for 243
2021-12-03 10:08:54 +05:30
Shailesh Pandit
39386941f5
Sync people index only after new files are synced
...
Maintain files and people latest versions
2021-12-01 19:21:02 +05:30
Shailesh Pandit
498603eb34
Clear tf memory usage after each sync run
2021-12-01 19:00:57 +05:30
Shailesh Pandit
7bfddfedce
Handle async updates in PeopleList
2021-12-01 11:18:36 +05:30
abhinavkgrd
aa49c8a775
Merge pull request #257 from ente-io/error-handling
...
fix getUnixTime failure Error handling
2021-11-30 11:45:34 +05:30
Abhinav
a0708ac3f8
log dateTime value on getUNIXTime fail
2021-11-30 11:15:36 +05:30
Abhinav
0e57c8830b
fail safe error handling
2021-11-30 11:14:33 +05:30