Commit graph

936 commits

Author SHA1 Message Date
Abhinav 1f3734b577 fix isFileHEIC check 2021-11-29 12:09:21 +05:30
Abhinav 9e3c294775 check in memory cache for thumbnail before hitting browser cache 2021-11-29 12:08:53 +05:30
Abhinav f997c7457a use converted suffix instead of forPreview to to avoid duplicate download of unconverted files 2021-11-29 11:18:28 +05:30
Abhinav f688d620cc prevent duplicate file download calls 2021-11-29 10:42:46 +05:30
Shailesh Pandit 1d41644ac8 Add people to search, filter photos by person 2021-11-28 21:45:44 +05:30
Shailesh Pandit af130f803b Set person face chip to one having max pixels
And detection probability score
2021-11-28 11:28:13 +05:30
Shailesh Pandit e96e1a9ee4 Show people face chips in info panel of image 2021-11-28 11:17:56 +05:30
Shailesh Pandit 52b20c9783 Rename personId to id 2021-11-27 15:40:29 +05:30
Shailesh Pandit 320099df59 Sync people from generated clusters
Update personId in faces
2021-11-27 15:31:03 +05:30
Shailesh Pandit 83e21d7aab Fix build, better naming, disable tsne 2021-11-27 11:34:26 +05:30
Shailesh Pandit 0d72fccd7a Streamline clustering config and service
Fix tsne
MLDebug to have start and stop ml sync
2021-11-27 09:55:39 +05:30
Shailesh Pandit 8d6ec08d08 Run clustering on all faces in db 2021-11-26 20:31:34 +05:30
Shailesh Pandit b4ad482431 Process new and outdated files in ml sync 2021-11-26 19:59:13 +05:30
Shailesh Pandit 1f0853debd Run ml-worker batches continuously
Persist versioned faces in indexdb
2021-11-25 22:08:28 +05:30
abhinavkgrd 4c30c45724
Merge pull request #249 from ente-io/ffmpeg-load-fail-handling
ffmpeg load fail handling
2021-11-25 12:11:53 +05:30
abhinavkgrd 863b814d88
Merge pull request #237 from ente-io/fix-file-type-not-logged
missed a place where type info was not logged
2021-11-25 11:55:19 +05:30
Abhinav 7f8d2b84c8 clear failed ffmpeg instance..so new load is trigerred 2021-11-25 11:28:16 +05:30
Abhinav 62a761e5ca handle missing key or token 2021-11-23 09:45:19 +05:30
Shailesh Pandit 9068b5643a Limit tsne to 200 faces
As it takes exponential time and 200 faces is enough for analysis
2021-11-22 11:49:05 +05:30
Shailesh Pandit d16837262d Use arcface alignment for mobilefacenet
Use rotation alignment in blazeface to fapi flow
Extract aligned face images before embeddings calculations
2021-11-20 14:56:36 +05:30
Abhinav e13787df7a only pass non trashed file user files for search 2021-11-20 12:15:51 +05:30
Abhinav 8929f235e7 improve error handling 2021-11-20 12:06:25 +05:30
Abhinav b928052165 make fix creation time visible to array of userIds 2021-11-19 00:25:11 +05:30
Abhinav 18c6edab2c null check 2021-11-19 00:25:11 +05:30
Abhinav b2162c4398 add options for fix creation time 2021-11-19 00:24:47 +05:30
Abhinav 2b7e5f2074 one more place with same issue 2021-11-18 10:12:19 +05:30
abhinavkgrd e913615f57
Merge pull request #221 from ente-io/fix-creation-time
Fix creation time
2021-11-17 22:26:16 +05:30
Shailesh Pandit eeec2d1012 Make TFJSFaceEmbeddingService api compatible 2021-11-17 16:42:55 +05:30
Shailesh Pandit 0380fb64e3 Create worker env for face-api without global patch 2021-11-17 16:41:45 +05:30
Abhinav d62739e259 show fix creation for selected user 2021-11-17 15:10:09 +05:30
Shailesh Pandit 3764e67709 Add required face-api.js files to work with latest tfjs 2021-11-17 14:14:43 +05:30
Shailesh Pandit 4171e8cb3a Use blazeface for detection, face-api for alignment and embeddings 2021-11-17 14:01:30 +05:30
Abhinav 8ad2d3f23f skip non image file before downoading itself 2021-11-17 13:51:21 +05:30
Abhinav 0c23ace8ff remove redundant code 2021-11-17 13:29:46 +05:30
Abhinav f8de2f21c7 move setProgressTracker to finally block for any case update 2021-11-17 13:16:29 +05:30
Abhinav 80aa50b8fb only try to parse image exif 2021-11-17 13:11:33 +05:30
Abhinav 80fda73a79 move fix CreationTime option to selectionOption bar 2021-11-16 12:27:23 +05:30
Abhinav f94322ddef log the exifparsing inside getExifData itself 2021-11-16 11:40:46 +05:30
Shailesh Pandit cbaba79db9 Use hdbscan debug info to visualize mst tree 2021-11-14 16:30:23 +05:30
Abhinav e8aa6141dd bubble up error to caller from queue processor 2021-11-13 12:50:37 +05:30
Shailesh Pandit afa8fc2a81 Use hdbscan implemented following scikit-learn package 2021-11-13 10:41:32 +05:30
Neeraj Gupta ad11422034
Merge pull request #220 from ente-io/fix-file-type-not-logged
fix file type not logged on image thumbnail generation fail
2021-11-12 10:50:47 +05:30
Abhinav 88f643192c fix getExifData breaking for some files 2021-11-10 14:53:23 +05:30
Abhinav c47d24eb8c removed unneccessary getExifDataFromURL 2021-11-10 14:52:40 +05:30
Abhinav 3d3213e989 replace exif only if creationTime different than exif 2021-11-10 13:47:21 +05:30
Abhinav 76842b92a6 Merge branch 'master' into fix-creation-time 2021-11-10 12:50:34 +05:30
Vishnu Mohandas 46b7bada93
Merge pull request #219 from ente-io/fix-collection-sort 2021-11-10 12:41:30 +05:30
Abhinav 4b27ed4fd5 updated info object key from type to fileFormat , as sentry does not recognise type as valid property name for some reason 2021-11-10 12:14:56 +05:30
Abhinav 270c43521d better solution to avoid saving merged metadata to local storage 2021-11-10 10:21:29 +05:30
Shailesh Pandit 4d8c1571df Use TSNE to visualize faces over 2d plot 2021-11-09 19:16:52 +05:30
Abhinav 3c5e74f16d update the files array so that returned files from the function is sorted as the caller expect sorted files and use spread operator so that deep copy of file is used to set state to avoid #212 problem 2021-11-09 17:08:27 +05:30
Abhinav ebe839acf0 Merge branch 'master' into update-file-title 2021-11-09 15:46:12 +05:30
Shailesh Pandit 4bd52d53ee Use HDBSCAN for clustering and visualize results 2021-11-07 19:09:39 +05:30
Shailesh Pandit 48388aa125 Use centroid of cluster as summary
Increase face detection minConfidence
2021-11-07 07:39:28 +05:30
Shailesh Pandit 0ed8df8c17 Make maxFaceDistance configurable 2021-11-06 14:26:12 +05:30
Shailesh Pandit 15fcfbde44 Distribute noise to nearest initial clusters if distance is within limit 2021-11-06 14:03:12 +05:30
Shailesh Pandit dbb5e99fda Restrict face distance further 2021-11-06 11:27:07 +05:30
Shailesh Pandit 833f25e07f Add batch size, return all info to derive face images later
Required to reduce worker -> caller payload size later
2021-11-06 10:59:05 +05:30
Shailesh Pandit 4a94ecbbed Clean tf memory after usage 2021-11-06 09:34:44 +05:30
Shailesh Pandit 0db387cdb1 Tweak default parameters based on initial results 2021-11-05 22:05:10 +05:30
Shailesh Pandit a5453b8858 Add minFaceSize to limit small faces 2021-11-05 21:44:38 +05:30
Shailesh Pandit 6fb22e429c Testing with face face-api.js 2021-11-05 20:56:41 +05:30
Shailesh Pandit 41aad5e205 Add Dlib alignment and other clustering methods 2021-11-05 20:35:23 +05:30
Abhinav b47cf3b1fa await for fetchUploadURLs 2021-11-05 18:36:25 +05:30
Shailesh Pandit e5597dc017 Get only unique files for ml sync 2021-11-05 14:03:23 +05:30
Abhinav 91825db617 Merge branch 'master' into update-file-title 2021-11-05 13:26:12 +05:30
Shailesh Pandit 4d1f8d28ac Undo changes which got removed 2021-11-05 11:24:10 +05:30
Abhinav 80ba92c98c dont export getCollectionLastSyncTime 2021-11-04 19:25:19 +05:30
Abhinav 7444ad183e dont set files directly to state, use a copy 2021-11-04 19:01:02 +05:30
Abhinav d2ee821977 refactored getCollectionLastSyncTime 2021-11-04 18:53:35 +05:30
Abhinav 8d79b443fe add setLocalFile and remove appendPhotoSwipeProps funcitons 2021-11-04 18:46:04 +05:30
Shailesh Pandit aeccc14d3c Make clusterFaceDistance and minClusterSize configurable on ml debug page 2021-11-04 18:23:41 +05:30
Shailesh Pandit 15707f8344 WIP: hacks to ignore dom access from web worker 2021-11-04 17:41:37 +05:30
Shailesh Pandit 955e2e965f Add dbscan clustering 2021-11-04 17:01:00 +05:30
Shailesh Pandit 6d126e1569 Run face detection and embeddings on all local files 2021-11-04 16:48:10 +05:30
Shailesh Pandit 551e91d278 Add TFJSFaceEmbeddingService and tflite model
Set wasm path
2021-11-04 16:35:09 +05:30
Shailesh Pandit 9c70801a16 Add tfjs wasm files, set wasm files path 2021-11-04 16:31:56 +05:30
Shailesh Pandit 2f767ed83f Add TFJSFaceDetectionService 2021-11-04 16:11:07 +05:30
Shailesh Pandit 377400228a Machine learning worker
Call machine learning service inside a worker
ML Debug page to trigger worker
2021-11-04 15:18:30 +05:30
Vishnu Mohandas 8f77bda4c6
Merge pull request #210 from ente-io/update-change-creation-time-ui
Update change creation time UI
2021-11-03 22:02:52 +05:30
Abhinav e573a7f180 fix file not found chrome error 2021-11-03 21:24:46 +05:30
Abhinav 4c5df92e51 add max and min time limit 2021-11-03 20:06:00 +05:30
Abhinav e6a3ac35ee Merge branch 'master' into fix-creation-time 2021-11-03 16:05:32 +05:30
Abhinav 5095bde562 adds updateCreationTimeWithExif script 2021-11-03 16:03:01 +05:30
Vishnu Mohandas d8eb2231be
Merge pull request #207 from ente-io/migrate-trashed-file-thumbnail
migrate trashFiles thumbnail too
2021-11-03 15:53:23 +05:30
Abhinav 801de8f3cc add log if all large thumbnail are not present locally 2021-11-02 21:05:23 +05:30
Abhinav ee67921a75 migrate trashFiles thumbnail too 2021-11-02 20:59:31 +05:30
Abhinav af302f6980 send fileType info with exif data missing logs 2021-11-02 20:50:07 +05:30
Abhinav 99169e407a correct lower limit edited time 2021-11-02 14:10:03 +05:30
Abhinav f43e2cf6d6 added file name charcter limit 2021-11-02 13:21:00 +05:30
Abhinav 0263e5cb38 ad change file title logic 2021-11-02 13:05:41 +05:30
Abhinav 3eaf583f7b return upated file as updateMagicMetadata response 2021-11-02 12:22:38 +05:30
Abhinav 916e84c58e reafactor code 2021-11-02 11:52:13 +05:30
Abhinav 5b95215e07 mergeMetadata before every setFiles call 2021-11-02 11:13:35 +05:30
Abhinav 9603fba46c adds max and min date limit 2021-11-01 23:53:34 +05:30
Abhinav 4b3e9f9e08 Merge branch 'master' into update-creation-time 2021-11-01 22:37:55 +05:30
Abhinav d9fae0bf5d Merge branch 'master' into update-creation-time 2021-10-31 19:25:21 +05:30
Abhinav df0bfd0c2b fix update magic metadata 2021-10-30 20:39:52 +05:30
Abhinav ebccb6a981 merge metadatas before sorting 2021-10-30 20:35:45 +05:30
Abhinav dc794090a6 update pubMagicMetadat prop name from creationTime to editedTime 2021-10-30 19:02:17 +05:30