Commit graph

2524 commits

Author SHA1 Message Date
Abhinav 6ba24037e1 add download logic 2021-11-27 15:40:15 +05:30
Shailesh Pandit 320099df59 Sync people from generated clusters
Update personId in faces
2021-11-27 15:31:03 +05:30
Abhinav 97b9ac0626 add download all button 2021-11-27 13:23:05 +05:30
Shailesh Pandit 83e21d7aab Fix build, better naming, disable tsne 2021-11-27 11:34:26 +05:30
Shailesh Pandit 0d72fccd7a Streamline clustering config and service
Fix tsne
MLDebug to have start and stop ml sync
2021-11-27 09:55:39 +05:30
Shailesh Pandit 8d6ec08d08 Run clustering on all faces in db 2021-11-26 20:31:34 +05:30
Shailesh Pandit b4ad482431 Process new and outdated files in ml sync 2021-11-26 19:59:13 +05:30
Vishnu Mohandas 935f480b04
Merge pull request #250 from ente-io/photoswipe-error-handling
fixes photoswipe issues
2021-11-25 23:07:14 +05:30
Shailesh Pandit 1f0853debd Run ml-worker batches continuously
Persist versioned faces in indexdb
2021-11-25 22:08:28 +05:30
Abhinav 80e26b10b7 fix width and height missing from photoswipe items 2021-11-25 17:25:56 +05:30
abhinavkgrd 4c30c45724
Merge pull request #249 from ente-io/ffmpeg-load-fail-handling
ffmpeg load fail handling
2021-11-25 12:11:53 +05:30
abhinavkgrd 863b814d88
Merge pull request #237 from ente-io/fix-file-type-not-logged
missed a place where type info was not logged
2021-11-25 11:55:19 +05:30
Abhinav 7f8d2b84c8 clear failed ffmpeg instance..so new load is trigerred 2021-11-25 11:28:16 +05:30
abhinavkgrd 5e3551e8c3
Merge pull request #246 from ente-io/stripe-redirect
Stripe redirect fix
2021-11-24 14:05:36 +05:30
abhinavkgrd d1e98d17a5
Merge pull request #247 from ente-io/fix-multi-folder-detection
Fix multi folder detection
2021-11-24 13:51:43 +05:30
Abhinav ca86255bd3 use app context instead of locl storage key 2021-11-23 17:55:04 +05:30
Abhinav 18878ec240 remove console logs 2021-11-23 17:24:58 +05:30
Abhinav e204fb2aef fix multiple folder detection 2021-11-23 17:24:58 +05:30
Abhinav 7bd3a4ad42 Revert "preserve other query param during collection url set"
This reverts commit 4d5fae1591.
2021-11-23 10:44:56 +05:30
Abhinav 62a761e5ca handle missing key or token 2021-11-23 09:45:19 +05:30
Abhinav f592a04ad2 prevent router loop 2021-11-23 09:40:19 +05:30
Abhinav cb3775c690 dont need shallow update 2021-11-23 00:01:42 +05:30
Abhinav 0c8ad4b67c wait for router ready before checkSubscriptionPurchase 2021-11-22 22:59:34 +05:30
Abhinav 4bdbc36b25 fix change 2021-11-22 22:32:30 +05:30
Abhinav 97a3eef465 preserve rest queryParam after checkSubscriptionPurchase 2021-11-22 22:10:05 +05:30
Abhinav 4d5fae1591 preserve other query param during collection url set 2021-11-22 22:09:25 +05:30
Abhinav 879ab66c08 save redirectURL in localStorage before auth redirect 2021-11-22 21:54:32 +05:30
Shailesh Pandit 986f514cba Hide clustering params not used in hdbscan 2021-11-22 11:53:59 +05:30
Shailesh Pandit 9068b5643a Limit tsne to 200 faces
As it takes exponential time and 200 faces is enough for analysis
2021-11-22 11:49:05 +05:30
Shailesh Pandit d16837262d Use arcface alignment for mobilefacenet
Use rotation alignment in blazeface to fapi flow
Extract aligned face images before embeddings calculations
2021-11-20 14:56:36 +05:30
Abhinav e13787df7a only pass non trashed file user files for search 2021-11-20 12:15:51 +05:30
Abhinav 8929f235e7 improve error handling 2021-11-20 12:06:25 +05:30
Abhinav b95be7bf06 fix style 2021-11-19 02:21:10 +05:30
Abhinav e3aa37c09e update copy 2021-11-19 01:50:59 +05:30
Abhinav 56791e2c91 update layout 2021-11-19 01:36:58 +05:30
Abhinav 60fef97f7b update copies 2021-11-19 01:34:54 +05:30
Abhinav db92ac123f update string 2021-11-19 00:59:56 +05:30
Abhinav 8d6b889126 fix date selector width 2021-11-19 00:49:39 +05:30
Abhinav b928052165 make fix creation time visible to array of userIds 2021-11-19 00:25:11 +05:30
Abhinav 18c6edab2c null check 2021-11-19 00:25:11 +05:30
Abhinav aca752f00e refactor component 2021-11-19 00:25:11 +05:30
Abhinav b2162c4398 add options for fix creation time 2021-11-19 00:24:47 +05:30
Abhinav 91cbbfc3eb refactor date picker into seperate component 2021-11-18 22:20:53 +05:30
Abhinav 2b7e5f2074 one more place with same issue 2021-11-18 10:12:19 +05:30
abhinavkgrd e913615f57
Merge pull request #221 from ente-io/fix-creation-time
Fix creation time
2021-11-17 22:26:16 +05:30
Shailesh Pandit eeec2d1012 Make TFJSFaceEmbeddingService api compatible 2021-11-17 16:42:55 +05:30
Shailesh Pandit 0380fb64e3 Create worker env for face-api without global patch 2021-11-17 16:41:45 +05:30
Abhinav d62739e259 show fix creation for selected user 2021-11-17 15:10:09 +05:30
Shailesh Pandit 3764e67709 Add required face-api.js files to work with latest tfjs 2021-11-17 14:14:43 +05:30
Shailesh Pandit 4171e8cb3a Use blazeface for detection, face-api for alignment and embeddings 2021-11-17 14:01:30 +05:30
Abhinav 8ad2d3f23f skip non image file before downoading itself 2021-11-17 13:51:21 +05:30
Abhinav bb9c82db52 remove unused LS_KEYS 2021-11-17 13:36:23 +05:30
Abhinav 0c23ace8ff remove redundant code 2021-11-17 13:29:46 +05:30
Abhinav 84617a3267 trigger popper open only if attributes not null 2021-11-17 13:17:21 +05:30
Abhinav f8de2f21c7 move setProgressTracker to finally block for any case update 2021-11-17 13:16:29 +05:30
Abhinav 80aa50b8fb only try to parse image exif 2021-11-17 13:11:33 +05:30
Abhinav d15cef404d update strings 2021-11-17 13:05:41 +05:30
Abhinav 29ecff60d6 reorder selection bar icons 2021-11-17 10:29:40 +05:30
Abhinav ff58e8900d clear selection after trigerring fix creation 2021-11-17 10:22:30 +05:30
Abhinav 70b3e59fbf add fix time icon 2021-11-16 17:55:19 +05:30
Abhinav 638dab4421 fix setting fixState on modal open 2021-11-16 13:08:25 +05:30
Abhinav 80fda73a79 move fix CreationTime option to selectionOption bar 2021-11-16 12:27:23 +05:30
Abhinav f94322ddef log the exifparsing inside getExifData itself 2021-11-16 11:40:46 +05:30
Neeraj Gupta 9529521af4
Merge pull request #232 from ente-io/mnemonic
Add support to show mnemonic recovery key
2021-11-16 11:25:36 +05:30
Neeraj Gupta e1b683734b
Handle mneomonic recovery code during 2FA recover 2021-11-15 21:39:32 +05:30
Shailesh Pandit cbaba79db9 Use hdbscan debug info to visualize mst tree 2021-11-14 16:30:23 +05:30
Abhinav e8aa6141dd bubble up error to caller from queue processor 2021-11-13 12:50:37 +05:30
Shailesh Pandit afa8fc2a81 Use hdbscan implemented following scikit-learn package 2021-11-13 10:41:32 +05:30
Neeraj Gupta 9b333807a2
Add support to show mnemonic recovery key 2021-11-13 00:23:05 +05:30
Abhinav ab73e7f8a9 Merge branch 'master' into close-for-without-edit 2021-11-12 10:53:38 +05:30
Neeraj Gupta ad11422034
Merge pull request #220 from ente-io/fix-file-type-not-logged
fix file type not logged on image thumbnail generation fail
2021-11-12 10:50:47 +05:30
Abhinav 07591fe30d update creation Time copies 2021-11-12 10:39:36 +05:30
Abhinav 04ab5a1651 dont create inline function for startFix 2021-11-10 15:02:36 +05:30
Abhinav 088d7e2156 sync after fix creation time completion 2021-11-10 14:55:29 +05:30
Abhinav 88f643192c fix getExifData breaking for some files 2021-11-10 14:53:23 +05:30
Abhinav c47d24eb8c removed unneccessary getExifDataFromURL 2021-11-10 14:52:40 +05:30
Abhinav 3d3213e989 replace exif only if creationTime different than exif 2021-11-10 13:47:21 +05:30
Abhinav 87089eec43 adds logic to refresh state on repen 2021-11-10 13:46:16 +05:30
Abhinav 76842b92a6 Merge branch 'master' into fix-creation-time 2021-11-10 12:50:34 +05:30
Vishnu Mohandas 46b7bada93
Merge pull request #219 from ente-io/fix-collection-sort 2021-11-10 12:41:30 +05:30
Abhinav 4b27ed4fd5 updated info object key from type to fileFormat , as sentry does not recognise type as valid property name for some reason 2021-11-10 12:14:56 +05:30
Abhinav 270c43521d better solution to avoid saving merged metadata to local storage 2021-11-10 10:21:29 +05:30
Abhinav 15f12a6f8e fix filename spliting 2021-11-09 22:33:09 +05:30
Shailesh Pandit 4d8c1571df Use TSNE to visualize faces over 2d plot 2021-11-09 19:16:52 +05:30
Abhinav 3c5e74f16d update the files array so that returned files from the function is sorted as the caller expect sorted files and use spread operator so that deep copy of file is used to set state to avoid #212 problem 2021-11-09 17:08:27 +05:30
Abhinav b225b4ff35 simpley close date edit if saved without edit 2021-11-09 16:06:12 +05:30
Abhinav 1dc5ecb061 minor improvments 2021-11-09 15:59:37 +05:30
Abhinav ebe839acf0 Merge branch 'master' into update-file-title 2021-11-09 15:46:12 +05:30
Abhinav d807828b77 remove valid file extension detection logic 2021-11-09 15:43:10 +05:30
Abhinav 4f3faf3d78 use formik for file name update form state management 2021-11-09 15:32:27 +05:30
Abhinav aa90e897b4 update EnteSpinner to use props passed to it 2021-11-09 15:31:09 +05:30
Abhinav 40846245ff break long file name 2021-11-08 12:49:04 +05:30
Abhinav d8bb91a7e1 Merge branch 'master' into update-file-title 2021-11-08 12:28:24 +05:30
Shailesh Pandit 4bd52d53ee Use HDBSCAN for clustering and visualize results 2021-11-07 19:09:39 +05:30
Shailesh Pandit 48388aa125 Use centroid of cluster as summary
Increase face detection minConfidence
2021-11-07 07:39:28 +05:30
Shailesh Pandit 0ed8df8c17 Make maxFaceDistance configurable 2021-11-06 14:26:12 +05:30
Shailesh Pandit 15fcfbde44 Distribute noise to nearest initial clusters if distance is within limit 2021-11-06 14:03:12 +05:30
Shailesh Pandit dbb5e99fda Restrict face distance further 2021-11-06 11:27:07 +05:30
Shailesh Pandit 833f25e07f Add batch size, return all info to derive face images later
Required to reduce worker -> caller payload size later
2021-11-06 10:59:05 +05:30
Shailesh Pandit 4a94ecbbed Clean tf memory after usage 2021-11-06 09:34:44 +05:30
Shailesh Pandit 0db387cdb1 Tweak default parameters based on initial results 2021-11-05 22:05:10 +05:30
Shailesh Pandit a5453b8858 Add minFaceSize to limit small faces 2021-11-05 21:44:38 +05:30
Shailesh Pandit 6fb22e429c Testing with face face-api.js 2021-11-05 20:56:41 +05:30
Shailesh Pandit 41aad5e205 Add Dlib alignment and other clustering methods 2021-11-05 20:35:23 +05:30
Abhinav b47cf3b1fa await for fetchUploadURLs 2021-11-05 18:36:25 +05:30
Shailesh Pandit e5597dc017 Get only unique files for ml sync 2021-11-05 14:03:23 +05:30
Abhinav 91825db617 Merge branch 'master' into update-file-title 2021-11-05 13:26:12 +05:30
Shailesh Pandit 4d1f8d28ac Undo changes which got removed 2021-11-05 11:24:10 +05:30
Vishnu Mohandas df60b0c6c0
Merge pull request #213 from ente-io/empty-trash-changes
Empty trash changes
2021-11-04 19:57:11 +05:30
Abhinav 80ba92c98c dont export getCollectionLastSyncTime 2021-11-04 19:25:19 +05:30
Abhinav 7444ad183e dont set files directly to state, use a copy 2021-11-04 19:01:02 +05:30
Abhinav d2ee821977 refactored getCollectionLastSyncTime 2021-11-04 18:53:35 +05:30
Abhinav 8d79b443fe add setLocalFile and remove appendPhotoSwipeProps funcitons 2021-11-04 18:46:04 +05:30
Shailesh Pandit aeccc14d3c Make clusterFaceDistance and minClusterSize configurable on ml debug page 2021-11-04 18:23:41 +05:30
Shailesh Pandit 15707f8344 WIP: hacks to ignore dom access from web worker 2021-11-04 17:41:37 +05:30
Shailesh Pandit d9fa4a6804 Display clusters and noise on ml debug page 2021-11-04 17:06:15 +05:30
Shailesh Pandit 955e2e965f Add dbscan clustering 2021-11-04 17:01:00 +05:30
Shailesh Pandit 6d126e1569 Run face detection and embeddings on all local files 2021-11-04 16:48:10 +05:30
Shailesh Pandit 551e91d278 Add TFJSFaceEmbeddingService and tflite model
Set wasm path
2021-11-04 16:35:09 +05:30
Shailesh Pandit 9c70801a16 Add tfjs wasm files, set wasm files path 2021-11-04 16:31:56 +05:30
Shailesh Pandit 2f767ed83f Add TFJSFaceDetectionService 2021-11-04 16:11:07 +05:30
Shailesh Pandit 377400228a Machine learning worker
Call machine learning service inside a worker
ML Debug page to trigger worker
2021-11-04 15:18:30 +05:30
Vishnu Mohandas 8f77bda4c6
Merge pull request #210 from ente-io/update-change-creation-time-ui
Update change creation time UI
2021-11-03 22:02:52 +05:30
Vishnu Mohandas 7f88324a03
Merge pull request #211 from ente-io/fix-file-not-found
fix file not found chrome error
2021-11-03 21:58:25 +05:30
Abhinav e573a7f180 fix file not found chrome error 2021-11-03 21:24:46 +05:30
Abhinav 4c5df92e51 add max and min time limit 2021-11-03 20:06:00 +05:30
Abhinav 70fc35549b update style and remove button from calender 2021-11-03 19:11:11 +05:30
Abhinav 9afe465e91 updated tick icon 2021-11-03 19:07:46 +05:30
Abhinav 425cf21f28 redirect to all section after empty trash 2021-11-03 17:03:24 +05:30
Abhinav df23ea80d7 upadated strings 2021-11-03 17:03:12 +05:30
Abhinav 3eb6f68da0 highlight all in range 2021-11-03 16:59:23 +05:30
Abhinav 040776bb07 fire select event only for items between the ends as they are already selected by click 2021-11-03 16:58:51 +05:30
Abhinav 49e3fa00f0 select file on click even if range select is active 2021-11-03 16:57:46 +05:30
Abhinav 5a879f50ae fix range start nulled on selected second item 2021-11-03 16:30:08 +05:30
Abhinav e6a3ac35ee Merge branch 'master' into fix-creation-time 2021-11-03 16:05:32 +05:30
Abhinav 51923850cb update string constant name for fix large thumbnail 2021-11-03 16:05:01 +05:30
Abhinav e052da48ff adds Fix creationTime UI 2021-11-03 16:04:11 +05:30
Abhinav 5095bde562 adds updateCreationTimeWithExif script 2021-11-03 16:03:01 +05:30
Vishnu Mohandas d8eb2231be
Merge pull request #207 from ente-io/migrate-trashed-file-thumbnail
migrate trashFiles thumbnail too
2021-11-03 15:53:23 +05:30
Vishnu Mohandas 8ccb74d2a4
Merge pull request #208 from ente-io/download-mobile-app-banner
fixed install mobile app banner not shown on empty screen
2021-11-03 15:50:56 +05:30
Abhinav b372c3892b fixed install mobile app banner not shown on empty screen 2021-11-02 21:36:14 +05:30
Abhinav 801de8f3cc add log if all large thumbnail are not present locally 2021-11-02 21:05:23 +05:30
Abhinav ee67921a75 migrate trashFiles thumbnail too 2021-11-02 20:59:31 +05:30
Abhinav af302f6980 send fileType info with exif data missing logs 2021-11-02 20:50:07 +05:30
Abhinav-grd acbb9498b4
Merge pull request #198 from ente-io/web-perf
Web perf
2021-11-02 20:24:56 +05:30
Abhinav 99169e407a correct lower limit edited time 2021-11-02 14:10:03 +05:30
Abhinav dbe5554373 close edit mode if saved without changes 2021-11-02 14:06:15 +05:30
Abhinav f43e2cf6d6 added file name charcter limit 2021-11-02 13:21:00 +05:30
Abhinav 70c175a10b update FIle name Ui to have edit option 2021-11-02 13:06:04 +05:30
Abhinav 0263e5cb38 ad change file title logic 2021-11-02 13:05:41 +05:30