beenull/ente
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
3322 commits 18 branches 104 tags 490 MiB
Commit graph

2890 commits

Author SHA1 Message Date
Abhinav 2044f4f6cf remove unneccsary console log 2022-01-06 12:15:13 +05:30
Abhinav bf6a0ef7cc fix double counting selected items if new and previous range select overlap 2022-01-06 12:14:18 +05:30
Abhinav 14b1e59c90 abstract SmallLoadingSpinner 2022-01-06 10:21:08 +05:30
Abhinav 3c4a0f7b6a add loading spinner during creation udpate api call 2022-01-06 10:11:33 +05:30
Shailesh Pandit 2b5aafa0bc Rename blazeface and mobilefacenet services 2022-01-06 07:22:05 +05:30
Shailesh Pandit 19c3654926 Rename tfjs face detection and embedding service files 2022-01-06 07:20:29 +05:30
Shailesh Pandit 19aae1a75b Refactor interfaces 
Use composition to store face analysis results
Add face id to stored face
 2022-01-06 06:49:08 +05:30
Abhinav b752b77c26 Merge branch 'master' into upload-types-refactor 2022-01-05 16:36:39 +05:30
Shailesh Pandit 1a41c7c194 Fix getUnidentifiedFaces for empty face crops 2022-01-05 14:43:25 +05:30
Shailesh Pandit b88ccee6ed Update files version after syncLocalFiles 2022-01-05 14:39:55 +05:30
Shailesh Pandit be476995b2 Remove one time migration for face crops 2022-01-05 14:15:49 +05:30
Shailesh Pandit 2f3d06cb4d Migrate face crops from indexdb to cache 2022-01-05 13:54:21 +05:30
Abhinav 9e099d4e67 moved queueProcessor to service directory 2022-01-05 13:28:24 +05:30
Abhinav e4f649c467 refactor upload service constants and types 2022-01-05 13:27:10 +05:30
Abhinav 2faade0d42 move KEK interface to types 2022-01-05 13:05:18 +05:30
Abhinav 344d2b2c0c move ProgressUpdater interface to UIService 2022-01-05 13:00:29 +05:30
Abhinav 7285af6977 keep NULL_LOCATION along with Location type defination 2022-01-05 12:50:10 +05:30
Abhinav 44bc3916a5 move isDataStream type check util function to types/upload 2022-01-05 12:46:57 +05:30
Abhinav caef21f939 merge types/user imports 2022-01-05 12:41:16 +05:30
Abhinav 63960c207b fix User import 2022-01-05 12:40:36 +05:30
Abhinav a5849600b1 move errorUtil from utils/common to utils/error 2022-01-05 12:25:48 +05:30
Abhinav b00d7ea2b0 move file enums to constants/file 2022-01-05 12:18:46 +05:30
Abhinav 9e0fef4743 move export enums to constants/export 2022-01-05 12:14:22 +05:30
Shailesh Pandit 2471a57b3b Store face crops in cache to reduce io 
when updating indexeddb
 2022-01-05 12:12:24 +05:30
Abhinav ce22425be9 move collection enum to constants/collection 2022-01-05 12:11:32 +05:30
Abhinav 11e990ffe9 move file constants to constants/file 2022-01-04 17:27:19 +05:30
Abhinav 8a96b73b37 moved export constants to constants/export 2022-01-04 17:19:14 +05:30
Abhinav 88ea78ebb3 dont export constants used only in one file 2022-01-04 17:14:34 +05:30
Abhinav 8f0a0d3f18 fix FIX_CREATION_TIME_VISIBLE_TO_USER_IDS import 2022-01-04 17:12:43 +05:30
Abhinav 9b48275144 moved upload constants to constants/upload 2022-01-04 17:12:29 +05:30
Abhinav eddfbed37c moved user constants to constants/user 2022-01-04 16:57:57 +05:30
Abhinav 5a84003388 move collection constants to constants/collection 2022-01-04 16:54:39 +05:30
Abhinav dfdf2897d4 move constants from util to src directory and split into sub folders 2022-01-04 16:50:54 +05:30
Abhinav b10a43b3a8 move gallery related types to types/gallery 2022-01-04 16:27:59 +05:30
Abhinav f30a5103bc renamed types to util/constants 2022-01-04 16:19:58 +05:30
Abhinav 41b8ed55a2 moved user related types to types/user 2022-01-04 16:09:42 +05:30
Abhinav 4011b6fbe8 move trash related types to types/trash 2022-01-04 15:51:35 +05:30
Abhinav 79f6ebc454 moved search related types to types/search 2022-01-04 15:48:33 +05:30
Abhinav b5b31a8350 move non exported constant back to origin file 2022-01-04 15:36:16 +05:30
Abhinav aba964922e moved file related types to types/file 2022-01-04 15:20:14 +05:30
Abhinav f8af3a9a39 moved export types to types/export 2022-01-04 14:21:47 +05:30
Abhinav 2aba5cb058 moved collection related types to types/collection 2022-01-04 14:17:38 +05:30
Abhinav 1a1c4d145c created types for billing and renamed billingUtil to billing/index 2022-01-04 14:05:41 +05:30
Shailesh Pandit 8ab7dc38e1 Ignore empty faces in AllFacesMap 2022-01-04 13:54:07 +05:30
Shailesh Pandit 68a976f628 Revert one time migration 2022-01-04 13:26:22 +05:30
Shailesh Pandit 86b2efbdd6 Fix migration for one time run 2022-01-04 13:07:34 +05:30
abhinavkgrd 1d0aa42630
Merge pull request #273 from ente-io/web-security-clean 
harden web security
 2022-01-04 13:03:09 +05:30
Abhinav 530f40f5a0 Merge branch 'master' into upload-types-refactor 2022-01-04 12:20:28 +05:30
Shailesh Pandit 4cb552046a Use IndexedDB without forage to use indexes 2022-01-04 11:26:16 +05:30
Abhinav 9acb76795e fix sentry tunnel URL 2022-01-03 15:33:08 +05:30
Shailesh Pandit fa7453323d Remove unnecessary sorting while getting out of sync files 
Add timing logs to getPeopleList and getOutOfSyncFiles
 2022-01-03 15:02:48 +05:30
Shailesh Pandit fb402e9b69 Sync deleted files, remove ml data for them 
Reset sync job backoff on local file updates
 2022-01-03 10:06:30 +05:30
Shailesh Pandit 2cb9ebf402 Exponential back off for ml sync job 2022-01-03 08:05:00 +05:30
Shailesh Pandit b9d32cc1e6 Dispose sync context in local file sync flow 2022-01-03 07:13:59 +05:30
Shailesh Pandit fc459171f4 Fix typo 2022-01-02 22:33:40 +05:30
Shailesh Pandit 502a023fa3 Run ml sync concurrently 2022-01-02 22:27:42 +05:30
Shailesh Pandit 86052cc393 Run face clustering using configured method 
Save face clustering results
Display noise faces on ml debug page
 2021-12-31 12:08:50 +05:30
Shailesh Pandit 30f9088c81 Show face crops and images in rows 2021-12-29 18:45:47 +05:30
Shailesh Pandit 778431d01b Normalize landmark and box thickness in ml debug 2021-12-29 17:11:46 +05:30
Shailesh Pandit 9d3bf5ce6f Detected face transforms to and from face crop 2021-12-29 12:10:11 +05:30
Shailesh Pandit 162d760b80 Use transformation-matrix package for transforms 2021-12-29 10:32:01 +05:30
Shailesh Pandit 385acec1ab Do 2nd pass of blazeface on close ups 
for better accuracy
Transform utils
 2021-12-28 20:30:52 +05:30
Shailesh Pandit 72b2a6ad8b Handle empty faces in unidentified faces 2021-12-25 14:22:38 +05:30
Shailesh Pandit 8177cd336b Show unidentified faces in info panel 
Add local file debugging info to ml debug page
showing aligned face box and landmarks and face crops
 2021-12-25 13:07:24 +05:30
Shailesh Pandit 91bd053cf5 Use face crops while calculating embeddings 
Simulate mlVersion update requiring only embeddings to be recalculated
without downloading full image
 2021-12-24 12:27:29 +05:30
Shailesh Pandit 7b06f5d8f8 imageSource not updated based on actual source 2021-12-23 23:59:49 +05:30
Shailesh Pandit 44f4362f0f Store ml sync error count for a file, limit retry 
Download original quality files for photos and live photos only
 2021-12-23 23:40:21 +05:30
Shailesh Pandit b4c31c5845 Store face crops, extract aligned faces from face crops 
Align faces using center, size and rotation only, using this aligned faces can be extracted without whole image
 2021-12-23 18:27:53 +05:30
Shailesh Pandit 4ebcddbb84 Provision to run ml sync on original images 
To capture high resolution face images
Use ImageBitmap till tf models as tf manipulations on variable dimention images leads to gpu memory leak - https://github.com/tensorflow/tfjs/issues/604
 2021-12-20 22:20:20 +05:30
Abhinav 6e62f312bf update to use ente domain url for workes instead of worker.dev cf domains 2021-12-20 15:51:24 +05:30
Abhinav 40058f0883 fix typo 2021-12-20 13:21:12 +05:30
Abhinav bff8411284 adds download collection option 2021-12-20 13:00:56 +05:30
Abhinav e066ee5ff1 added start and finish loading helper function 2021-12-20 12:59:39 +05:30
Abhinav f45fd0d0e4 fix allElectronAPIsExist intialisation 2021-12-19 15:23:36 +05:30
Abhinav 9088942e16 fix checks 2021-12-19 14:43:30 +05:30
Abhinav e2b3c157f5 renamed oldClient to better allElectronAPIsExist 2021-12-19 14:38:10 +05:30
Abhinav d814359e10 add olderClient check and use olderClient logic 2021-12-19 12:24:58 +05:30
Shailesh Pandit 0e366264a0 TF memory cleaned only with tf.dispose and tf.tidy 
Remove usage of startScope and endScope, can be used for debugging
 2021-12-15 17:20:07 +05:30
Shailesh Pandit f5ca124fc9 Only sync updated ml methods for existing files 2021-12-14 19:44:13 +05:30
Shailesh Pandit 2d17dd30e9 For uploaded files use local files for ML Sync 
Extract out ML work manager and sync job from worker
Start and stop ML Sync job on app start, login and logout
 2021-12-12 23:12:18 +05:30
Shailesh Pandit 470f9fb931 Move machine learning types to types folder 2021-12-08 12:43:51 +05:30
Shailesh Pandit 4d89e7df96 Revert comented ffmpeg code 
As not required after common upload types are extracted out
 2021-12-08 12:22:12 +05:30
Shailesh Pandit d65de21be5 Merge branch 'upload-types-refactor' into machine-learning 2021-12-08 11:59:07 +05:30
Shailesh Pandit d5199acc43 Extract common types in upload service to upload types 
Required for not including code required for upload service in other parts just requiring common types
e.g. ffmpegService is included in machine learning web worker while including downloadManager service
 2021-12-08 11:53:34 +05:30
Shailesh Pandit 28b77bcf0a Merge branch 'master' into machine-learning 2021-12-07 18:41:29 +05:30
Abhinav 9dfd2e4ba7 Merge branch 'master' into export-v2 2021-12-07 18:25:44 +05:30
Abhinav 2e92784569 add missing await to save saveMetadataFile 2021-12-07 18:17:46 +05:30
Abhinav ba1fb670e8 add old sanitizer to get oldname for migration 2021-12-07 18:15:12 +05:30
Abhinav f13549b2bf null safety 2021-12-07 18:15:12 +05:30
Abhinav 85d06fc528 fix bugs 2021-12-07 18:15:12 +05:30
Abhinav 27d9d703c7 renamed exported Collection if collection name changed 2021-12-07 16:23:56 +05:30
Abhinav 5257a91864 fix addCollectionExportedRecord calls 2021-12-07 16:02:55 +05:30
Abhinav 6074200b67 better local errors 2021-12-07 15:41:50 +05:30
Abhinav 55b2de1a53 fix collection folder creation 2021-12-07 15:41:38 +05:30
Abhinav cf09858fb7 only export user personal files 2021-12-07 14:24:28 +05:30
Abhinav 3dd90ba538 fix getUniqueFileSaveName , by providing collectionPath too for checking if file already exists at the fileSavePath 2021-12-07 14:16:37 +05:30
Abhinav c3e7578019 Merge branch 'master' into fix-queue-processing-order 2021-12-07 13:19:26 +05:30
Abhinav e925663dba make internal function private 2021-12-07 13:19:10 +05:30
Abhinav 1476e68e3c use queueProcessor to make update sequential 2021-12-07 13:14:21 +05:30
Abhinav 710ffd202b add missing await for saveFileToDisk 2021-12-07 12:56:50 +05:30
Abhinav 2424767e79 null safe variable 2021-12-07 12:54:11 +05:30
Abhinav 42817eb8d2 better function name 2021-12-07 12:53:32 +05:30
Abhinav 8be93db2db use exists electron API to remove the need of in memory used fileName and collectionName maps 2021-12-07 11:53:48 +05:30
Abhinav 7df09a17ea cleanup 2021-12-03 20:20:56 +05:30
Vishnu Mohandas 79046cc694
Enable batch edit of creation-time for 243 2021-12-03 10:08:54 +05:30
Abhinav 7969d20a76 test 2021-12-02 14:54:07 +05:30
Abhinav e5b9ad70e8 remove script hash 2021-12-02 14:47:25 +05:30
Abhinav 4b032058d7 move all directive except script-src to header 2021-12-02 14:33:36 +05:30
Abhinav 14094d1ad0 added unsafe inline as fallback to hash for script-src 2021-12-02 13:25:18 +05:30
Abhinav 25ef3a8a44 make content security active 2021-12-02 13:12:07 +05:30
Abhinav d51335b630 better formatted csp 2021-12-02 12:57:44 +05:30
Abhinav 366a283f65 move csp to meta tag in document to add inline script hash 2021-12-02 12:03:25 +05:30
Shailesh Pandit 39386941f5 Sync people index only after new files are synced 
Maintain files and people latest versions
 2021-12-01 19:21:02 +05:30
Shailesh Pandit 498603eb34 Clear tf memory usage after each sync run 2021-12-01 19:00:57 +05:30
Shailesh Pandit 7bfddfedce Handle async updates in PeopleList 2021-12-01 11:18:36 +05:30
Abhinav e9e777f5eb better function name 2021-11-30 22:51:47 +05:30
Abhinav 9dfcbacaea adds comments 2021-11-30 12:23:11 +05:30
Abhinav c84ee17a7c move version check logic to migrateExport function 2021-11-30 12:18:02 +05:30
Abhinav 13cb4338ff update sanitize name function 2021-11-30 11:57:50 +05:30
Abhinav a0708ac3f8 log dateTime value on getUNIXTime fail 2021-11-30 11:15:36 +05:30
Abhinav 0e57c8830b fail safe error handling 2021-11-30 11:14:33 +05:30
Abhinav cff0959cf3 Merge branch 'master' into export-v2 2021-11-29 14:56:22 +05:30
Abhinav c443bae39a add null check before trying to update exif with edited value 2021-11-29 14:39:11 +05:30
Abhinav 9454540175 update name to getCachedOriginalFile 2021-11-29 14:14:28 +05:30
Abhinav 3a0e6b2f98 renamed get preview to getThumbnail 2021-11-29 14:12:24 +05:30
Abhinav a1672d3c2f handle saving to cache in getPreview itself 2021-11-29 14:11:41 +05:30
Abhinav 1f3734b577 fix isFileHEIC check 2021-11-29 12:09:21 +05:30
Abhinav 9e3c294775 check in memory cache for thumbnail before hitting browser cache 2021-11-29 12:08:53 +05:30
Abhinav f997c7457a use converted suffix instead of forPreview to to avoid duplicate download of unconverted files 2021-11-29 11:18:28 +05:30
Abhinav f688d620cc prevent duplicate file download calls 2021-11-29 10:42:46 +05:30
Shailesh Pandit 1d41644ac8 Add people to search, filter photos by person 2021-11-28 21:45:44 +05:30
Shailesh Pandit af130f803b Set person face chip to one having max pixels 
And detection probability score
 2021-11-28 11:28:13 +05:30
Shailesh Pandit e96e1a9ee4 Show people face chips in info panel of image 2021-11-28 11:17:56 +05:30
Abhinav 4b93b9e9a4 only show progress bar if sync not in progress 2021-11-27 16:47:54 +05:30
Shailesh Pandit 52b20c9783 Rename personId to id 2021-11-27 15:40:29 +05:30
Abhinav 6ba24037e1 add download logic 2021-11-27 15:40:15 +05:30
Shailesh Pandit 320099df59 Sync people from generated clusters 
Update personId in faces
 2021-11-27 15:31:03 +05:30
Abhinav 97b9ac0626 add download all button 2021-11-27 13:23:05 +05:30
Shailesh Pandit 83e21d7aab Fix build, better naming, disable tsne 2021-11-27 11:34:26 +05:30
Shailesh Pandit 0d72fccd7a Streamline clustering config and service 
Fix tsne
MLDebug to have start and stop ml sync
 2021-11-27 09:55:39 +05:30
Shailesh Pandit 8d6ec08d08 Run clustering on all faces in db 2021-11-26 20:31:34 +05:30
Shailesh Pandit b4ad482431 Process new and outdated files in ml sync 2021-11-26 19:59:13 +05:30
Abhinav fe6d0c4125 merge master into export-v2 2021-11-26 12:06:58 +05:30
Abhinav 33bd80f571 fix metadata json map setting 2021-11-26 12:04:46 +05:30
Vishnu Mohandas 935f480b04
Merge pull request #250 from ente-io/photoswipe-error-handling 
fixes photoswipe issues
 2021-11-25 23:07:14 +05:30
Shailesh Pandit 1f0853debd Run ml-worker batches continuously 
Persist versioned faces in indexdb
 2021-11-25 22:08:28 +05:30
Abhinav 80e26b10b7 fix width and height missing from photoswipe items 2021-11-25 17:25:56 +05:30
abhinavkgrd 4c30c45724
Merge pull request #249 from ente-io/ffmpeg-load-fail-handling 
ffmpeg load fail handling
 2021-11-25 12:11:53 +05:30
abhinavkgrd 863b814d88
Merge pull request #237 from ente-io/fix-file-type-not-logged 
missed a place where type info was not logged
 2021-11-25 11:55:19 +05:30
Abhinav 7f8d2b84c8 clear failed ffmpeg instance..so new load is trigerred 2021-11-25 11:28:16 +05:30
abhinavkgrd 5e3551e8c3
Merge pull request #246 from ente-io/stripe-redirect 
Stripe redirect fix
 2021-11-24 14:05:36 +05:30
abhinavkgrd d1e98d17a5
Merge pull request #247 from ente-io/fix-multi-folder-detection 
Fix multi folder detection
 2021-11-24 13:51:43 +05:30
Abhinav-grd e4e58fd905 fallback to creationTime if modification time missing 2021-11-23 22:08:51 +05:30
Abhinav-grd 66eb9478aa add debug logs 2021-11-23 21:43:37 +05:30
Abhinav ca86255bd3 use app context instead of locl storage key 2021-11-23 17:55:04 +05:30
Abhinav 18878ec240 remove console logs 2021-11-23 17:24:58 +05:30
Abhinav e204fb2aef fix multiple folder detection 2021-11-23 17:24:58 +05:30
Abhinav 7bd3a4ad42 Revert "preserve other query param during collection url set" 
This reverts commit 4d5fae1591.
 2021-11-23 10:44:56 +05:30
Abhinav 62a761e5ca handle missing key or token 2021-11-23 09:45:19 +05:30
Abhinav f592a04ad2 prevent router loop 2021-11-23 09:40:19 +05:30
Abhinav cb3775c690 dont need shallow update 2021-11-23 00:01:42 +05:30
Abhinav 0c8ad4b67c wait for router ready before checkSubscriptionPurchase 2021-11-22 22:59:34 +05:30
Abhinav 4bdbc36b25 fix change 2021-11-22 22:32:30 +05:30
Abhinav 97a3eef465 preserve rest queryParam after checkSubscriptionPurchase 2021-11-22 22:10:05 +05:30
Abhinav 4d5fae1591 preserve other query param during collection url set 2021-11-22 22:09:25 +05:30
Abhinav 879ab66c08 save redirectURL in localStorage before auth redirect 2021-11-22 21:54:32 +05:30
Shailesh Pandit 986f514cba Hide clustering params not used in hdbscan 2021-11-22 11:53:59 +05:30
Shailesh Pandit 9068b5643a Limit tsne to 200 faces 
As it takes exponential time and 200 faces is enough for analysis
 2021-11-22 11:49:05 +05:30
Abhinav dcc13dc317 fix UI 2021-11-22 11:40:04 +05:30
Shailesh Pandit d16837262d Use arcface alignment for mobilefacenet 
Use rotation alignment in blazeface to fapi flow
Extract aligned face images before embeddings calculations
 2021-11-20 14:56:36 +05:30
Abhinav e13787df7a only pass non trashed file user files for search 2021-11-20 12:15:51 +05:30
Abhinav 8929f235e7 improve error handling 2021-11-20 12:06:25 +05:30
Abhinav b95be7bf06 fix style 2021-11-19 02:21:10 +05:30
Abhinav e3aa37c09e update copy 2021-11-19 01:50:59 +05:30
Abhinav 56791e2c91 update layout 2021-11-19 01:36:58 +05:30
Abhinav 60fef97f7b update copies 2021-11-19 01:34:54 +05:30
Abhinav db92ac123f update string 2021-11-19 00:59:56 +05:30
Abhinav 8d6b889126 fix date selector width 2021-11-19 00:49:39 +05:30
Abhinav b928052165 make fix creation time visible to array of userIds 2021-11-19 00:25:11 +05:30
Abhinav 18c6edab2c null check 2021-11-19 00:25:11 +05:30
Abhinav aca752f00e refactor component 2021-11-19 00:25:11 +05:30
Abhinav b2162c4398 add options for fix creation time 2021-11-19 00:24:47 +05:30
Abhinav 91cbbfc3eb refactor date picker into seperate component 2021-11-18 22:20:53 +05:30
Abhinav 2b7e5f2074 one more place with same issue 2021-11-18 10:12:19 +05:30
Abhinav 8c1e7249c6 build fix 2021-11-17 22:33:15 +05:30
abhinavkgrd e913615f57
Merge pull request #221 from ente-io/fix-creation-time 
Fix creation time
 2021-11-17 22:26:16 +05:30
Shailesh Pandit eeec2d1012 Make TFJSFaceEmbeddingService api compatible 2021-11-17 16:42:55 +05:30
Shailesh Pandit 0380fb64e3 Create worker env for face-api without global patch 2021-11-17 16:41:45 +05:30
Abhinav d62739e259 show fix creation for selected user 2021-11-17 15:10:09 +05:30
Abhinav 8d4dff4c38 fix collection unique name and file name 2021-11-17 14:54:26 +05:30
Shailesh Pandit 3764e67709 Add required face-api.js files to work with latest tfjs 2021-11-17 14:14:43 +05:30
Abhinav 2273dcdc76 adds util for getting metadata folderpath 2021-11-17 14:11:04 +05:30
Abhinav eed7f5e288 change updateFileModifyDateInEXIF to updateFileCreationDateInEXIF 2021-11-17 14:06:53 +05:30
Shailesh Pandit 4171e8cb3a Use blazeface for detection, face-api for alignment and embeddings 2021-11-17 14:01:30 +05:30
Abhinav a4654413d4 no need to migrate metadata folder 2021-11-17 13:58:08 +05:30
Abhinav 8ad2d3f23f skip non image file before downoading itself 2021-11-17 13:51:21 +05:30
Abhinav bb9c82db52 remove unused LS_KEYS 2021-11-17 13:36:23 +05:30
Abhinav 0c23ace8ff remove redundant code 2021-11-17 13:29:46 +05:30
Abhinav 84617a3267 trigger popper open only if attributes not null 2021-11-17 13:17:21 +05:30
Abhinav f8de2f21c7 move setProgressTracker to finally block for any case update 2021-11-17 13:16:29 +05:30
Abhinav 80aa50b8fb only try to parse image exif 2021-11-17 13:11:33 +05:30
Abhinav d15cef404d update strings 2021-11-17 13:05:41 +05:30
Abhinav de2acbcf32 fix updateExportTime 2021-11-17 11:58:50 +05:30
Abhinav 29ecff60d6 reorder selection bar icons 2021-11-17 10:29:40 +05:30
Abhinav ff58e8900d clear selection after trigerring fix creation 2021-11-17 10:22:30 +05:30
Abhinav 70b3e59fbf add fix time icon 2021-11-16 17:55:19 +05:30
Abhinav 670dbe2d0f download from photoswipe contain updated exif 2021-11-16 17:21:26 +05:30
Abhinav da02db2a49 update DateTimeOriginal property with editedTime 2021-11-16 17:21:01 +05:30
Abhinav 3de18c4fbd migrate export if previous export version less than current 2021-11-16 16:45:58 +05:30
Abhinav 638dab4421 fix setting fixState on modal open 2021-11-16 13:08:25 +05:30
Abhinav 80fda73a79 move fix CreationTime option to selectionOption bar 2021-11-16 12:27:23 +05:30
Abhinav f94322ddef log the exifparsing inside getExifData itself 2021-11-16 11:40:46 +05:30
Neeraj Gupta 9529521af4
Merge pull request #232 from ente-io/mnemonic 
Add support to show mnemonic recovery key
 2021-11-16 11:25:36 +05:30
Neeraj Gupta e1b683734b
Handle mneomonic recovery code during 2FA recover 2021-11-15 21:39:32 +05:30
Abhinav 799f85b089 fix process queue processed from the end 2021-11-15 13:58:52 +05:30
Shailesh Pandit cbaba79db9 Use hdbscan debug info to visualize mst tree 2021-11-14 16:30:23 +05:30
Abhinav e8aa6141dd bubble up error to caller from queue processor 2021-11-13 12:50:37 +05:30
Shailesh Pandit afa8fc2a81 Use hdbscan implemented following scikit-learn package 2021-11-13 10:41:32 +05:30
Neeraj Gupta 9b333807a2
Add support to show mnemonic recovery key 2021-11-13 00:23:05 +05:30
Abhinav ab73e7f8a9 Merge branch 'master' into close-for-without-edit 2021-11-12 10:53:38 +05:30
Neeraj Gupta ad11422034
Merge pull request #220 from ente-io/fix-file-type-not-logged 
fix file type not logged on image thumbnail generation fail
 2021-11-12 10:50:47 +05:30
Abhinav 07591fe30d update creation Time copies 2021-11-12 10:39:36 +05:30
Abhinav eafa14c155 Merge branch 'master' into export-v2 2021-11-11 13:18:36 +05:30
Abhinav f0787b7dfb refactor code 2021-11-11 13:13:59 +05:30
Abhinav 6a482c937e added error handling for updateFileModifyDateInEXIF 2021-11-11 13:11:16 +05:30
Abhinav 9a3aa75d1e better variable names 2021-11-11 13:07:19 +05:30
Abhinav dd6fbb29df await on returned promised to handle error itself 2021-11-11 13:02:20 +05:30
Abhinav 220d7ba62e fixed date format set in exif 2021-11-11 12:54:28 +05:30
Abhinav f92fa1c331 replace dataURL so that piexif considers file as JPEG 2021-11-11 12:54:28 +05:30
Abhinav 2636568724 if file has edited Time and is jpeg then update the exif ModifyDate with the edited time 2021-11-11 12:54:28 +05:30
Abhinav e6056f0ea3 adds exif update logic 2021-11-11 12:54:28 +05:30
Abhinav 824dc54d76 adds getFileExtension util 2021-11-11 12:54:28 +05:30
Abhinav c6318dd808 remove commented code 2021-11-11 12:54:28 +05:30
Abhinav dfefa9f546 merge metadata for file before export 2021-11-11 12:54:28 +05:30
Abhinav 4deba2df42 update save file name and collection name parenthesied number for same name instead of using ids to make them unique 2021-11-11 12:54:28 +05:30
Abhinav 04ab5a1651 dont create inline function for startFix 2021-11-10 15:02:36 +05:30
Abhinav 088d7e2156 sync after fix creation time completion 2021-11-10 14:55:29 +05:30
Abhinav 88f643192c fix getExifData breaking for some files 2021-11-10 14:53:23 +05:30
Abhinav c47d24eb8c removed unneccessary getExifDataFromURL 2021-11-10 14:52:40 +05:30
Abhinav 3d3213e989 replace exif only if creationTime different than exif 2021-11-10 13:47:21 +05:30
Abhinav 87089eec43 adds logic to refresh state on repen 2021-11-10 13:46:16 +05:30
Abhinav 76842b92a6 Merge branch 'master' into fix-creation-time 2021-11-10 12:50:34 +05:30
Vishnu Mohandas 46b7bada93
Merge pull request #219 from ente-io/fix-collection-sort 2021-11-10 12:41:30 +05:30
Abhinav 4b27ed4fd5 updated info object key from type to fileFormat , as sentry does not recognise type as valid property name for some reason 2021-11-10 12:14:56 +05:30
Abhinav 270c43521d better solution to avoid saving merged metadata to local storage 2021-11-10 10:21:29 +05:30
Abhinav 8c3106f66d added fail safe for exportModal state update on reopen 2021-11-09 22:40:57 +05:30
Abhinav 7245af0cc8 honor edited property in metadata 2021-11-09 22:40:57 +05:30
Abhinav b651d16ee5 skip shared-collections during export 2021-11-09 22:40:57 +05:30
Abhinav 15f12a6f8e fix filename spliting 2021-11-09 22:33:09 +05:30
Shailesh Pandit 4d8c1571df Use TSNE to visualize faces over 2d plot 2021-11-09 19:16:52 +05:30
Abhinav 3c5e74f16d update the files array so that returned files from the function is sorted as the caller expect sorted files and use spread operator so that deep copy of file is used to set state to avoid #212 problem 2021-11-09 17:08:27 +05:30
Abhinav b225b4ff35 simpley close date edit if saved without edit 2021-11-09 16:06:12 +05:30
Abhinav 1dc5ecb061 minor improvments 2021-11-09 15:59:37 +05:30
Abhinav ebe839acf0 Merge branch 'master' into update-file-title 2021-11-09 15:46:12 +05:30
Abhinav d807828b77 remove valid file extension detection logic 2021-11-09 15:43:10 +05:30
Abhinav 4f3faf3d78 use formik for file name update form state management 2021-11-09 15:32:27 +05:30
Abhinav aa90e897b4 update EnteSpinner to use props passed to it 2021-11-09 15:31:09 +05:30
Abhinav 40846245ff break long file name 2021-11-08 12:49:04 +05:30
Abhinav d8bb91a7e1 Merge branch 'master' into update-file-title 2021-11-08 12:28:24 +05:30
Shailesh Pandit 4bd52d53ee Use HDBSCAN for clustering and visualize results 2021-11-07 19:09:39 +05:30
Shailesh Pandit 48388aa125 Use centroid of cluster as summary 
Increase face detection minConfidence
 2021-11-07 07:39:28 +05:30
Shailesh Pandit 0ed8df8c17 Make maxFaceDistance configurable 2021-11-06 14:26:12 +05:30
Shailesh Pandit 15fcfbde44 Distribute noise to nearest initial clusters if distance is within limit 2021-11-06 14:03:12 +05:30
Shailesh Pandit dbb5e99fda Restrict face distance further 2021-11-06 11:27:07 +05:30
Shailesh Pandit 833f25e07f Add batch size, return all info to derive face images later 
Required to reduce worker -> caller payload size later
 2021-11-06 10:59:05 +05:30
Shailesh Pandit 4a94ecbbed Clean tf memory after usage 2021-11-06 09:34:44 +05:30
Shailesh Pandit 0db387cdb1 Tweak default parameters based on initial results 2021-11-05 22:05:10 +05:30
Shailesh Pandit a5453b8858 Add minFaceSize to limit small faces 2021-11-05 21:44:38 +05:30
Shailesh Pandit 6fb22e429c Testing with face face-api.js 2021-11-05 20:56:41 +05:30
Shailesh Pandit 41aad5e205 Add Dlib alignment and other clustering methods 2021-11-05 20:35:23 +05:30
Abhinav b47cf3b1fa await for fetchUploadURLs 2021-11-05 18:36:25 +05:30
Shailesh Pandit e5597dc017 Get only unique files for ml sync 2021-11-05 14:03:23 +05:30
Abhinav 91825db617 Merge branch 'master' into update-file-title 2021-11-05 13:26:12 +05:30
Shailesh Pandit 4d1f8d28ac Undo changes which got removed 2021-11-05 11:24:10 +05:30
Vishnu Mohandas df60b0c6c0
Merge pull request #213 from ente-io/empty-trash-changes 
Empty trash changes
 2021-11-04 19:57:11 +05:30
Abhinav 80ba92c98c dont export getCollectionLastSyncTime 2021-11-04 19:25:19 +05:30
Abhinav 7444ad183e dont set files directly to state, use a copy 2021-11-04 19:01:02 +05:30
Abhinav d2ee821977 refactored getCollectionLastSyncTime 2021-11-04 18:53:35 +05:30
Abhinav 8d79b443fe add setLocalFile and remove appendPhotoSwipeProps funcitons 2021-11-04 18:46:04 +05:30
Shailesh Pandit aeccc14d3c Make clusterFaceDistance and minClusterSize configurable on ml debug page 2021-11-04 18:23:41 +05:30
Shailesh Pandit 15707f8344 WIP: hacks to ignore dom access from web worker 2021-11-04 17:41:37 +05:30
Shailesh Pandit d9fa4a6804 Display clusters and noise on ml debug page 2021-11-04 17:06:15 +05:30
Shailesh Pandit 955e2e965f Add dbscan clustering 2021-11-04 17:01:00 +05:30
Shailesh Pandit 6d126e1569 Run face detection and embeddings on all local files 2021-11-04 16:48:10 +05:30
Shailesh Pandit 551e91d278 Add TFJSFaceEmbeddingService and tflite model 
Set wasm path
 2021-11-04 16:35:09 +05:30
Shailesh Pandit 9c70801a16 Add tfjs wasm files, set wasm files path 2021-11-04 16:31:56 +05:30
Shailesh Pandit 2f767ed83f Add TFJSFaceDetectionService 2021-11-04 16:11:07 +05:30
Shailesh Pandit 377400228a Machine learning worker 
Call machine learning service inside a worker
ML Debug page to trigger worker
 2021-11-04 15:18:30 +05:30
Vishnu Mohandas 8f77bda4c6
Merge pull request #210 from ente-io/update-change-creation-time-ui 
Update change creation time UI
 2021-11-03 22:02:52 +05:30
Vishnu Mohandas 7f88324a03
Merge pull request #211 from ente-io/fix-file-not-found 
fix file not found chrome error
 2021-11-03 21:58:25 +05:30
Abhinav e573a7f180 fix file not found chrome error 2021-11-03 21:24:46 +05:30
Abhinav 4c5df92e51 add max and min time limit 2021-11-03 20:06:00 +05:30
Abhinav 70fc35549b update style and remove button from calender 2021-11-03 19:11:11 +05:30
Abhinav 9afe465e91 updated tick icon 2021-11-03 19:07:46 +05:30
Abhinav 425cf21f28 redirect to all section after empty trash 2021-11-03 17:03:24 +05:30
Abhinav df23ea80d7 upadated strings 2021-11-03 17:03:12 +05:30
Abhinav 3eb6f68da0 highlight all in range 2021-11-03 16:59:23 +05:30
Abhinav 040776bb07 fire select event only for items between the ends as they are already selected by click 2021-11-03 16:58:51 +05:30
Abhinav 49e3fa00f0 select file on click even if range select is active 2021-11-03 16:57:46 +05:30
Abhinav 5a879f50ae fix range start nulled on selected second item 2021-11-03 16:30:08 +05:30
Abhinav e6a3ac35ee Merge branch 'master' into fix-creation-time 2021-11-03 16:05:32 +05:30
Abhinav 51923850cb update string constant name for fix large thumbnail 2021-11-03 16:05:01 +05:30
Abhinav e052da48ff adds Fix creationTime UI 2021-11-03 16:04:11 +05:30
Abhinav 5095bde562 adds updateCreationTimeWithExif script 2021-11-03 16:03:01 +05:30
Vishnu Mohandas d8eb2231be
Merge pull request #207 from ente-io/migrate-trashed-file-thumbnail 
migrate trashFiles thumbnail too
 2021-11-03 15:53:23 +05:30
Vishnu Mohandas 8ccb74d2a4
Merge pull request #208 from ente-io/download-mobile-app-banner 
fixed install mobile app banner not shown on empty screen
 2021-11-03 15:50:56 +05:30
Abhinav b372c3892b fixed install mobile app banner not shown on empty screen 2021-11-02 21:36:14 +05:30
Abhinav 801de8f3cc add log if all large thumbnail are not present locally 2021-11-02 21:05:23 +05:30
Abhinav ee67921a75 migrate trashFiles thumbnail too 2021-11-02 20:59:31 +05:30
Abhinav af302f6980 send fileType info with exif data missing logs 2021-11-02 20:50:07 +05:30
Abhinav-grd acbb9498b4
Merge pull request #198 from ente-io/web-perf 
Web perf
 2021-11-02 20:24:56 +05:30
Abhinav 99169e407a correct lower limit edited time 2021-11-02 14:10:03 +05:30
Abhinav dbe5554373 close edit mode if saved without changes 2021-11-02 14:06:15 +05:30
Abhinav f43e2cf6d6 added file name charcter limit 2021-11-02 13:21:00 +05:30
Abhinav 70c175a10b update FIle name Ui to have edit option 2021-11-02 13:06:04 +05:30
Abhinav 0263e5cb38 ad change file title logic 2021-11-02 13:05:41 +05:30
Abhinav 20388566fe fix typo 2021-11-02 12:25:12 +05:30
Abhinav 3eaf583f7b return upated file as updateMagicMetadata response 2021-11-02 12:22:38 +05:30
Abhinav 4cc1ff3547 no need to remerge metadata 2021-11-02 12:19:07 +05:30
Abhinav 5c62ff0472 updated icons 2021-11-02 12:15:18 +05:30
Abhinav d0baa20cc8 skip update if pickedTime same as creationTime 2021-11-02 12:01:32 +05:30
Abhinav 99d8d4266e minor fixes 2021-11-02 11:56:25 +05:30
Abhinav 916e84c58e reafactor code 2021-11-02 11:52:13 +05:30
Abhinav 7300a85e5e rename updateMagicMetadata property updater to updateMagicMetadataProps 2021-11-02 11:24:26 +05:30
Abhinav 5b95215e07 mergeMetadata before every setFiles call 2021-11-02 11:13:35 +05:30
Abhinav a3b6a2860e fix save and cancel button container styles 2021-11-02 10:23:45 +05:30
Abhinav 8180d47123 update date picker style 2021-11-02 00:18:28 +05:30
Abhinav 9603fba46c adds max and min date limit 2021-11-01 23:53:34 +05:30
Abhinav 4b3e9f9e08 Merge branch 'master' into update-creation-time 2021-11-01 22:37:55 +05:30
Abhinav 63e5dd6227 Merge branch 'master' into web-perf 2021-11-01 22:28:09 +05:30
Abhinav 45ef18b451 update List key to only active collection so that its re-rendered only on collection change 2021-11-01 22:19:31 +05:30
Abhinav-grd 2e90601c1c
Merge pull request #192 from ente-io/range-select 
Range select
 2021-11-01 21:44:24 +05:30
Abhinav 445bc64731 update blacnk space added hieght 2021-11-01 18:07:20 +05:30
Abhinav e25e2e4e43 resize edit button 2021-11-01 18:05:27 +05:30
Abhinav b06dbc4f57 update to new date picking lib 2021-11-01 18:02:50 +05:30
Abhinav d9fae0bf5d Merge branch 'master' into update-creation-time 2021-10-31 19:25:21 +05:30
Abhinav 9d6a7218a3 update highlight in range color 2021-10-31 19:18:56 +05:30
Abhinav 22e76c0c3e start tracking hover if one item has been selected 2021-10-31 19:18:15 +05:30
Abhinav 08c9e49a87 refresh list after timeStampList instead of filtered data update 2021-10-31 14:39:03 +05:30
Abhinav 3f127b9927 fix banner appending 2021-10-31 11:12:53 +05:30
Abhinav df0bfd0c2b fix update magic metadata 2021-10-30 20:39:52 +05:30
Abhinav ebccb6a981 merge metadatas before sorting 2021-10-30 20:35:45 +05:30
Abhinav dc794090a6 update pubMagicMetadat prop name from creationTime to editedTime 2021-10-30 19:02:17 +05:30
Abhinav-grd 87cfff1a52
Merge pull request #202 from ente-io/update-migrate-thumbnail-copies 
add new NOOP state to migrateThumbnail
 2021-10-30 18:50:29 +05:30
Abhinav f4097effd2 adds new NOOP state for for when no files present to be compressed and use Completed when fix completes 2021-10-30 18:02:13 +05:30
Abhinav 7f75cc532a Schedule update and update pubMagicMetadata locally 2021-10-30 17:05:07 +05:30
Abhinav 0c20f59ceb update files metadata with new update pubMagicMetaData 2021-10-30 16:22:39 +05:30
Abhinav c46ba48980 disable photoswipe keyboard event when info modal is open 2021-10-30 16:22:35 +05:30
Abhinav 1569e189ed update migrate thumbnail copies 2021-10-30 09:15:39 +05:30
Abhinav 1fe2766ce9 Merge branch 'master' into collection-diff-v2 2021-10-30 08:36:38 +05:30