beenull/ente
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
3341 commits 18 branches 104 tags 490 MiB
Commit graph

2909 commits

Author SHA1 Message Date
Abhinav 22528bb7ca dont animate currentSubscribedPlan 2022-01-14 17:43:40 +05:30
Abhinav 1fe2a97f8c call user-plans api if token present 2022-01-14 17:41:33 +05:30
Shailesh Pandit ec0108dda6 Start and stop sync job from debug page 
using ml work manager
 2022-01-14 15:51:37 +05:30
Shailesh Pandit c454c50341 Select nearest pass2 detection in blazeface 
Remove duplicates after 2nd pass
Updated min face detection probability based on results
 2022-01-14 12:28:11 +05:30
Abhinav 13c362f16c fixes unable to select consective item range select 2022-01-13 14:18:50 +05:30
Abhinav 6516246499 fixes https://sentry.ente.io/organizations/ente/issues/2338/ 
adds rangeStart undefined check
 2022-01-13 14:18:00 +05:30
Shailesh Pandit f5e45a8b73 Show filtered faces based on detection probability 
Some styling changes of debug page
 2022-01-13 13:39:13 +05:30
Shailesh Pandit 255219f778 Fix idb upgrades 
Use oldVersion to apply all required upgrades
 2022-01-13 12:03:11 +05:30
Abhinav Kumar 44b2907c69
Merge pull request #295 from ente-io/fix-search-count 
fix search count by updating it when filteredData changes
 2022-01-13 11:14:58 +05:30
Abhinav Kumar 8aa55eb411
Merge pull request #291 from ente-io/first-upload-name 
use suggested name if available during first upload
 2022-01-13 11:14:45 +05:30
Abhinav 41a23dbc0b fix search count by updating it when filteredData changes 2022-01-13 10:39:14 +05:30
Shailesh Pandit 5f6e617f68 Show upto 200 people in search box 
Make people list in search box scrollable
 2022-01-13 09:28:01 +05:30
Shailesh Pandit 09c9deda5e Disabling large mst binary tree display on ml debug 
Fix wrong assumptions in faceId comment
 2022-01-13 07:16:54 +05:30
Shailesh Pandit 4cd781d201 Update hdbscan to remove mst tree from storage 2022-01-12 20:35:04 +05:30
Abhinav 000f1546fe fix getFileOriginalName if name doesn't have edited suffix 2022-01-12 17:00:58 +05:30
Abhinav f37cac0a39 fix casing of ParsedMetadataJSON 2022-01-12 16:59:27 +05:30
Abhinav bed6a086a6 use suggested if available during first upload 2022-01-12 14:42:46 +05:30
Shailesh Pandit c14f8cc90f Display face of person only based on detection probability 
Fix comparator of findFirstIfSorted
 2022-01-12 14:15:22 +05:30
Shailesh Pandit fbe6e5f8cf Check if old faces are in same order before using 
Keep old ml version if present
 2022-01-12 12:05:31 +05:30
Shailesh Pandit ef6c564d62 Only set fields related to each ml sync step 
Reset error fields on successful sync of file
 2022-01-12 10:53:06 +05:30
Shailesh Pandit 7ac252aca8 Handle some non file related errors in ml sync 
Handles network error and session expired errors
 2022-01-11 19:08:26 +05:30
Shailesh Pandit 864885d586 Update default face clustering parameters 2022-01-11 09:53:19 +05:30
Shailesh Pandit 0c1db302c1 Extract ConfigEditor as component 2022-01-11 09:42:31 +05:30
Shailesh Pandit 2ceca69514 Move ml react components to a folder 2022-01-11 08:44:33 +05:30
Shailesh Pandit bd7be81acf Fix build 2022-01-11 07:08:42 +05:30
Shailesh Pandit aa6b40b724 Make ml sync configs editable on debug page 2022-01-10 22:28:09 +05:30
Shailesh Pandit b90cd62fa8 Store configs in db 2022-01-10 20:20:06 +05:30
Shailesh Pandit 52078b3e5e Ad Dbscan clustering method 2022-01-10 17:38:51 +05:30
Shailesh Pandit cc7d2355f7 Update hdbscan to use cluser selection method and epsilon 2022-01-10 14:56:00 +05:30
Shailesh Pandit 4237b9cfc7 Display clusters and mst in treeview on ml debug 
from last clustering run
 2022-01-09 22:40:55 +05:30
Shailesh Pandit bb000c0c69 ML Debug refresh for all identified people 
Clear people index button
 2022-01-09 18:32:25 +05:30
abhinavkgrd 7dc9246519
Merge pull request #284 from ente-io/rename-type-MetadataObject-to-Metadata 
Rename type MetadataObject to Metadata
 2022-01-09 18:05:13 +05:30
abhinavkgrd 71a97caa03
Merge pull request #281 from ente-io/reuse-file-readers 
reuse file readers
 2022-01-09 18:00:51 +05:30
abhinavkgrd b504e072f3
Merge pull request #288 from ente-io/fix-get-original-filename-logic 
fix getFileOriginalName logic
 2022-01-09 18:00:39 +05:30
Shailesh Pandit 8eebdb226e Fix: clear old person id in face before reclustering 2022-01-09 17:41:52 +05:30
Abhinav 4cdc93e345 renamed sentry constants to follow the global convention 2022-01-09 13:55:07 +05:30
Abhinav 48eac037ea fix getFileOriginalName logic 2022-01-09 12:25:40 +05:30
Abhinav d42af9cd1a pass reader correctly instead of passing workers 2022-01-09 11:05:50 +05:30
Shailesh Pandit 90bf35b05d Make minSamples of hdbscan configurable 2022-01-09 10:06:38 +05:30
Shailesh Pandit 0d9d79e979 Display all peope on ml debug 2022-01-09 10:05:13 +05:30
Shailesh Pandit aac2318513 Moving default ml sync configs to constants 
Limit sync job max interval to around 15 mins
 2022-01-09 07:43:21 +05:30
Shailesh Pandit 2dd48e6ceb MLWorkManager refactor 
Extract generic SimpleJob from ML Sync Job
Terminate sync job and live sync workers after work done
 2022-01-08 23:27:29 +05:30
Vishnu Mohandas 5d3e284fcd
Merge pull request #280 from ente-io/disable-sentry-release-cli-for-local-build 
disable sentry release cli for local build
 2022-01-08 18:44:27 +05:30
abhinavkgrd 9d727f23b6
Merge pull request #287 from ente-io/handle-exifr-error 
handle exifr parsing failure gracefully
 2022-01-08 15:08:05 +05:30
Abhinav 6abf883b3e Merge branch 'reuse-file-readers' into rename-type-MetadataObject-to-Metadata 2022-01-08 13:56:22 +05:30
Abhinav d4eb485829 handle exifr parsing fail 2022-01-08 13:44:51 +05:30
Abhinav 0e7ab5c886 fix if fileReader not present check 2022-01-08 13:34:50 +05:30
Abhinav 585d3acf88 fix multiple folder detection for sibling folder with no common ancestor 2022-01-08 13:09:43 +05:30
Abhinav f788490573 fixc worker passed instead of FileReader to getMimeTypeFromBlob 2022-01-08 12:29:10 +05:30
Abhinav 15a03a87b3 rename type MetadataObject to Metadata 2022-01-08 10:34:40 +05:30
Shailesh Pandit c995729ab9 Use face crop cache to store person display face 2022-01-07 19:20:56 +05:30
Abhinav 8fc784a1f5 replace one missed worker.getUint8ArrayView function 2022-01-07 18:34:42 +05:30
Abhinav bd3d6d84ce use global file reader and reuse them wherever possible 2022-01-07 18:28:22 +05:30
Abhinav 5427fbf232 move isSentryEnabled needed by both config util and constants/sentry to seperate file sentryConfigUtil 
as neither of the two files can import each other
 2022-01-07 18:06:22 +05:30
Abhinav fbf6476d70 move sentry constants to constants/sentry 2022-01-07 17:52:37 +05:30
Shailesh Pandit 03a3a57055 Use only path of cached face crop in export 2022-01-07 13:56:45 +05:30
Shailesh Pandit 1b0d6e8da4 Catch error while showing blob image to not crash app 2022-01-07 09:18:39 +05:30
Shailesh Pandit 0fbb65cb9a Remove one time face interface migration 2022-01-07 09:07:20 +05:30
Shailesh Pandit 3d81ffd84b Export and Import ml data from ml debug 2022-01-07 09:06:18 +05:30
Abhinav 028bbdd01d Merge branch 'master' into fix-queue-processing-order 2022-01-06 19:25:47 +05:30
abhinavkgrd 6d219275c0
Merge pull request #263 from ente-io/upload-types-refactor 
Extract types and constants from services and components
 2022-01-06 18:36:23 +05:30
Shailesh Pandit 943fa990cb Migration for new Face interface 2022-01-06 15:05:00 +05:30
abhinavkgrd b297e9fd64
Merge pull request #278 from ente-io/fix-double-counting-selected-items 
Fix overlapping range select behaviour
 2022-01-06 14:30:46 +05:30
Abhinav 73882919d1 handle case where range select with few selected and few unselected items 
select all the items in the union of two ranges
 2022-01-06 14:12:41 +05:30
Abhinav 6d76611079 fix counting again 🥲 2022-01-06 13:53:29 +05:30
Abhinav 314f8d44b1 handle range deselection 2022-01-06 13:35:27 +05:30
Abhinav a24ace5946 deselect items if overlap between range selected value 2022-01-06 13:07:52 +05:30
Abhinav e41b3c184f make onSelect required prop 2022-01-06 13:07:18 +05:30
Shailesh Pandit 945139b758 Embedding service interface refactor 
Use face imageBitmaps as input
Use Float32Array as output and for storage in db
 2022-01-06 12:15:26 +05:30
Abhinav 2044f4f6cf remove unneccsary console log 2022-01-06 12:15:13 +05:30
Abhinav bf6a0ef7cc fix double counting selected items if new and previous range select overlap 2022-01-06 12:14:18 +05:30
Abhinav 14b1e59c90 abstract SmallLoadingSpinner 2022-01-06 10:21:08 +05:30
Abhinav 3c4a0f7b6a add loading spinner during creation udpate api call 2022-01-06 10:11:33 +05:30
Shailesh Pandit 2b5aafa0bc Rename blazeface and mobilefacenet services 2022-01-06 07:22:05 +05:30
Shailesh Pandit 19c3654926 Rename tfjs face detection and embedding service files 2022-01-06 07:20:29 +05:30
Shailesh Pandit 19aae1a75b Refactor interfaces 
Use composition to store face analysis results
Add face id to stored face
 2022-01-06 06:49:08 +05:30
Abhinav b752b77c26 Merge branch 'master' into upload-types-refactor 2022-01-05 16:36:39 +05:30
Shailesh Pandit 1a41c7c194 Fix getUnidentifiedFaces for empty face crops 2022-01-05 14:43:25 +05:30
Shailesh Pandit b88ccee6ed Update files version after syncLocalFiles 2022-01-05 14:39:55 +05:30
Shailesh Pandit be476995b2 Remove one time migration for face crops 2022-01-05 14:15:49 +05:30
Shailesh Pandit 2f3d06cb4d Migrate face crops from indexdb to cache 2022-01-05 13:54:21 +05:30
Abhinav 9e099d4e67 moved queueProcessor to service directory 2022-01-05 13:28:24 +05:30
Abhinav e4f649c467 refactor upload service constants and types 2022-01-05 13:27:10 +05:30
Abhinav 2faade0d42 move KEK interface to types 2022-01-05 13:05:18 +05:30
Abhinav 344d2b2c0c move ProgressUpdater interface to UIService 2022-01-05 13:00:29 +05:30
Abhinav 7285af6977 keep NULL_LOCATION along with Location type defination 2022-01-05 12:50:10 +05:30
Abhinav 44bc3916a5 move isDataStream type check util function to types/upload 2022-01-05 12:46:57 +05:30
Abhinav caef21f939 merge types/user imports 2022-01-05 12:41:16 +05:30
Abhinav 63960c207b fix User import 2022-01-05 12:40:36 +05:30
Abhinav a5849600b1 move errorUtil from utils/common to utils/error 2022-01-05 12:25:48 +05:30
Abhinav b00d7ea2b0 move file enums to constants/file 2022-01-05 12:18:46 +05:30
Abhinav 9e0fef4743 move export enums to constants/export 2022-01-05 12:14:22 +05:30
Shailesh Pandit 2471a57b3b Store face crops in cache to reduce io 
when updating indexeddb
 2022-01-05 12:12:24 +05:30
Abhinav ce22425be9 move collection enum to constants/collection 2022-01-05 12:11:32 +05:30
Abhinav 11e990ffe9 move file constants to constants/file 2022-01-04 17:27:19 +05:30
Abhinav 8a96b73b37 moved export constants to constants/export 2022-01-04 17:19:14 +05:30
Abhinav 88ea78ebb3 dont export constants used only in one file 2022-01-04 17:14:34 +05:30
Abhinav 8f0a0d3f18 fix FIX_CREATION_TIME_VISIBLE_TO_USER_IDS import 2022-01-04 17:12:43 +05:30
Abhinav 9b48275144 moved upload constants to constants/upload 2022-01-04 17:12:29 +05:30
Abhinav eddfbed37c moved user constants to constants/user 2022-01-04 16:57:57 +05:30
Abhinav 5a84003388 move collection constants to constants/collection 2022-01-04 16:54:39 +05:30
Abhinav dfdf2897d4 move constants from util to src directory and split into sub folders 2022-01-04 16:50:54 +05:30
Abhinav b10a43b3a8 move gallery related types to types/gallery 2022-01-04 16:27:59 +05:30
Abhinav f30a5103bc renamed types to util/constants 2022-01-04 16:19:58 +05:30
Abhinav 41b8ed55a2 moved user related types to types/user 2022-01-04 16:09:42 +05:30
Abhinav 4011b6fbe8 move trash related types to types/trash 2022-01-04 15:51:35 +05:30
Abhinav 79f6ebc454 moved search related types to types/search 2022-01-04 15:48:33 +05:30
Abhinav b5b31a8350 move non exported constant back to origin file 2022-01-04 15:36:16 +05:30
Abhinav aba964922e moved file related types to types/file 2022-01-04 15:20:14 +05:30
Abhinav f8af3a9a39 moved export types to types/export 2022-01-04 14:21:47 +05:30
Abhinav 2aba5cb058 moved collection related types to types/collection 2022-01-04 14:17:38 +05:30
Abhinav 1a1c4d145c created types for billing and renamed billingUtil to billing/index 2022-01-04 14:05:41 +05:30
Shailesh Pandit 8ab7dc38e1 Ignore empty faces in AllFacesMap 2022-01-04 13:54:07 +05:30
Shailesh Pandit 68a976f628 Revert one time migration 2022-01-04 13:26:22 +05:30
Shailesh Pandit 86b2efbdd6 Fix migration for one time run 2022-01-04 13:07:34 +05:30
abhinavkgrd 1d0aa42630
Merge pull request #273 from ente-io/web-security-clean 
harden web security
 2022-01-04 13:03:09 +05:30
Abhinav 530f40f5a0 Merge branch 'master' into upload-types-refactor 2022-01-04 12:20:28 +05:30
Shailesh Pandit 4cb552046a Use IndexedDB without forage to use indexes 2022-01-04 11:26:16 +05:30
Abhinav 9acb76795e fix sentry tunnel URL 2022-01-03 15:33:08 +05:30
Shailesh Pandit fa7453323d Remove unnecessary sorting while getting out of sync files 
Add timing logs to getPeopleList and getOutOfSyncFiles
 2022-01-03 15:02:48 +05:30
Shailesh Pandit fb402e9b69 Sync deleted files, remove ml data for them 
Reset sync job backoff on local file updates
 2022-01-03 10:06:30 +05:30
Shailesh Pandit 2cb9ebf402 Exponential back off for ml sync job 2022-01-03 08:05:00 +05:30
Shailesh Pandit b9d32cc1e6 Dispose sync context in local file sync flow 2022-01-03 07:13:59 +05:30
Shailesh Pandit fc459171f4 Fix typo 2022-01-02 22:33:40 +05:30
Shailesh Pandit 502a023fa3 Run ml sync concurrently 2022-01-02 22:27:42 +05:30
Shailesh Pandit 86052cc393 Run face clustering using configured method 
Save face clustering results
Display noise faces on ml debug page
 2021-12-31 12:08:50 +05:30
Shailesh Pandit 30f9088c81 Show face crops and images in rows 2021-12-29 18:45:47 +05:30
Shailesh Pandit 778431d01b Normalize landmark and box thickness in ml debug 2021-12-29 17:11:46 +05:30
Shailesh Pandit 9d3bf5ce6f Detected face transforms to and from face crop 2021-12-29 12:10:11 +05:30
Shailesh Pandit 162d760b80 Use transformation-matrix package for transforms 2021-12-29 10:32:01 +05:30
Shailesh Pandit 385acec1ab Do 2nd pass of blazeface on close ups 
for better accuracy
Transform utils
 2021-12-28 20:30:52 +05:30
Shailesh Pandit 72b2a6ad8b Handle empty faces in unidentified faces 2021-12-25 14:22:38 +05:30
Shailesh Pandit 8177cd336b Show unidentified faces in info panel 
Add local file debugging info to ml debug page
showing aligned face box and landmarks and face crops
 2021-12-25 13:07:24 +05:30
Shailesh Pandit 91bd053cf5 Use face crops while calculating embeddings 
Simulate mlVersion update requiring only embeddings to be recalculated
without downloading full image
 2021-12-24 12:27:29 +05:30
Shailesh Pandit 7b06f5d8f8 imageSource not updated based on actual source 2021-12-23 23:59:49 +05:30
Shailesh Pandit 44f4362f0f Store ml sync error count for a file, limit retry 
Download original quality files for photos and live photos only
 2021-12-23 23:40:21 +05:30
Shailesh Pandit b4c31c5845 Store face crops, extract aligned faces from face crops 
Align faces using center, size and rotation only, using this aligned faces can be extracted without whole image
 2021-12-23 18:27:53 +05:30
Shailesh Pandit 4ebcddbb84 Provision to run ml sync on original images 
To capture high resolution face images
Use ImageBitmap till tf models as tf manipulations on variable dimention images leads to gpu memory leak - https://github.com/tensorflow/tfjs/issues/604
 2021-12-20 22:20:20 +05:30
Abhinav 6e62f312bf update to use ente domain url for workes instead of worker.dev cf domains 2021-12-20 15:51:24 +05:30
Abhinav 40058f0883 fix typo 2021-12-20 13:21:12 +05:30
Abhinav bff8411284 adds download collection option 2021-12-20 13:00:56 +05:30
Abhinav e066ee5ff1 added start and finish loading helper function 2021-12-20 12:59:39 +05:30
Abhinav f45fd0d0e4 fix allElectronAPIsExist intialisation 2021-12-19 15:23:36 +05:30
Abhinav 9088942e16 fix checks 2021-12-19 14:43:30 +05:30
Abhinav e2b3c157f5 renamed oldClient to better allElectronAPIsExist 2021-12-19 14:38:10 +05:30
Abhinav d814359e10 add olderClient check and use olderClient logic 2021-12-19 12:24:58 +05:30
Shailesh Pandit 0e366264a0 TF memory cleaned only with tf.dispose and tf.tidy 
Remove usage of startScope and endScope, can be used for debugging
 2021-12-15 17:20:07 +05:30
Shailesh Pandit f5ca124fc9 Only sync updated ml methods for existing files 2021-12-14 19:44:13 +05:30
Shailesh Pandit 2d17dd30e9 For uploaded files use local files for ML Sync 
Extract out ML work manager and sync job from worker
Start and stop ML Sync job on app start, login and logout
 2021-12-12 23:12:18 +05:30
Shailesh Pandit 470f9fb931 Move machine learning types to types folder 2021-12-08 12:43:51 +05:30
Shailesh Pandit 4d89e7df96 Revert comented ffmpeg code 
As not required after common upload types are extracted out
 2021-12-08 12:22:12 +05:30
Shailesh Pandit d65de21be5 Merge branch 'upload-types-refactor' into machine-learning 2021-12-08 11:59:07 +05:30
Shailesh Pandit d5199acc43 Extract common types in upload service to upload types 
Required for not including code required for upload service in other parts just requiring common types
e.g. ffmpegService is included in machine learning web worker while including downloadManager service
 2021-12-08 11:53:34 +05:30
Shailesh Pandit 28b77bcf0a Merge branch 'master' into machine-learning 2021-12-07 18:41:29 +05:30
Abhinav 9dfd2e4ba7 Merge branch 'master' into export-v2 2021-12-07 18:25:44 +05:30
Abhinav 2e92784569 add missing await to save saveMetadataFile 2021-12-07 18:17:46 +05:30
Abhinav ba1fb670e8 add old sanitizer to get oldname for migration 2021-12-07 18:15:12 +05:30
Abhinav f13549b2bf null safety 2021-12-07 18:15:12 +05:30
Abhinav 85d06fc528 fix bugs 2021-12-07 18:15:12 +05:30
Abhinav 27d9d703c7 renamed exported Collection if collection name changed 2021-12-07 16:23:56 +05:30
Abhinav 5257a91864 fix addCollectionExportedRecord calls 2021-12-07 16:02:55 +05:30
Abhinav 6074200b67 better local errors 2021-12-07 15:41:50 +05:30
Abhinav 55b2de1a53 fix collection folder creation 2021-12-07 15:41:38 +05:30
Abhinav cf09858fb7 only export user personal files 2021-12-07 14:24:28 +05:30
Abhinav 3dd90ba538 fix getUniqueFileSaveName , by providing collectionPath too for checking if file already exists at the fileSavePath 2021-12-07 14:16:37 +05:30
Abhinav c3e7578019 Merge branch 'master' into fix-queue-processing-order 2021-12-07 13:19:26 +05:30
Abhinav e925663dba make internal function private 2021-12-07 13:19:10 +05:30
Abhinav 1476e68e3c use queueProcessor to make update sequential 2021-12-07 13:14:21 +05:30
Abhinav 710ffd202b add missing await for saveFileToDisk 2021-12-07 12:56:50 +05:30
Abhinav 2424767e79 null safe variable 2021-12-07 12:54:11 +05:30
Abhinav 42817eb8d2 better function name 2021-12-07 12:53:32 +05:30
Abhinav 8be93db2db use exists electron API to remove the need of in memory used fileName and collectionName maps 2021-12-07 11:53:48 +05:30
Abhinav 7df09a17ea cleanup 2021-12-03 20:20:56 +05:30
Vishnu Mohandas 79046cc694
Enable batch edit of creation-time for 243 2021-12-03 10:08:54 +05:30
Abhinav 7969d20a76 test 2021-12-02 14:54:07 +05:30
Abhinav e5b9ad70e8 remove script hash 2021-12-02 14:47:25 +05:30
Abhinav 4b032058d7 move all directive except script-src to header 2021-12-02 14:33:36 +05:30
Abhinav 14094d1ad0 added unsafe inline as fallback to hash for script-src 2021-12-02 13:25:18 +05:30
Abhinav 25ef3a8a44 make content security active 2021-12-02 13:12:07 +05:30
Abhinav d51335b630 better formatted csp 2021-12-02 12:57:44 +05:30
Abhinav 366a283f65 move csp to meta tag in document to add inline script hash 2021-12-02 12:03:25 +05:30
Shailesh Pandit 39386941f5 Sync people index only after new files are synced 
Maintain files and people latest versions
 2021-12-01 19:21:02 +05:30
Shailesh Pandit 498603eb34 Clear tf memory usage after each sync run 2021-12-01 19:00:57 +05:30
Shailesh Pandit 7bfddfedce Handle async updates in PeopleList 2021-12-01 11:18:36 +05:30
Abhinav e9e777f5eb better function name 2021-11-30 22:51:47 +05:30
Abhinav 9dfcbacaea adds comments 2021-11-30 12:23:11 +05:30
Abhinav c84ee17a7c move version check logic to migrateExport function 2021-11-30 12:18:02 +05:30
Abhinav 13cb4338ff update sanitize name function 2021-11-30 11:57:50 +05:30
Abhinav a0708ac3f8 log dateTime value on getUNIXTime fail 2021-11-30 11:15:36 +05:30
Abhinav 0e57c8830b fail safe error handling 2021-11-30 11:14:33 +05:30
Abhinav cff0959cf3 Merge branch 'master' into export-v2 2021-11-29 14:56:22 +05:30
Abhinav c443bae39a add null check before trying to update exif with edited value 2021-11-29 14:39:11 +05:30
Abhinav 9454540175 update name to getCachedOriginalFile 2021-11-29 14:14:28 +05:30
Abhinav 3a0e6b2f98 renamed get preview to getThumbnail 2021-11-29 14:12:24 +05:30
Abhinav a1672d3c2f handle saving to cache in getPreview itself 2021-11-29 14:11:41 +05:30
Abhinav 1f3734b577 fix isFileHEIC check 2021-11-29 12:09:21 +05:30
Abhinav 9e3c294775 check in memory cache for thumbnail before hitting browser cache 2021-11-29 12:08:53 +05:30
Abhinav f997c7457a use converted suffix instead of forPreview to to avoid duplicate download of unconverted files 2021-11-29 11:18:28 +05:30
Abhinav f688d620cc prevent duplicate file download calls 2021-11-29 10:42:46 +05:30
Shailesh Pandit 1d41644ac8 Add people to search, filter photos by person 2021-11-28 21:45:44 +05:30
Shailesh Pandit af130f803b Set person face chip to one having max pixels 
And detection probability score
 2021-11-28 11:28:13 +05:30
Shailesh Pandit e96e1a9ee4 Show people face chips in info panel of image 2021-11-28 11:17:56 +05:30
Abhinav 4b93b9e9a4 only show progress bar if sync not in progress 2021-11-27 16:47:54 +05:30
Shailesh Pandit 52b20c9783 Rename personId to id 2021-11-27 15:40:29 +05:30
Abhinav 6ba24037e1 add download logic 2021-11-27 15:40:15 +05:30
Shailesh Pandit 320099df59 Sync people from generated clusters 
Update personId in faces
 2021-11-27 15:31:03 +05:30
Abhinav 97b9ac0626 add download all button 2021-11-27 13:23:05 +05:30
Shailesh Pandit 83e21d7aab Fix build, better naming, disable tsne 2021-11-27 11:34:26 +05:30
Shailesh Pandit 0d72fccd7a Streamline clustering config and service 
Fix tsne
MLDebug to have start and stop ml sync
 2021-11-27 09:55:39 +05:30
Shailesh Pandit 8d6ec08d08 Run clustering on all faces in db 2021-11-26 20:31:34 +05:30
Shailesh Pandit b4ad482431 Process new and outdated files in ml sync 2021-11-26 19:59:13 +05:30
Abhinav fe6d0c4125 merge master into export-v2 2021-11-26 12:06:58 +05:30
Abhinav 33bd80f571 fix metadata json map setting 2021-11-26 12:04:46 +05:30
Vishnu Mohandas 935f480b04
Merge pull request #250 from ente-io/photoswipe-error-handling 
fixes photoswipe issues
 2021-11-25 23:07:14 +05:30
Shailesh Pandit 1f0853debd Run ml-worker batches continuously 
Persist versioned faces in indexdb
 2021-11-25 22:08:28 +05:30
Abhinav 80e26b10b7 fix width and height missing from photoswipe items 2021-11-25 17:25:56 +05:30
abhinavkgrd 4c30c45724
Merge pull request #249 from ente-io/ffmpeg-load-fail-handling 
ffmpeg load fail handling
 2021-11-25 12:11:53 +05:30
abhinavkgrd 863b814d88
Merge pull request #237 from ente-io/fix-file-type-not-logged 
missed a place where type info was not logged
 2021-11-25 11:55:19 +05:30
Abhinav 7f8d2b84c8 clear failed ffmpeg instance..so new load is trigerred 2021-11-25 11:28:16 +05:30
abhinavkgrd 5e3551e8c3
Merge pull request #246 from ente-io/stripe-redirect 
Stripe redirect fix
 2021-11-24 14:05:36 +05:30
abhinavkgrd d1e98d17a5
Merge pull request #247 from ente-io/fix-multi-folder-detection 
Fix multi folder detection
 2021-11-24 13:51:43 +05:30
Abhinav-grd e4e58fd905 fallback to creationTime if modification time missing 2021-11-23 22:08:51 +05:30
Abhinav-grd 66eb9478aa add debug logs 2021-11-23 21:43:37 +05:30
Abhinav ca86255bd3 use app context instead of locl storage key 2021-11-23 17:55:04 +05:30
Abhinav 18878ec240 remove console logs 2021-11-23 17:24:58 +05:30
Abhinav e204fb2aef fix multiple folder detection 2021-11-23 17:24:58 +05:30
Abhinav 7bd3a4ad42 Revert "preserve other query param during collection url set" 
This reverts commit 4d5fae1591.
 2021-11-23 10:44:56 +05:30
Abhinav 62a761e5ca handle missing key or token 2021-11-23 09:45:19 +05:30
Abhinav f592a04ad2 prevent router loop 2021-11-23 09:40:19 +05:30
Abhinav cb3775c690 dont need shallow update 2021-11-23 00:01:42 +05:30
Abhinav 0c8ad4b67c wait for router ready before checkSubscriptionPurchase 2021-11-22 22:59:34 +05:30
Abhinav 4bdbc36b25 fix change 2021-11-22 22:32:30 +05:30
Abhinav 97a3eef465 preserve rest queryParam after checkSubscriptionPurchase 2021-11-22 22:10:05 +05:30
Abhinav 4d5fae1591 preserve other query param during collection url set 2021-11-22 22:09:25 +05:30
Abhinav 879ab66c08 save redirectURL in localStorage before auth redirect 2021-11-22 21:54:32 +05:30
Shailesh Pandit 986f514cba Hide clustering params not used in hdbscan 2021-11-22 11:53:59 +05:30
Shailesh Pandit 9068b5643a Limit tsne to 200 faces 
As it takes exponential time and 200 faces is enough for analysis
 2021-11-22 11:49:05 +05:30
Abhinav dcc13dc317 fix UI 2021-11-22 11:40:04 +05:30
Shailesh Pandit d16837262d Use arcface alignment for mobilefacenet 
Use rotation alignment in blazeface to fapi flow
Extract aligned face images before embeddings calculations
 2021-11-20 14:56:36 +05:30
Abhinav e13787df7a only pass non trashed file user files for search 2021-11-20 12:15:51 +05:30
Abhinav 8929f235e7 improve error handling 2021-11-20 12:06:25 +05:30
Abhinav b95be7bf06 fix style 2021-11-19 02:21:10 +05:30
Abhinav e3aa37c09e update copy 2021-11-19 01:50:59 +05:30
Abhinav 56791e2c91 update layout 2021-11-19 01:36:58 +05:30
Abhinav 60fef97f7b update copies 2021-11-19 01:34:54 +05:30
Abhinav db92ac123f update string 2021-11-19 00:59:56 +05:30
Abhinav 8d6b889126 fix date selector width 2021-11-19 00:49:39 +05:30
Abhinav b928052165 make fix creation time visible to array of userIds 2021-11-19 00:25:11 +05:30
Abhinav 18c6edab2c null check 2021-11-19 00:25:11 +05:30
Abhinav aca752f00e refactor component 2021-11-19 00:25:11 +05:30
Abhinav b2162c4398 add options for fix creation time 2021-11-19 00:24:47 +05:30
Abhinav 91cbbfc3eb refactor date picker into seperate component 2021-11-18 22:20:53 +05:30
Abhinav 2b7e5f2074 one more place with same issue 2021-11-18 10:12:19 +05:30
Abhinav 8c1e7249c6 build fix 2021-11-17 22:33:15 +05:30
abhinavkgrd e913615f57
Merge pull request #221 from ente-io/fix-creation-time 
Fix creation time
 2021-11-17 22:26:16 +05:30
Shailesh Pandit eeec2d1012 Make TFJSFaceEmbeddingService api compatible 2021-11-17 16:42:55 +05:30
Shailesh Pandit 0380fb64e3 Create worker env for face-api without global patch 2021-11-17 16:41:45 +05:30
Abhinav d62739e259 show fix creation for selected user 2021-11-17 15:10:09 +05:30
Abhinav 8d4dff4c38 fix collection unique name and file name 2021-11-17 14:54:26 +05:30
Shailesh Pandit 3764e67709 Add required face-api.js files to work with latest tfjs 2021-11-17 14:14:43 +05:30
Abhinav 2273dcdc76 adds util for getting metadata folderpath 2021-11-17 14:11:04 +05:30
Abhinav eed7f5e288 change updateFileModifyDateInEXIF to updateFileCreationDateInEXIF 2021-11-17 14:06:53 +05:30
Shailesh Pandit 4171e8cb3a Use blazeface for detection, face-api for alignment and embeddings 2021-11-17 14:01:30 +05:30
Abhinav a4654413d4 no need to migrate metadata folder 2021-11-17 13:58:08 +05:30
Abhinav 8ad2d3f23f skip non image file before downoading itself 2021-11-17 13:51:21 +05:30
Abhinav bb9c82db52 remove unused LS_KEYS 2021-11-17 13:36:23 +05:30
Abhinav 0c23ace8ff remove redundant code 2021-11-17 13:29:46 +05:30
Abhinav 84617a3267 trigger popper open only if attributes not null 2021-11-17 13:17:21 +05:30
Abhinav f8de2f21c7 move setProgressTracker to finally block for any case update 2021-11-17 13:16:29 +05:30
Abhinav 80aa50b8fb only try to parse image exif 2021-11-17 13:11:33 +05:30
Abhinav d15cef404d update strings 2021-11-17 13:05:41 +05:30
Abhinav de2acbcf32 fix updateExportTime 2021-11-17 11:58:50 +05:30
Abhinav 29ecff60d6 reorder selection bar icons 2021-11-17 10:29:40 +05:30
Abhinav ff58e8900d clear selection after trigerring fix creation 2021-11-17 10:22:30 +05:30
Abhinav 70b3e59fbf add fix time icon 2021-11-16 17:55:19 +05:30
Abhinav 670dbe2d0f download from photoswipe contain updated exif 2021-11-16 17:21:26 +05:30
Abhinav da02db2a49 update DateTimeOriginal property with editedTime 2021-11-16 17:21:01 +05:30
Abhinav 3de18c4fbd migrate export if previous export version less than current 2021-11-16 16:45:58 +05:30
Abhinav 638dab4421 fix setting fixState on modal open 2021-11-16 13:08:25 +05:30
Abhinav 80fda73a79 move fix CreationTime option to selectionOption bar 2021-11-16 12:27:23 +05:30
Abhinav f94322ddef log the exifparsing inside getExifData itself 2021-11-16 11:40:46 +05:30
Neeraj Gupta 9529521af4
Merge pull request #232 from ente-io/mnemonic 
Add support to show mnemonic recovery key
 2021-11-16 11:25:36 +05:30
Neeraj Gupta e1b683734b
Handle mneomonic recovery code during 2FA recover 2021-11-15 21:39:32 +05:30
Abhinav 799f85b089 fix process queue processed from the end 2021-11-15 13:58:52 +05:30
Shailesh Pandit cbaba79db9 Use hdbscan debug info to visualize mst tree 2021-11-14 16:30:23 +05:30
Abhinav e8aa6141dd bubble up error to caller from queue processor 2021-11-13 12:50:37 +05:30
Shailesh Pandit afa8fc2a81 Use hdbscan implemented following scikit-learn package 2021-11-13 10:41:32 +05:30
Neeraj Gupta 9b333807a2
Add support to show mnemonic recovery key 2021-11-13 00:23:05 +05:30
Abhinav ab73e7f8a9 Merge branch 'master' into close-for-without-edit 2021-11-12 10:53:38 +05:30
Neeraj Gupta ad11422034
Merge pull request #220 from ente-io/fix-file-type-not-logged 
fix file type not logged on image thumbnail generation fail
 2021-11-12 10:50:47 +05:30
Abhinav 07591fe30d update creation Time copies 2021-11-12 10:39:36 +05:30
Abhinav eafa14c155 Merge branch 'master' into export-v2 2021-11-11 13:18:36 +05:30
Abhinav f0787b7dfb refactor code 2021-11-11 13:13:59 +05:30
Abhinav 6a482c937e added error handling for updateFileModifyDateInEXIF 2021-11-11 13:11:16 +05:30
Abhinav 9a3aa75d1e better variable names 2021-11-11 13:07:19 +05:30
Abhinav dd6fbb29df await on returned promised to handle error itself 2021-11-11 13:02:20 +05:30
Abhinav 220d7ba62e fixed date format set in exif 2021-11-11 12:54:28 +05:30
Abhinav f92fa1c331 replace dataURL so that piexif considers file as JPEG 2021-11-11 12:54:28 +05:30
Abhinav 2636568724 if file has edited Time and is jpeg then update the exif ModifyDate with the edited time 2021-11-11 12:54:28 +05:30
Abhinav e6056f0ea3 adds exif update logic 2021-11-11 12:54:28 +05:30