Commit graph

936 commits

Author SHA1 Message Date
Abhinav 3c5e74f16d update the files array so that returned files from the function is sorted as the caller expect sorted files and use spread operator so that deep copy of file is used to set state to avoid #212 problem 2021-11-09 17:08:27 +05:30
Abhinav ebe839acf0 Merge branch 'master' into update-file-title 2021-11-09 15:46:12 +05:30
Shailesh Pandit 4bd52d53ee Use HDBSCAN for clustering and visualize results 2021-11-07 19:09:39 +05:30
Shailesh Pandit 48388aa125 Use centroid of cluster as summary
Increase face detection minConfidence
2021-11-07 07:39:28 +05:30
Shailesh Pandit 0ed8df8c17 Make maxFaceDistance configurable 2021-11-06 14:26:12 +05:30
Shailesh Pandit 15fcfbde44 Distribute noise to nearest initial clusters if distance is within limit 2021-11-06 14:03:12 +05:30
Shailesh Pandit dbb5e99fda Restrict face distance further 2021-11-06 11:27:07 +05:30
Shailesh Pandit 833f25e07f Add batch size, return all info to derive face images later
Required to reduce worker -> caller payload size later
2021-11-06 10:59:05 +05:30
Shailesh Pandit 4a94ecbbed Clean tf memory after usage 2021-11-06 09:34:44 +05:30
Shailesh Pandit 0db387cdb1 Tweak default parameters based on initial results 2021-11-05 22:05:10 +05:30
Shailesh Pandit a5453b8858 Add minFaceSize to limit small faces 2021-11-05 21:44:38 +05:30
Shailesh Pandit 6fb22e429c Testing with face face-api.js 2021-11-05 20:56:41 +05:30
Shailesh Pandit 41aad5e205 Add Dlib alignment and other clustering methods 2021-11-05 20:35:23 +05:30
Abhinav b47cf3b1fa await for fetchUploadURLs 2021-11-05 18:36:25 +05:30
Shailesh Pandit e5597dc017 Get only unique files for ml sync 2021-11-05 14:03:23 +05:30
Abhinav 91825db617 Merge branch 'master' into update-file-title 2021-11-05 13:26:12 +05:30
Shailesh Pandit 4d1f8d28ac Undo changes which got removed 2021-11-05 11:24:10 +05:30
Abhinav 80ba92c98c dont export getCollectionLastSyncTime 2021-11-04 19:25:19 +05:30
Abhinav 7444ad183e dont set files directly to state, use a copy 2021-11-04 19:01:02 +05:30
Abhinav d2ee821977 refactored getCollectionLastSyncTime 2021-11-04 18:53:35 +05:30
Abhinav 8d79b443fe add setLocalFile and remove appendPhotoSwipeProps funcitons 2021-11-04 18:46:04 +05:30
Shailesh Pandit aeccc14d3c Make clusterFaceDistance and minClusterSize configurable on ml debug page 2021-11-04 18:23:41 +05:30
Shailesh Pandit 15707f8344 WIP: hacks to ignore dom access from web worker 2021-11-04 17:41:37 +05:30
Shailesh Pandit 955e2e965f Add dbscan clustering 2021-11-04 17:01:00 +05:30
Shailesh Pandit 6d126e1569 Run face detection and embeddings on all local files 2021-11-04 16:48:10 +05:30
Shailesh Pandit 551e91d278 Add TFJSFaceEmbeddingService and tflite model
Set wasm path
2021-11-04 16:35:09 +05:30
Shailesh Pandit 9c70801a16 Add tfjs wasm files, set wasm files path 2021-11-04 16:31:56 +05:30
Shailesh Pandit 2f767ed83f Add TFJSFaceDetectionService 2021-11-04 16:11:07 +05:30
Shailesh Pandit 377400228a Machine learning worker
Call machine learning service inside a worker
ML Debug page to trigger worker
2021-11-04 15:18:30 +05:30
Vishnu Mohandas 8f77bda4c6
Merge pull request #210 from ente-io/update-change-creation-time-ui
Update change creation time UI
2021-11-03 22:02:52 +05:30
Abhinav e573a7f180 fix file not found chrome error 2021-11-03 21:24:46 +05:30
Abhinav 4c5df92e51 add max and min time limit 2021-11-03 20:06:00 +05:30
Abhinav e6a3ac35ee Merge branch 'master' into fix-creation-time 2021-11-03 16:05:32 +05:30
Abhinav 5095bde562 adds updateCreationTimeWithExif script 2021-11-03 16:03:01 +05:30
Vishnu Mohandas d8eb2231be
Merge pull request #207 from ente-io/migrate-trashed-file-thumbnail
migrate trashFiles thumbnail too
2021-11-03 15:53:23 +05:30
Abhinav 801de8f3cc add log if all large thumbnail are not present locally 2021-11-02 21:05:23 +05:30
Abhinav ee67921a75 migrate trashFiles thumbnail too 2021-11-02 20:59:31 +05:30
Abhinav af302f6980 send fileType info with exif data missing logs 2021-11-02 20:50:07 +05:30
Abhinav 99169e407a correct lower limit edited time 2021-11-02 14:10:03 +05:30
Abhinav f43e2cf6d6 added file name charcter limit 2021-11-02 13:21:00 +05:30
Abhinav 0263e5cb38 ad change file title logic 2021-11-02 13:05:41 +05:30
Abhinav 3eaf583f7b return upated file as updateMagicMetadata response 2021-11-02 12:22:38 +05:30
Abhinav 916e84c58e reafactor code 2021-11-02 11:52:13 +05:30
Abhinav 5b95215e07 mergeMetadata before every setFiles call 2021-11-02 11:13:35 +05:30
Abhinav 9603fba46c adds max and min date limit 2021-11-01 23:53:34 +05:30
Abhinav 4b3e9f9e08 Merge branch 'master' into update-creation-time 2021-11-01 22:37:55 +05:30
Abhinav d9fae0bf5d Merge branch 'master' into update-creation-time 2021-10-31 19:25:21 +05:30
Abhinav df0bfd0c2b fix update magic metadata 2021-10-30 20:39:52 +05:30
Abhinav ebccb6a981 merge metadatas before sorting 2021-10-30 20:35:45 +05:30
Abhinav dc794090a6 update pubMagicMetadat prop name from creationTime to editedTime 2021-10-30 19:02:17 +05:30
Abhinav 1fe2766ce9 Merge branch 'master' into collection-diff-v2 2021-10-30 08:36:38 +05:30
Abhinav 243a39c904 update to collection diff v2 2021-10-30 08:26:30 +05:30
Abhinav 8fb7146236 use public metadata creation time for sorting 2021-10-29 17:39:57 +05:30
Abhinav 69c9f423fe adds publicMetadata data update and parsing logic 2021-10-29 17:22:08 +05:30
Abhinav 8afcd3a766 refactor changeFilesVisibility to have a seperate updateMagicMetadata function and move encryption logic to upateMagicMetadata API 2021-10-29 17:15:06 +05:30
Abhinav c918225f4a updates MagicMetadata related type definations 2021-10-29 17:11:13 +05:30
Abhinav ed6be1cde1 fix generateThumbnail call during replaceThumbnail 2021-10-29 14:20:45 +05:30
Abhinav-grd 2689e81da0
Merge pull request #195 from ente-io/better-error-logs
improved error logs for failures during thumbnail generation
2021-10-29 09:56:10 +05:30
Abhinav 7ccc0b59f7 Merge branch 'master' into trash 2021-10-28 14:36:20 +05:30
Abhinav d5902aae84 Merge branch 'master' into remove-file-from-collection 2021-10-28 14:09:42 +05:30
Abhinav 86f1891d77 Merge branch 'master' into remove-file-from-collection 2021-10-28 14:08:01 +05:30
Abhinav 165958f772 Merge branch 'master' into migrate-large-thumbnails 2021-10-27 13:46:47 +05:30
Abhinav 244f59c7a6 Merge branch 'master' into better-error-logs 2021-10-27 13:30:54 +05:30
Abhinav b07ffbd820 make ffmpeg thumbnail output height to 720 2021-10-27 12:51:15 +05:30
Abhinav b587ea70fa fix file name of ffmpeg in-memory file 2021-10-27 12:43:03 +05:30
Abhinav c4dc9926e0 return file extension asexactType if file type detection fails 2021-10-27 11:43:13 +05:30
Abhinav 384fd9799a improved error logs for failure during thumbnail generation 2021-10-27 11:33:02 +05:30
Abhinav e850c8c242 fix typo 2021-10-27 10:55:43 +05:30
Abhinav 242deebb4c make max dimension(width or height) = 720px 2021-10-27 10:30:57 +05:30
Abhinav 81c77790df add comments 2021-10-27 09:13:43 +05:30
Abhinav 60c820a9be refactor code 2021-10-27 09:13:43 +05:30
Abhinav 01dc6142d0 log thumbnail dimension too 2021-10-27 09:13:43 +05:30
Abhinav 23356bf132 update thubnail dimension calculation 2021-10-27 09:13:43 +05:30
Abhinav-grd 197d5b49b4
Merge branch 'master' into migrate-large-thumbnails 2021-10-26 18:16:57 +05:30
Abhinav 6111ac87e2 clearLocalTrash after empty trash api call 2021-10-26 16:49:46 +05:30
Abhinav 9d6ae6afea show empty trash button only when trash has files 2021-10-26 16:42:32 +05:30
Abhinav d57f829adc pass files to trashService to get latest files 2021-10-26 16:33:06 +05:30
Abhinav 9aaac2b232 adds new empty trash api 2021-10-26 13:04:40 +05:30
Abhinav-grd f6106e70d1
Merge pull request #188 from ente-io/improve-thumnail-compression
Improve thumnail compression
2021-10-26 12:31:13 +05:30
Abhinav e984eb9be9 improve variable names and fix compression loop condition 2021-10-26 12:11:00 +05:30
Abhinav 192229e1e1 reduce max-compression quality to 50% 2021-10-26 11:36:58 +05:30
Abhinav aaf74290c3 updated trash diff fetch 2021-10-26 11:19:44 +05:30
Abhinav dac5ea727a updated min and max compression quality and MAX_THUMBNAIL_SIZE 2021-10-25 20:10:53 +05:30
abhinav-grd 18b27f5f08 dont have seperate preview file entry for video 2021-10-21 16:12:00 +05:30
abhinav-grd 6097e76fad fixed thumbnail and file download not retried after fail 2021-10-21 13:47:11 +05:30
abhinav-grd 8970741158 fix file download even if present in local bug 2021-10-19 18:19:29 +05:30
abhinav-grd d3b73eaa6b fix file not retrying download after a fail 2021-10-19 17:12:56 +05:30
abhinav-grd 1373a955aa make downloadThumb private correctly 2021-10-19 17:11:34 +05:30
abhinav-grd 47914f5281 reduce quality linearly 2021-10-19 15:46:15 +05:30
abhinav-grd 175e323c47 log thumbnail size greater than max limit 2021-10-19 14:02:11 +05:30
abhinav-grd 78a69a6d33 if compression more than min compression diff keep on compressing 2021-10-19 13:58:10 +05:30
abhinav-grd b53c978093 set REPLACE_THUMBNAIL_THRESHOLD to 500KB 2021-10-19 13:49:03 +05:30
abhinav-grd c9959994a5 rename migrate to migrateThumbnailService 2021-10-18 16:25:29 +05:30
abhinav-grd bc561f804b Revert "testing large thumbnails"
This reverts commit 96e9e54112.
2021-10-18 16:18:40 +05:30
abhinav-grd 1054380d09 show fix thumbnail dialog if large thumbnail present on load 2021-10-18 13:56:13 +05:30
abhinav-grd 96e9e54112 testing large thumbnails 2021-10-18 12:03:18 +05:30
abhinav-grd 2789a14eeb adds local state for fixLargeThumbnails 2021-10-18 11:49:57 +05:30
abhinav-grd 6681b601a3 completes fix thumbnail modal UI 2021-10-18 11:07:59 +05:30
Abhinav-grd 04dfe6a969
Merge pull request #184 from ente-io/save-fav-collection
Fixes Error removing from favorite
2021-10-18 10:29:46 +05:30
Abhinav-grd 1249421e4c
Merge pull request #179 from ente-io/search-files
Search files
2021-10-18 10:29:18 +05:30
abhinav-grd c095031b8e add newly created favorite collection to localCollections 2021-10-09 15:19:33 +05:30
abhinav-grd b399c50e65 fix MAX_THUMBNAIL_SIZE name typo and exported it 2021-10-08 19:57:38 +05:30
abhinav-grd d14217400a added migrate service to update large thumbnails 2021-10-08 19:56:49 +05:30
abhinav-grd b7c6eb8a2f updated _downloadThumb into getThumbnail to get uint8array as output 2021-10-08 19:56:06 +05:30
abhinav-grd 11eb962f79 compress thumbnail generated from ffmpeg using canvas method 2021-10-08 13:46:11 +05:30
abhinav-grd 3de8b0bfbe generate jpeg thumbnail with 512*512 resolution and jpeg format 2021-10-08 13:20:54 +05:30
abhinav-grd cbe1d8ce88 show only one instance of a file 2021-10-07 17:03:57 +05:30
abhinav-grd 9fa1c1fc09 fix owner photo filtering 2021-10-07 17:03:57 +05:30
abhinav-grd 9afd224a23 dont show shared files in options 2021-10-07 17:03:57 +05:30
abhinav-grd 828844151c show only four file search results 2021-10-07 17:03:57 +05:30
abhinav-grd 950adae9b3 Adds file search by name 2021-10-07 17:03:50 +05:30
abhinav-grd 798163f733 adds deleteBy caption to photo preview 2021-10-04 20:27:45 +05:30
abhinav-grd e3af66da9e Merge branch 'remove-file-from-collection' into trash 2021-10-04 18:39:11 +05:30
abhinav-grd 0e0e1f777d Merge branch 'master' into remove-file-from-collection 2021-10-04 18:30:39 +05:30
abhinav-grd 15a913e5fa fix trashItem decryption fail bug 2021-10-04 13:46:09 +05:30
abhinav-grd 1658d561cb decrypt collection in getColletion API 2021-10-04 13:45:32 +05:30
abhinav-grd d8d86eb967 added restoreToCollection API 2021-10-04 12:44:45 +05:30
abhinav-grd db066090f0 moved appendPhotoSwipeProps to getTrashedFiles 2021-10-04 11:39:23 +05:30
abhinav-grd 7497865172 added trash and delete from trash options 2021-10-04 11:03:03 +05:30
abhinav-grd d8801bf8bc added isTrashed Property to file interface 2021-10-01 12:16:07 +05:30
abhinav-grd a034504679 added getCollection API 2021-10-01 12:15:44 +05:30
abhinav-grd e28154e5b1 added trash service 2021-10-01 12:11:48 +05:30
abhinav-grd 0fc184d994 dont log collections missing from collectionsAndTheirLatestFile list 2021-09-30 17:56:28 +05:30
abhinav-grd d495ba8d86 updated error logging 2021-09-30 13:55:33 +05:30
abhinav-grd 2e6193b64b fixes favorite collection sorting 2021-09-30 13:02:58 +05:30
abhinav-grd 22a15d30aa collectionAndThierLatestFIle null check 2021-09-30 12:36:43 +05:30
abhinav-grd 7e738e1627 fix sort by latest file 2021-09-28 19:21:54 +05:30
abhinav-grd 4941cb514e Merge branch 'master' into search-collection 2021-09-28 16:30:42 +05:30
abhinav-grd 8deb45a358 updates collection delete to use the new API 2021-09-28 14:39:08 +05:30
abhinav-grd 44f01d128c upates delete file to trash file 2021-09-28 14:39:06 +05:30
abhinav-grd 497b97c26d adds collection ops remove logic 2021-09-28 13:55:15 +05:30
abhinav-grd d54e27b0be passes CollectionAndThierLatest file to Collection component and add sorting by latest file logic 2021-09-27 11:51:26 +05:30
abhinav-grd b9c41ea532 adds sharedCollections to collectionAndTheirLatestFile
This is needed because when sorting we use collectionsAndThierLatestFile to sort based on latest file and we need shared Collection file there
2021-09-27 11:36:06 +05:30
abhinav-grd 96711f7462 lowercase the text before searching for suggestions 2021-09-24 19:41:01 +05:30
Abhinav-grd 8ea85efafb
Merge pull request #155 from ente-io/archive
Archive
2021-09-24 18:40:22 +05:30
abhinav-grd 23cef6b9af Merge branch 'master' into search-collection 2021-09-24 14:06:02 +05:30
abhinav-grd dcc3f6665d searchCollection service function 2021-09-23 00:16:02 +05:30
abhinav-grd 1fe6875a14 first set collections and then its updation time ,to prevent bad state of time updated by collections not persisted 2021-09-22 19:38:21 +05:30
abhinav-grd 46471d4c25 Revert "added queue processor to file decryption"
This reverts commit 3cab5372e9.
2021-09-22 14:52:50 +05:30
abhinav-grd 6cf696a164 Merge branch 'disable-shared-collection-ops' into archive 2021-09-22 13:25:16 +05:30
abhinav-grd c98d4792be Merge branch 'move-files' into disable-shared-collection-ops 2021-09-22 12:34:12 +05:30
abhinav-grd 0bb82c189e better variable names 2021-09-21 17:52:31 +05:30
abhinav-grd 3cab5372e9 added queue processor to file decryption 2021-09-21 17:13:18 +05:30
abhinav-grd a26722d8de refactor deleteFileHelper and delete API 2021-09-21 16:09:04 +05:30
abhinav-grd 3021fd4a43 update updateMagicMetadata API 2021-09-21 16:07:53 +05:30
abhinav-grd 0b62609591 added updateMagicMetadata 2021-09-21 13:33:15 +05:30
abhinav-grd 78533c01e9 adds magicMetadata decryption logic 2021-09-21 13:15:17 +05:30
abhinav-grd 57aa358865 hides archived from all section 2021-09-21 13:00:39 +05:30
abhinav-grd 5ec72c2550 added ownerID to check if file is a shared file 2021-09-21 12:07:39 +05:30
abhinav-grd 5fcde0b6e6 added isShared property to collection and isSharedCollectionActive state 2021-09-20 19:16:08 +05:30