Commit graph

1142 commits

Author SHA1 Message Date
Abhinav 65667ac416 update to use single use ffmpeg st 2022-03-05 18:44:44 +05:30
Abhinav 98f1f98650 add progress bar for metadata extraction 2022-03-05 13:32:57 +05:30
Abhinav 6406867770 update to use the local ffmpeg wasm package 2022-03-05 12:39:17 +05:30
Abhinav 009590ef54 add option to skip put for local 2022-03-05 07:51:02 +05:30
Abhinav ff11cb14bc verbose logs 2022-03-04 13:14:39 +05:30
Abhinav 76776fcf5d set file name for converted file 2022-03-04 11:13:38 +05:30
Abhinav 3c0dc7a63d log skipped files 2022-03-04 09:35:53 +05:30
Abhinav 9d5917516c Revert "log last attemped video metadata extraction"
This reverts commit d72f16a884.
2022-03-04 09:24:15 +05:30
Abhinav 685bc14899 added upload logs and download log option 2022-03-04 09:16:18 +05:30
Abhinav 72e0f7318c add upload logs 2022-03-04 08:40:14 +05:30
Abhinav d72f16a884 log last attemped video metadata extraction 2022-03-04 07:27:33 +05:30
Abhinav Kumar f24f2bd00f
Merge pull request #411 from ente-io/log-failed-files
Log failed files
2022-03-03 19:03:04 +05:30
Abhinav 9225cb70fa log file size along with file name 2022-03-03 17:15:02 +05:30
Neeraj Gupta 0e32b2ac89
Merge branch 'master' into settings_button 2022-03-03 16:51:52 +05:30
Abhinav 17dd56a999 log failed files only 2022-03-03 14:53:20 +05:30
Abhinav 5bf20e046e log failed files in localDB 2022-03-03 09:33:18 +05:30
Rushikesh Tote 5c40812b4c
Merge branch 'master' 2022-03-03 00:00:01 +05:30
Abhinav Kumar 913a3a65aa
Merge pull request #409 from ente-io/fix-loading
Fix loading
2022-03-02 22:30:44 +05:30
Abhinav ae8db26a00 fix video loader not showing issue 2022-03-02 16:17:06 +05:30
Neeraj Gupta 44eecaf92f
Increase timeout for thumbnail gen 10s -> 30s
During testing, observed that for multiple copies of the same HEIC files, the thumbnail was blank for some files due to timeout error. 
Increasing this timeout fixed the issue.
2022-03-02 12:43:22 +05:30
Rushikesh Tote 28197afd23
Merge branch 'master' into add-livephoto-support 2022-03-02 12:00:55 +05:30
Rushikesh Tote 890c41da69
fixed styling, live photo split 2022-03-01 18:19:07 +05:30
Abhinav a86b9134d2 also check location tag in the metadata as fallback 2022-03-01 12:50:45 +05:30
Abhinav ca13691688 extractedMetadata will allows have the properties so no need of conditional access 2022-02-28 18:27:44 +05:30
Abhinav a866d109e5 rename getUNIXTime to getUnixTimeInMicroSeconds 2022-02-28 17:44:23 +05:30
Abhinav 222167878a better handle metadata extraction failure 2022-02-28 14:03:47 +05:30
Abhinav cf1f55e68a moved types and getUnixTime to time util 2022-02-28 13:48:52 +05:30
Neeraj Gupta a6a4ecbf46
Fix minor bug in put share-url api call 2022-02-28 13:48:30 +05:30
Abhinav a98d35ad66 refactoring moved videoMetadata extraction to seperate service 2022-02-28 13:42:33 +05:30
Abhinav e49a7f9ec9 better types 2022-02-28 13:29:30 +05:30
Abhinav c488d76609 update comment for extractVideoMetadata command 2022-02-28 13:23:34 +05:30
Abhinav 5887aec373 read all available stream metadata dont need to specifically read video and audio streams 2022-02-28 13:05:14 +05:30
Neeraj Gupta 5646fff10b
collectionService: method for updating sharable url 2022-02-28 11:54:08 +05:30
Abhinav a4d81da065 Merge branch 'master' into ffmpeg-video-metadata 2022-02-28 10:47:50 +05:30
Abhinav 540620373b fix minor bugs 2022-02-28 10:34:27 +05:30
Abhinav 1af2dc24ca add metadata extraction logic 2022-02-28 10:34:16 +05:30
Rushikesh Tote 1eee5e8a74
fixed: one ffmpeg process at any time 2022-02-28 10:04:20 +05:30
Rushikesh Tote 6188c9eed4
fixed issues with video conversion 2022-02-27 12:04:51 +05:30
Rushikesh Tote 4e33ce0cf6
Merge remote-tracking branch 'origin/master' into add-livephoto-support 2022-02-26 20:16:32 +05:30
Abhinav 63d3fb34cc fix error message for verify password api 2022-02-26 18:41:52 +05:30
Abhinav bda2423930 fix variable name for get and save LocalPassword and avoid using token directly as collectionUID 2022-02-26 15:37:46 +05:30
Abhinav 0a028e7b07 dont make syncCall if already up to date with collection update time 2022-02-26 14:45:31 +05:30
Abhinav 29c7cc69c7 handle password change case 2022-02-26 14:20:31 +05:30
Abhinav c6dd93270d revert back to using ref for password token 2022-02-26 12:34:43 +05:30
Abhinav 86488ee056 minor changes and refactoring 2022-02-25 15:58:12 +05:30
Neeraj Gupta fc45b94930
switch to different api for validating link password 2022-02-24 21:09:00 +05:30
Rushikesh Tote 60fd87df8f added live photo playback support 2022-02-24 19:26:57 +05:30
Neeraj Gupta bb5b37997e
add support for showing password protected albums 2022-02-23 14:31:00 +05:30
Neeraj Gupta b93fb5167c
remove entry for publicCollection sync time while removing collection 2022-02-22 12:24:56 +05:30
Abhinav Kumar f7cb51f856
Merge pull request #253 from ente-io/live-photo-import
add live photo upload support
2022-02-16 20:18:38 +05:30
Abhinav 671bf0ee2d add live photo detection info section 2022-02-16 13:13:47 +05:30
Abhinav 0474d28aec remove only underscore three from the end 2022-02-16 12:30:34 +05:30
Abhinav 5744def6f2 added logic to show filename in upload progressbar 2022-02-16 12:18:07 +05:30
Abhinav 602f36ee37 use the ext returned from the fileType detection library to set the correct extension for the file 2022-02-16 12:04:16 +05:30
Abhinav 227a04a01f update file type detection function 2022-02-16 12:04:05 +05:30
Abhinav 4d74c62eb2 add try catch wrapper over extractFileMetadata and parseMetadataJSON to prevent one file breaking to progagate cause all of them to fail 2022-02-16 10:44:32 +05:30
Abhinav 3b9841b9c4 use the last index of underscore 2022-02-16 10:13:18 +05:30
Abhinav 47c6fabc05 isImageOrVideo util function and updated the areFilesLivePhotoAssets to allow only image and video as allowed assets 2022-02-16 10:06:28 +05:30
Abhinav 8534f69e96 refactor code 2022-02-16 09:57:33 +05:30
Abhinav 79455d2295 added imageType and videoType property to FleTypeInfo to handle livePhoto case 2022-02-16 09:52:00 +05:30
Abhinav 044b257972 dont need cryptoWorker for thumbnail generation convertService handles it 2022-02-16 09:29:50 +05:30
Abhinav 58dbac8ffd remove underscored suffix added to live photo name while comparing file names 2022-02-16 09:08:35 +05:30
Abhinav 0b34bcbba2 set livePhotoLocalID correctly 2022-02-15 19:21:53 +05:30
Abhinav f58108a55f fix type passed to thumbnail generation for heic detection 2022-02-15 16:32:42 +05:30
Abhinav 0ea457e5f8 fix imageMetadata intialisation 2022-02-15 09:52:17 +05:30
Abhinav c04056569b use image metadata for live photo 2022-02-15 09:48:38 +05:30
Abhinav 80db61133a refactored code to not create stream for livePhotodata assets as they zipping library doesn't support streams 2022-02-15 09:20:41 +05:30
Abhinav 8b668b924a use file name as metadata for some files may be empty 2022-02-15 09:01:19 +05:30
Abhinav 5ff8b857bc add comment and check to avoid larger than multipart file size files to be clustered as livePhoto 2022-02-15 08:12:38 +05:30
Abhinav 08cd6e72ea group same collection files together before live photo clustering 2022-02-14 16:43:56 +05:30
Abhinav 22a489be6e only generate and use image thumbnail for livePhoto 2022-02-14 13:17:10 +05:30
Abhinav ed06e1427e use video thumbnails for livePhotos 2022-02-14 13:05:22 +05:30
Abhinav dab1844223 reuse fileTypeInfo and metdata and fix case where live photos clustering 2022-02-14 12:44:42 +05:30
Abhinav 04f4fd14e3 uploadService getFileMetadata to better name extractFileMetadata to avoid confusion with getFileMetadataAndFileTypeInfo 2022-02-13 16:48:42 +05:30
Abhinav ccd730cf9f minor changes 2022-02-13 16:40:50 +05:30
Abhinav 1398ea22b3 set live photo extension as zip 2022-02-13 16:34:08 +05:30
Abhinav 86a9b86294 handle metadata null case 2022-02-13 16:26:46 +05:30
Abhinav 0fff2ee674 fix minor bugs 2022-02-13 14:40:17 +05:30
Abhinav 87d635be58 Merge branch 'refactor-metadata-extraction-v2' into live-photo-import 2022-02-13 12:59:43 +05:30
Abhinav 7b45aee757 refactor code 2022-02-13 09:43:25 +05:30
Abhinav 13d8c10a60 Merge branch 'master' into live-photo-import 2022-02-13 08:29:16 +05:30
Abhinav bbb78a6c5e update publicCollectionUID template 2022-02-12 14:03:13 +05:30
Abhinav eb23444853 create a POC working model of live photo upload 2022-02-09 10:53:43 +05:30
Abhinav 858315c897 added stage for metadata extraction 2022-02-09 10:32:14 +05:30
Abhinav Kumar c801e8225f
Merge pull request #363 from ente-io/public-link-changes
Public link changes
2022-02-06 16:43:34 +05:30
Abhinav cc04a48d26 send correct header for video download 2022-02-06 15:22:19 +05:30
Abhinav 6d07b63cba remove token and key logging 2022-02-05 20:43:26 +05:30
Abhinav e39eb9c82e remove cacheResp logging 2022-02-05 15:15:40 +05:30
Abhinav b5d19d8ce7 Revert "add better logs to check cache issue"
This reverts commit 83ada844a3.
2022-02-05 15:12:35 +05:30
Abhinav e45f164246 Revert "even better logs"
This reverts commit e3586fa3fe.
2022-02-05 15:11:01 +05:30
Abhinav 54e074bebe add resp.data not undefined check before creating Uint8ArrayBuffer out of it 2022-02-05 15:10:32 +05:30
Abhinav 95a7b871f6 add check to only set data in map if not null 2022-02-05 14:22:07 +05:30
Abhinav 42670853e7 renamed 5GB to better name of max file size supported 2022-02-05 14:10:18 +05:30
Abhinav c9129ce11c remove console logs 2022-02-05 14:03:34 +05:30
Abhinav e3586fa3fe even better logs 2022-02-05 09:35:02 +05:30
Abhinav 83ada844a3 add better logs to check cache issue 2022-02-05 09:27:51 +05:30
Abhinav f361ad516b log cache response 2022-02-04 19:30:50 +05:30
Abhinav 21aab14380 fix things 2022-02-04 00:26:34 +05:30
Abhinav e7c051ac53 refactor metadata extraction 2022-02-03 23:54:36 +05:30
Abhinav 6ffe0acd54 fix comlink type import 2022-02-01 19:10:30 +05:30