Commit graph

57 commits

Author SHA1 Message Date
Shailesh Pandit f6f701061c Merge branch 'master' into machine-learning 2022-01-31 19:41:59 +05:30
Shailesh Pandit 94a7ec4796 Use new local sync context every batchSize sync
Maintain local sync context in ml service
Sync context to only store counts of files and faces synced
2022-01-18 08:07:18 +05:30
Abhinav bd3d6d84ce use global file reader and reuse them wherever possible 2022-01-07 18:28:22 +05:30
Shailesh Pandit 4ebcddbb84 Provision to run ml sync on original images
To capture high resolution face images
Use ImageBitmap till tf models as tf manipulations on variable dimention images leads to gpu memory leak - https://github.com/tensorflow/tfjs/issues/604
2021-12-20 22:20:20 +05:30
Shailesh Pandit 2d17dd30e9 For uploaded files use local files for ML Sync
Extract out ML work manager and sync job from worker
Start and stop ML Sync job on app start, login and logout
2021-12-12 23:12:18 +05:30
Shailesh Pandit 320099df59 Sync people from generated clusters
Update personId in faces
2021-11-27 15:31:03 +05:30
Shailesh Pandit 0d72fccd7a Streamline clustering config and service
Fix tsne
MLDebug to have start and stop ml sync
2021-11-27 09:55:39 +05:30
Shailesh Pandit b4ad482431 Process new and outdated files in ml sync 2021-11-26 19:59:13 +05:30
Shailesh Pandit 1f0853debd Run ml-worker batches continuously
Persist versioned faces in indexdb
2021-11-25 22:08:28 +05:30
Shailesh Pandit 0ed8df8c17 Make maxFaceDistance configurable 2021-11-06 14:26:12 +05:30
Shailesh Pandit 833f25e07f Add batch size, return all info to derive face images later
Required to reduce worker -> caller payload size later
2021-11-06 10:59:05 +05:30
Shailesh Pandit a5453b8858 Add minFaceSize to limit small faces 2021-11-05 21:44:38 +05:30
Shailesh Pandit aeccc14d3c Make clusterFaceDistance and minClusterSize configurable on ml debug page 2021-11-04 18:23:41 +05:30
Shailesh Pandit 377400228a Machine learning worker
Call machine learning service inside a worker
ML Debug page to trigger worker
2021-11-04 15:18:30 +05:30
abhinav-grd 760cdef036 update decryptMetadata to handle any generic json decryption 2021-09-21 13:14:29 +05:30
Abhinav-grd 07d44846be replaced heic2any pacakeg with heic-convert and use custom worker 2021-09-07 14:54:08 +05:30
Abhinav-grd 16e287d1ce added comment for file import fail error 2021-08-18 12:43:14 +05:30
Abhinav-grd 9b49e15d5c moved file reading ot worker 2021-08-18 10:02:27 +05:30
Abhinav-grd ed049bac9a formatted source files 2021-08-13 08:17:10 +05:30
Abhinav-grd 465100a69f use URLSafeB64 conversion 2021-06-14 20:58:39 +05:30
Pushkar Anand e66817c43b Eslint rule update 2021-05-30 22:26:48 +05:30
Pushkar Anand adb6af09ce Added eslint 2021-05-29 11:57:52 +05:30
Abhinav-grd e039aeb4ba added crypto boxSeal function 2021-04-28 14:29:05 +05:30
Abhinav-grd 48d0be32db added fromHex crypto function 2021-04-05 15:54:20 +05:30
Abhinav-grd b3dc992c23 rename generateMasterKey to generateEncryptionKey 2021-04-05 15:00:47 +05:30
Abhinav-grd d674717cb0 added new crypto function toHex 2021-04-05 13:32:02 +05:30
Abhinav-grd d5a416997a added deriveIntermediateKey crytpo function 2021-04-01 18:45:51 +05:30
Vishnu Mohandas dcbe7d4c4e Use sensitive ops and mem limits to derive key 2021-03-18 15:26:40 +05:30
Abhinav-grd 05a8e02282 Merge branch 'master' into lfu-with-multipart 2021-03-14 15:51:11 +05:30
Pushkar Anand 23d1ee3ab9 Merge branch 'master' of https://github.com/ente-io/bada-frame into test-video-streaming 2021-03-08 10:01:52 +05:30
Abhinav-grd 476de9f262 added initChunkEncryption encryptFileChunk crypto functions 2021-03-02 15:33:11 +05:30
Abhinav-grd 85f17f0108 corrected libsodium function call 2021-02-16 17:20:53 +05:30
Abhinav-grd 4bbfb61f56 fixed collection name decryption 2021-02-16 17:13:21 +05:30
Abhinav-grd 1d5473f3dd added braces everywhere and formated all files 2021-02-09 15:04:10 +05:30
Abhinav-grd 2a1f916794 added decryptString function and updated fromB64 to parse normal string 2021-01-21 07:43:10 +05:30
Abhinav-grd 64b5500d36 modified cryto util to handle b64 to uint8Array conversion and have all keys as base64 string outside the util 2021-01-18 09:13:16 +05:30
Abhinav-grd d4cd0ed099 added encryptToB64 worker function 2021-01-11 13:50:49 +05:30
Abhinav-grd e6917adc50 improved metadata handling 2021-01-09 09:17:05 +05:30
Abhinav-grd 63a7586a6d corrected encryptMetadata function 2021-01-08 18:44:31 +05:30
Abhinav-grd f073d9c187 corrected encryptMetadata function 2021-01-08 13:14:56 +05:30
Abhinav-grd 01852b67a8 added encryptThumbail and encryptMetaData functions 2021-01-08 09:37:50 +05:30
Abhinav-grd 73ee2453c6 created encryptFile cryptoWorker function 2021-01-07 16:19:03 +05:30
Pushkar Anand d9b37f93c7 Its something. 2020-12-31 22:49:33 +05:30
Vishnu Mohandas a85ef0de9a Add functionality to download and decrypt files 2020-11-21 20:26:36 +05:30
Vishnu Mohandas f6381a78a0 Decrypt shared collection files 2020-11-20 12:29:27 +05:30
Vishnu Mohandas a9e0821db0 Generate and set user's private and public key pair 2020-11-07 15:57:59 +05:30
Vishnu Mohandas 01e57a212b Update file decryption mechanism 2020-10-19 08:31:34 +05:30
Pushkar Anand cdccfd3372 Fix crypto bug. 2020-10-03 20:20:10 +05:30
Pushkar Anand ad1e90dfcc Moved libsodium to worker. 2020-10-03 19:51:56 +05:30
Vishnu Mohandas 31106f1eca Update crypto worker to pipe calls via the libsodium util 2020-10-01 06:58:52 +05:30