Abhinav
d61deaf8f8
fix ml worker use
2023-01-20 21:23:57 +05:30
Abhinav
98685123dd
Merge branch 'better-comlink-types' into ml-alpha
2023-01-20 21:06:42 +05:30
Abhinav
b830510276
add heic-convert types
2023-01-20 16:18:44 +05:30
Abhinav
3b468cb154
Merge branch 'main' into ml-alpha
2023-01-14 21:41:35 +05:30
Abhinav
b795668cd0
fix build
2022-12-04 19:56:27 +05:30
Abhinav
fb32c6de5b
Merge branch 'main' into add-comlink-types
2022-12-04 19:47:30 +05:30
Abhinav
ff9bcde321
fix import
2022-11-14 16:52:20 +05:30
Abhinav
7aad26a315
update ffmpeg worker
2022-11-14 13:47:13 +05:30
Abhinav
362e9a8803
fix import
2022-10-15 06:15:45 +05:30
Abhinav
3db124bc41
rename heicConvertor to wasmHeicConvertor
2022-10-15 00:40:57 +05:30
Abhinav
4341a16938
add ffmpeg worker type
2022-09-18 02:11:13 +05:30
Abhinav
757241b38d
add ConvertWorker type
2022-09-18 02:09:23 +05:30
Abhinav
af295c4240
add cryptoWorker type
2022-09-18 02:07:49 +05:30
Abhinav
e38c663e1a
testing logs
2022-08-19 15:18:22 +05:30
Abhinav
fd020c209f
fix pipe console from worker
2022-08-15 15:49:43 +05:30
Abhinav
5eb0f69c3d
rename proxy services
2022-08-13 11:34:49 +05:30
Abhinav
ce2be79a76
comment testing code
2022-08-13 10:29:33 +05:30
Abhinav
b5062b94c8
make ReverseProxiedElectronCacheStorageProxy a normal class instead of a singleton
2022-08-13 10:08:26 +05:30
Abhinav
ab2f35a147
rename to ReverseProxiedElectronCacheStorageProxy
2022-08-13 09:57:14 +05:30
Abhinav
1c2d4fa109
add ElectronCacheStorageReverseProxy
2022-08-13 09:53:52 +05:30
Abhinav
be6acf03b2
add ProxiedLimitedCacheStorage interface and complete ElectronCacheStorageProxy implementation
2022-08-13 09:53:14 +05:30
Abhinav
60bc437a7f
add manual serialization and deserialization
2022-08-12 17:59:39 +05:30
Abhinav
8c7794b355
use main thread exposed ElectronCacheService inside worker
2022-08-12 17:24:46 +05:30
Abhinav
3e339eee84
Merge branch 'main' into run-ml-button
2022-07-30 10:50:11 +05:30
Abhinav
55ebb509c2
proxy file hashing through comlink
2022-06-23 19:59:57 +05:30
Abhinav Kumar
c580ac60c8
Merge pull request #434 from ente-io/fix-heic-convert-fail
...
Fix heic conversion failing
2022-03-25 22:16:06 +05:30
Abhinav
603d961eca
Merge branch 'master' into settings_button
2022-03-11 19:01:26 +05:30
Abhinav
ec15d63a7f
handle HIEC multiple externally , process two files at a time , using a double the size of that as worker pool also use png as it didn't crash for two parralel files and add a timeout to heic conversion
2022-03-09 11:10:20 +05:30
Abhinav
e8a1f8b042
fix ffmpegClient
2022-03-07 19:07:13 +05:30
Abhinav
de174c2a37
offload ffmpeg operations on custom worker
2022-03-07 18:48:46 +05:30
Neeraj Gupta
8ccb53cf4b
rename deriveIntermediateKey -> deriveInteractiveKey
2022-03-06 21:06:20 +05:30
Neeraj Gupta
9c48b6b120
reuse existing method for generating passhash
2022-03-06 20:59:54 +05:30
Neeraj Gupta
44ef819f07
switch to interactive limit for password hash
2022-03-03 19:43:59 +05:30
Abhinav
f76b1c3ee3
add new worker for conversion
2022-02-01 18:54:44 +05:30
Abhinav
c30fa05b60
add HIECConveter service to queue up and process heic to jpeg conversion
2022-02-01 16:21:47 +05:30
Shailesh Pandit
f6f701061c
Merge branch 'master' into machine-learning
2022-01-31 19:41:59 +05:30
Shailesh Pandit
94a7ec4796
Use new local sync context every batchSize sync
...
Maintain local sync context in ml service
Sync context to only store counts of files and faces synced
2022-01-18 08:07:18 +05:30
Abhinav
bd3d6d84ce
use global file reader and reuse them wherever possible
2022-01-07 18:28:22 +05:30
Shailesh Pandit
4ebcddbb84
Provision to run ml sync on original images
...
To capture high resolution face images
Use ImageBitmap till tf models as tf manipulations on variable dimention images leads to gpu memory leak - https://github.com/tensorflow/tfjs/issues/604
2021-12-20 22:20:20 +05:30
Shailesh Pandit
2d17dd30e9
For uploaded files use local files for ML Sync
...
Extract out ML work manager and sync job from worker
Start and stop ML Sync job on app start, login and logout
2021-12-12 23:12:18 +05:30
Shailesh Pandit
320099df59
Sync people from generated clusters
...
Update personId in faces
2021-11-27 15:31:03 +05:30
Shailesh Pandit
0d72fccd7a
Streamline clustering config and service
...
Fix tsne
MLDebug to have start and stop ml sync
2021-11-27 09:55:39 +05:30
Shailesh Pandit
b4ad482431
Process new and outdated files in ml sync
2021-11-26 19:59:13 +05:30
Shailesh Pandit
1f0853debd
Run ml-worker batches continuously
...
Persist versioned faces in indexdb
2021-11-25 22:08:28 +05:30
Shailesh Pandit
0ed8df8c17
Make maxFaceDistance configurable
2021-11-06 14:26:12 +05:30
Shailesh Pandit
833f25e07f
Add batch size, return all info to derive face images later
...
Required to reduce worker -> caller payload size later
2021-11-06 10:59:05 +05:30
Shailesh Pandit
a5453b8858
Add minFaceSize to limit small faces
2021-11-05 21:44:38 +05:30
Shailesh Pandit
aeccc14d3c
Make clusterFaceDistance and minClusterSize configurable on ml debug page
2021-11-04 18:23:41 +05:30
Shailesh Pandit
377400228a
Machine learning worker
...
Call machine learning service inside a worker
ML Debug page to trigger worker
2021-11-04 15:18:30 +05:30
abhinav-grd
760cdef036
update decryptMetadata to handle any generic json decryption
2021-09-21 13:14:29 +05:30
