Commit graph

2852 commits

Author SHA1 Message Date
Shailesh Pandit 94a7ec4796 Use new local sync context every batchSize sync
Maintain local sync context in ml service
Sync context to only store counts of files and faces synced
2022-01-18 08:07:18 +05:30
Shailesh Pandit eed5497da8 More logging for queue stats and worker
Temporarily add timeout to livesync queue
2022-01-16 20:30:20 +05:30
Shailesh Pandit 1fa4a8cf66 Update hdbscan to use iterative implementation
to avoid js stack limits
2022-01-16 16:34:40 +05:30
Shailesh Pandit 4999f8b4e0 Extract MAX_FACE_DISTANCE_PERCENT as constant 2022-01-16 13:08:49 +05:30
Shailesh Pandit 43c792e46d Fix local env needing refresh to login
by loading tfjs-tflite as dynamic import
2022-01-16 13:01:29 +05:30
Shailesh Pandit 18db6f44dc Fix SimpleJob to set correct state after stopped 2022-01-16 11:47:04 +05:30
Shailesh Pandit d1bab5ec84 Fix build
Revisit todos
2022-01-15 09:39:27 +05:30
Shailesh Pandit 4845c1d605 Convert not compatible local images before sync
Only sync image types locally
2022-01-15 09:05:56 +05:30
Shailesh Pandit f7a05fcb39 Use pqueue addAll instead of Promise.all
Add timeout to downloads during ml sync
2022-01-14 19:45:39 +05:30
Shailesh Pandit f7f40bf5ec Include actual store in increment version tx 2022-01-14 19:10:42 +05:30
Shailesh Pandit ec0108dda6 Start and stop sync job from debug page
using ml work manager
2022-01-14 15:51:37 +05:30
Shailesh Pandit c454c50341 Select nearest pass2 detection in blazeface
Remove duplicates after 2nd pass
Updated min face detection probability based on results
2022-01-14 12:28:11 +05:30
Shailesh Pandit f5e45a8b73 Show filtered faces based on detection probability
Some styling changes of debug page
2022-01-13 13:39:13 +05:30
Shailesh Pandit 255219f778 Fix idb upgrades
Use oldVersion to apply all required upgrades
2022-01-13 12:03:11 +05:30
Shailesh Pandit 5f6e617f68 Show upto 200 people in search box
Make people list in search box scrollable
2022-01-13 09:28:01 +05:30
Shailesh Pandit 09c9deda5e Disabling large mst binary tree display on ml debug
Fix wrong assumptions in faceId comment
2022-01-13 07:16:54 +05:30
Shailesh Pandit 4cd781d201 Update hdbscan to remove mst tree from storage 2022-01-12 20:35:04 +05:30
Shailesh Pandit c14f8cc90f Display face of person only based on detection probability
Fix comparator of findFirstIfSorted
2022-01-12 14:15:22 +05:30
Shailesh Pandit fbe6e5f8cf Check if old faces are in same order before using
Keep old ml version if present
2022-01-12 12:05:31 +05:30
Shailesh Pandit ef6c564d62 Only set fields related to each ml sync step
Reset error fields on successful sync of file
2022-01-12 10:53:06 +05:30
Shailesh Pandit 7ac252aca8 Handle some non file related errors in ml sync
Handles network error and session expired errors
2022-01-11 19:08:26 +05:30
Shailesh Pandit 864885d586 Update default face clustering parameters 2022-01-11 09:53:19 +05:30
Shailesh Pandit 0c1db302c1 Extract ConfigEditor as component 2022-01-11 09:42:31 +05:30
Shailesh Pandit 2ceca69514 Move ml react components to a folder 2022-01-11 08:44:33 +05:30
Shailesh Pandit bd7be81acf Fix build 2022-01-11 07:08:42 +05:30
Shailesh Pandit aa6b40b724 Make ml sync configs editable on debug page 2022-01-10 22:28:09 +05:30
Shailesh Pandit b90cd62fa8 Store configs in db 2022-01-10 20:20:06 +05:30
Shailesh Pandit 52078b3e5e Ad Dbscan clustering method 2022-01-10 17:38:51 +05:30
Shailesh Pandit cc7d2355f7 Update hdbscan to use cluser selection method and epsilon 2022-01-10 14:56:00 +05:30
Shailesh Pandit 4237b9cfc7 Display clusters and mst in treeview on ml debug
from last clustering run
2022-01-09 22:40:55 +05:30
Shailesh Pandit bb000c0c69 ML Debug refresh for all identified people
Clear people index button
2022-01-09 18:32:25 +05:30
Shailesh Pandit 8eebdb226e Fix: clear old person id in face before reclustering 2022-01-09 17:41:52 +05:30
Shailesh Pandit 90bf35b05d Make minSamples of hdbscan configurable 2022-01-09 10:06:38 +05:30
Shailesh Pandit 0d9d79e979 Display all peope on ml debug 2022-01-09 10:05:13 +05:30
Shailesh Pandit aac2318513 Moving default ml sync configs to constants
Limit sync job max interval to around 15 mins
2022-01-09 07:43:21 +05:30
Shailesh Pandit 2dd48e6ceb MLWorkManager refactor
Extract generic SimpleJob from ML Sync Job
Terminate sync job and live sync workers after work done
2022-01-08 23:27:29 +05:30
Shailesh Pandit c995729ab9 Use face crop cache to store person display face 2022-01-07 19:20:56 +05:30
Shailesh Pandit 03a3a57055 Use only path of cached face crop in export 2022-01-07 13:56:45 +05:30
Shailesh Pandit 1b0d6e8da4 Catch error while showing blob image to not crash app 2022-01-07 09:18:39 +05:30
Shailesh Pandit 0fbb65cb9a Remove one time face interface migration 2022-01-07 09:07:20 +05:30
Shailesh Pandit 3d81ffd84b Export and Import ml data from ml debug 2022-01-07 09:06:18 +05:30
Shailesh Pandit 943fa990cb Migration for new Face interface 2022-01-06 15:05:00 +05:30
Shailesh Pandit 945139b758 Embedding service interface refactor
Use face imageBitmaps as input
Use Float32Array as output and for storage in db
2022-01-06 12:15:26 +05:30
Shailesh Pandit 2b5aafa0bc Rename blazeface and mobilefacenet services 2022-01-06 07:22:05 +05:30
Shailesh Pandit 19c3654926 Rename tfjs face detection and embedding service files 2022-01-06 07:20:29 +05:30
Shailesh Pandit 19aae1a75b Refactor interfaces
Use composition to store face analysis results
Add face id to stored face
2022-01-06 06:49:08 +05:30
Shailesh Pandit 1a41c7c194 Fix getUnidentifiedFaces for empty face crops 2022-01-05 14:43:25 +05:30
Shailesh Pandit b88ccee6ed Update files version after syncLocalFiles 2022-01-05 14:39:55 +05:30
Shailesh Pandit be476995b2 Remove one time migration for face crops 2022-01-05 14:15:49 +05:30
Shailesh Pandit 2f3d06cb4d Migrate face crops from indexdb to cache 2022-01-05 13:54:21 +05:30