Commit graph

104 commits

Author SHA1 Message Date
vishnukvmd 073e2a06e6 Update model path 2023-12-18 12:14:17 +05:30
vishnukvmd 22d24cfd73 Fix warnings 2023-12-18 11:28:32 +05:30
vishnukvmd 8c0b569702 Remove all release calls 2023-12-17 17:46:06 +05:30
vishnukvmd fb11e730ce Skip image model loading 2023-12-16 17:10:39 +05:30
vishnukvmd 621599496e Use ONNX for text embeddings 2023-12-16 16:50:07 +05:30
vishnukvmd d0a85aa146 Fix warnings 2023-12-16 16:22:01 +05:30
0nullpointer 04b4a1fbba Add ggml image preprocessing 2023-12-15 02:45:00 +05:30
vishnukvmd 61a6481de4 Extract variable 2023-12-14 15:38:42 +05:30
0nullpointer cfc0d05a14 image normalization with tensors 2023-12-14 12:02:14 +05:30
vishnukvmd 03f471623b Temporarily parse model from assets 2023-12-14 11:31:01 +05:30
vishnukvmd c35ee381d3 Add ability to clear local embeddings 2023-12-14 11:30:09 +05:30
vishnukvmd 1c488e86a5 Increase batch size for caching thumbs 2023-12-14 11:25:16 +05:30
vishnukvmd 7bbcdb0010 Increase batch size for caching thumbnails 2023-12-13 19:08:05 +05:30
vishnukvmd f5b7897838 Fix thumbnail caching logic 2023-12-13 17:24:27 +05:30
vishnukvmd ad8f7cbccd Cache all thumbnails first 2023-12-13 15:16:34 +05:30
vishnukvmd e1ea9530f1 Remove score threshold 2023-12-13 15:02:35 +05:30
vishnukvmd bbee1c0e41 Fetch only relevant embeddings from disk 2023-12-13 14:56:08 +05:30
vishnukvmd 3ea8fca2f2 Retrieve OrtSession from cached address 2023-12-13 14:55:51 +05:30
vishnukvmd 14acf95a15 Disable embedding push 2023-12-13 14:55:13 +05:30
vishnukvmd 01c82eaf82 Store framework name along with the model name 2023-12-13 14:42:02 +05:30
vishnukvmd 1c0ff2f10c Use the cached address to retrieve the encoder 2023-12-13 14:39:18 +05:30
vishnukvmd b2f9dd2c8b Initialize tokenizer outside the isolate 2023-12-13 14:38:24 +05:30
vishnukvmd f0f4f7f429 Fix logger name 2023-12-13 14:37:36 +05:30
vishnukvmd de3db565f5 Fix asset path 2023-12-13 14:37:26 +05:30
vishnukvmd b59e928a1a Pass final file path to model loader 2023-12-13 12:54:03 +05:30
vishnukvmd dd846d7920 Split ONNX framework into multiple files 2023-12-13 12:46:07 +05:30
vishnukvmd 4ed3720906 Fix compilation 2023-12-13 12:39:08 +05:30
vishnukvmd 4c44fc521c Fix warnings 2023-12-13 12:36:14 +05:30
0nullpointer d7cacce1d8 Add bpePath to CLIPTokenizer 2023-12-13 12:33:28 +05:30
0nullpointer 02114efc2b [WIP] onnx local test 2023-12-13 12:28:04 +05:30
0nullpointer f7859cdb7f [WIP] semantic search with onnx 2023-12-12 21:53:59 +05:30
0nullpointer e2c7cdf9f8 Add initial onnx framework 2023-12-12 21:39:35 +05:30
vishnukvmd 75704f0687 Update logger name 2023-12-05 22:37:56 +05:30
vishnukvmd 708b1c8d23 Refactor ML framework 2023-12-05 22:36:02 +05:30
vishnukvmd 05ba553ebc Define a dummy init method 2023-12-05 21:33:03 +05:30
vishnukvmd ac82f5b282 Create a generic EmbeddingService 2023-12-05 21:31:25 +05:30
vishnukvmd dc16c52ff6 Move score computation to app layer 2023-12-05 21:17:28 +05:30
vishnukvmd a0a5640e61 Add logs 2023-11-18 16:57:25 +05:30
vishnukvmd 1956a589d7 ping-pong 2023-11-17 17:26:02 +05:30
vishnukvmd 6faa408204 Re-enable computation of image embedding 2023-11-17 15:44:16 +05:30
vishnukvmd f54d82be34 Perform no image embedding 2023-11-15 17:35:04 +05:30
vishnukvmd cf3634f707 Ignore spurious requests to backfill 2023-11-15 10:50:48 +05:30
vishnukvmd 179dc0ce89 Minor refactor 2023-11-15 10:47:25 +05:30
vishnukvmd 4c2ec1da50 Wait until model is loaded 2023-11-15 10:42:03 +05:30
vishnukvmd 2e15d953f7 Ignore search if models haven't been loaded 2023-11-15 10:19:05 +05:30
vishnukvmd d64d3c4179 Reflect the correct index status 2023-11-15 02:17:53 +05:30
vishnukvmd df5c776dc8 Simplify state 2023-11-15 02:08:26 +05:30
vishnukvmd 76f3c43ae3 Use a different event to pull from server 2023-11-15 02:03:32 +05:30
vishnukvmd a28219807b Remove extra sync event 2023-11-15 01:36:14 +05:30
vishnukvmd 688b43c75a Listen to changes in the DB and update the cache 2023-11-15 01:16:17 +05:30