beenull/orcinus-search
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
106 commits 1 branch 0 tags 4.2 MiB
Commit graph

39 commits

Author SHA1 Message Date
Brian Huisman 956af77655 Update admin.php 
Add a message when there are no pages in the Page Index to list so it's less confusing than just an empty table.
 2023-05-19 12:47:23 -04:00
Brian Huisman b2091b8cfb Update admin.php 
Add display of # of unique IPs in Query Log
 2023-05-18 09:11:03 -04:00
Brian Huisman 0f7ea69790 Store s_weights as JSON 2023-05-17 09:22:00 -04:00
Brian Huisman d8e9d5dc91 Admin UI edits for when crawl is in progress 
Automatically encode/decode json when saving/reading ODATA config values.
Remove 'sp_links_crawled' config table value, now stored in 'sp_progress'.
Update Crawl Information window in real-time while crawler is running. Be more aggressive at reloading the page to get the latest data once a crawl has finished.
Time the setting of certain config values while crawling in a more sensible way.
 2023-05-16 12:00:28 -04:00
Brian Huisman 4bb28031b6 Enable downloading Page Index 
Allow downloading of the page index as a csv.
Remove unnecessary database columns url_base and status_noindex
Store list of domains at crawl so we don't need to request them every page-load; you will need to reinstall fresh because of this change
 2023-05-12 10:06:57 -04:00
Brian Huisman d82ee666c7 Update admin.php 
In the edge case where the same query is requested twice in the same second by different IPs, both would appear in the Query Log UI. Add a second GROUP BY to avoid this.
 2023-05-08 07:32:39 -04:00
Brian Huisman 803155547d Rename to sp_punct 
Rename sp_smart ("smart" punctuation) to the more general and accurate sp_punct
 2023-05-05 11:54:07 -04:00
Brian Huisman 635422b1d6 Punctuation normalization and MIME-type display 
Disable Query log download button if query log is empty.
Further database error resiliency.
Add many more punctuation normalization characters; normalize on search as well as storage.
Add count of MIME-types in Search Management UI.
 2023-05-05 11:17:39 -04:00
Brian Huisman e6777287d7 Update admin.php 
Add scrolling for queries that are too wide for mobile.
 2023-05-04 15:06:30 -04:00
Brian Huisman 31421e47bc Update admin.php 
Also add same geoip extra check for file download
 2023-05-03 11:41:25 -04:00
Brian Huisman 8caf5440d3 Update admin.php 
Fix for geolocates that succeed but don't return a country code.
 2023-05-03 11:32:24 -04:00
Brian Huisman da235cdc95 Update admin.php 
More filter row simplification
 2023-05-01 11:40:32 -04:00
Brian Huisman 8a5f5965b0 Update admin.php 
Tweak display of Filters row on Page Index
 2023-05-01 11:18:49 -04:00
Brian Huisman 83f8fc9ed2 Javascript crawl support enhancement 
Don't require reloading the page after a crawl has completed.
Javascript will dynamically update the Crawler Information values if we are on the Crawler Management page.
 2023-04-28 13:55:26 -04:00
Brian Huisman 41f6b25f0f Allow specifying Default Category 2023-04-27 13:10:22 -04:00
Brian Huisman 8405e903c3 Update admin.php 
Line up Page Index links a bit better
 2023-04-26 20:25:56 -04:00
Brian Huisman ba04173c29 Daily updates 
Keep Page Index pagination page within limits; add UTF-8 BOM to CSV and TXT download output; use utf8mb4_unicode_520_ci collation to remove need for SQL REGEXP; add more latin accent equivalent characters.
 2023-04-26 15:16:13 -04:00
Brian Huisman 761491c21a Update admin.php 
Make headers responsive too.
 2023-04-25 15:14:18 -04:00
Brian Huisman b3b40a9194 Implement filetype: searching 2023-04-24 16:31:27 -04:00
Brian Huisman fc968ae460 Simplify, add titles to Download buttons 2023-04-24 13:47:18 -04:00
Brian Huisman ab7ad64ac1 Remove 'Allowed' lol 2023-04-22 21:50:07 -04:00
Brian Huisman fed2b979e1 Add query length limit option 2023-04-22 21:48:43 -04:00
Brian Huisman 57ef2a6599 fclose 2023-04-21 16:25:28 -04:00
Brian Huisman 8d99e4fd41 Enable downloading Query Log CSV 2023-04-21 11:27:46 -04:00
Brian Huisman daaf934e33 REGEXP_REPLACE 
Use REGEXP_REPLACE to capture all leading punctuation, not just ' and "
 2023-04-20 22:35:32 -04:00
Brian Huisman 1d5204caeb Also trim ' from queries for ordering 2023-04-20 14:59:37 -04:00
Brian Huisman c81e043e7f Minor admin.php tweaks 2023-04-20 14:45:48 -04:00
Brian Huisman b4ef2827ae Fix test for 'geo' key 2023-04-20 12:09:55 -04:00
Brian Huisman 8768cae733 Fresh install update 2023-04-20 11:20:10 -04:00
Brian Huisman 84e38a5663 Re-upload 3rd party libraries 2023-04-20 10:47:11 -04:00
Brian Huisman 1363370840 Fix for dynamic classes deprecation in PHP 8.2 2023-04-19 11:50:48 -04:00
Brian Huisman 11afbe12e8 Update admin.php 2023-04-18 19:20:33 -04:00
Brian Huisman ec2b7aa075 Daily updates, big flow change in crawler.php 2023-04-18 17:20:27 -04:00
Brian Huisman 553fc019fe Daily update 2023-04-17 17:47:22 -04:00
Brian Huisman 17fa8fae05 Tighten up file headings 2023-04-13 08:27:41 -04:00
Brian Huisman 062f009829 Updates for the day 2023-04-12 19:08:00 -04:00
Brian Huisman 5b97f545df Capitalize GeoIP2 2023-04-12 08:30:31 -04:00
Brian Huisman 595740962e Update name to Orcinus 2023-04-12 08:28:29 -04:00
Brian Huisman bffa144421 move os3/ to orcinus/ 2023-04-12 08:08:11 -04:00
Renamed from os3/admin.php (Browse further)