thallada/modmapper
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • d31f44a349 Add healthchecks.io badge img to README main thallada 2025-09-03 22:43:10 -04:00
  • ec3fa5e980 Marked scripts as executable thallada 2025-09-03 22:37:26 -04:00
  • 68c5cfe8a6 Add monitoring of scripts through healthchecks.io thallada 2025-09-03 22:28:11 -04:00
  • 7b8fbea7d4 Update nexus scraper to use new graphql api thallada 2025-05-30 15:07:53 -04:00
  • 1a105a3ea2 Update packages, fix unrar after major version upgrade thallada 2025-03-02 16:01:21 -05:00
  • a677325c4d Prevent overwriting of base game cells is_base_game value thallada 2025-03-02 14:15:05 -05:00
  • a5135b30f4 Add timestep option to dump_cell_edit_counts_over_time thallada 2023-11-18 02:02:07 -05:00
  • 7579db364b Recreate pg pool connection in all dump commands thallada 2023-11-15 18:35:48 -05:00
  • 8cb9bfa4ca Recreate pg connection pool in command to prevent slowdown thallada 2023-11-15 18:07:26 -05:00
  • c931eeca86 Add command for writing cell edits over time thallada 2023-11-15 16:59:28 -05:00
  • 9fcac0ce39 Fix reversed is_base_game_only logic in get_cell_data thallada 2023-11-09 00:44:32 -05:00
  • c7ead28cfa Fix cells unique index thallada 2023-11-08 16:06:26 -05:00
  • e85edff30a Fix bad interior cell data in db thallada 2023-11-08 01:05:19 -05:00
  • 56864c7f29 Fix mode page scraping thallada 2023-06-30 12:30:12 -04:00
  • 694ef6e89b Move spammy command log messages to debug level thallada 2023-04-24 00:04:29 -04:00
  • 01444cd928 Update deps, rustfmt, clippy fixes thallada 2023-04-20 00:47:14 -04:00
  • 03cf20029e Revert "Login before scraping mods to include adult mods" thallada 2022-10-02 02:37:15 -04:00
  • bb02771b87 Login before scraping mods to include adult mods thallada 2022-10-02 00:34:38 -04:00
  • 675c1dda8a Update skyrim-cell-dump to 0.4.1 thallada 2022-10-01 17:57:02 -04:00
  • 2bb7b78cd5 Update skyrim-cell-dump to 0.4.0 thallada 2022-09-30 16:47:43 -04:00
  • 183c60f52d Update dependencies thallada 2022-09-30 13:26:30 -04:00
  • 3c16787756 Update skyrim-cell-dump to 0.3.4 thallada 2022-09-30 13:03:59 -04:00
  • fa2de316cb Try to extract .exe before skipping it thallada 2022-09-29 20:16:11 -04:00
  • 7f0f5ca2ff Merge branch 'main' of github.com:thallada/modmapper into main thallada 2022-09-29 20:10:58 -04:00
  • 49fcde836a Skip .exe files thallada 2022-09-29 20:10:55 -04:00
  • 662bd7e355 Merge branch 'main' of github.com:thallada/modmapper into main thallada 2022-09-27 12:19:10 -04:00
  • 589b00923e Replace trailing period in folder names when saving plugin file thallada 2022-09-27 12:18:25 -04:00
  • cf4e83c054 Fix has_next_page scraping logic thallada 2022-09-26 00:15:25 -04:00
  • 203af0adc9 Scope bulk_get_last_updated_by_nexus_mod_ids by game_id thallada 2022-09-26 00:00:22 -04:00
  • c3264b3b11 Enable updating skyrim mods thallada 2022-09-24 19:58:26 -04:00
  • f2a4205b89 Handle missing author names thallada 2022-09-17 12:25:59 -04:00
  • afefc8fef3 Don't try to parse dirs after extracting with 7z thallada 2022-09-12 21:02:12 -04:00
  • fe908799d7 Try to fix saving plugins with "\\" in path thallada 2022-09-05 18:47:43 -04:00
  • e531386095 Detect failed extract with 7zip thallada 2022-09-04 17:39:05 -04:00
  • d2510c72aa Remove unused import thallada 2022-09-03 15:43:36 -04:00
  • e96d760a1c Create mod subdirectories for each game thallada 2022-09-03 14:29:50 -04:00
  • 14be03cd3d Make separate mod search indices per game instead thallada 2022-09-03 00:49:57 -04:00
  • 84a02971a0 Add game names to mod search index thallada 2022-09-03 00:35:26 -04:00
  • 782f7a473f Add dump_games command thallada 2022-09-03 00:31:49 -04:00
  • 7d229ccd1a Add support for scraping classic Skyrim mods thallada 2022-09-02 00:43:53 -04:00
  • 89428da6e0 Fix plugins data dump with updated_after parameter thallada 2022-08-21 00:16:51 -04:00
  • b80edb49fa Serialize plugin hashes to strings thallada 2022-08-08 23:37:27 -04:00
  • 33a29df2cb Dump file plugins with full_path, not file_name thallada 2022-07-23 01:00:48 -04:00
  • 330fd8ad28 Remove destination folder from sync commands thallada 2022-06-30 01:35:03 -04:00
  • 1c1303e4f6 Separate buckets for each file type thallada 2022-06-30 01:29:54 -04:00
  • 4b7a52588c Use rclone for sync, add more instructions thallada 2022-06-29 16:36:32 -04:00
  • 09c87fa93b Split up batched mod data query to speed up dump thallada 2022-06-05 02:58:11 -04:00
  • d72ed943ce Append all command output to the log thallada 2022-06-04 18:53:06 -04:00
  • bafa405223 Add tracing logging to all commands thallada 2022-06-04 18:51:20 -04:00
  • 8f420c5558 Pass -u option to plugins_data command, not cells thallada 2022-06-04 16:48:10 -04:00
  • 026d175da4 Add updated_after option to limit files generated on every run thallada 2022-06-04 00:50:11 -04:00
  • bed49d0953 Add a new command to dump files to json files thallada 2022-06-01 00:53:53 -04:00
  • f59a0155d8 Add files array & file/plugin count to mod data json thallada 2022-06-01 00:53:17 -04:00
  • 04c0501514 Revert change to get_cell_data query thallada 2022-03-23 17:24:41 -04:00
  • 4e5284a57f Add mod_cell_counts dump to update.sh thallada 2022-03-18 00:30:27 -04:00
  • 65f841eef3 Go back to INNER JOIN on mod_cell_counts instead thallada 2022-03-18 00:28:23 -04:00
  • 02c03bd1d9 Use LEFT OUTER JOIN to include mods with 0 cell edits thallada 2022-03-18 00:16:33 -04:00
  • 7a87f0fd22 Add command to generate mod_cell_counts.json thallada 2022-03-17 23:51:32 -04:00
  • a42c22cf4b Add is_translation to mod with backfill thallada 2022-03-15 23:59:56 -04:00
  • 5d55e78283 Dump plugins by hash instead of id Tyler Hallada 2022-03-12 13:05:21 -05:00
  • c9dcd3b7c5 Include cells with plugin data thallada 2022-03-10 23:27:26 -05:00
  • 7552573d00 Dump plugins data with file and mod data thallada 2022-03-10 22:32:46 -05:00
  • 17f766da29 Fix rclone command in backup.sh thallada 2022-02-13 14:34:09 -05:00
  • bb2059e697 Fix find command options in backup.sh thallada 2022-02-12 23:26:45 -05:00
  • 21fffd3c23 Remove dbg logging thallada 2022-02-12 01:25:30 -05:00
  • eb92f7191d Add scripts for updating and backing up data thallada 2022-02-12 00:44:32 -05:00
  • 4d9855552b Add option for full update and default to false thallada 2022-02-11 22:38:44 -05:00
  • 283cad220b Move tile_scraper from examples to commands thallada 2022-02-08 00:12:59 -05:00
  • b8c5f63aeb Refactor main.rs into separate files thallada 2022-02-08 00:02:26 -05:00
  • 51175933d6 Fix skyrim worldspace filter in mod cells query thallada 2022-02-06 23:30:46 -05:00
  • 82996f237f Add missing migration for cell lookup index thallada 2022-02-06 23:15:36 -05:00
  • 891dbd791a Limit cells in mod files to Skyrim worldspace cells thallada 2022-02-06 23:11:03 -05:00
  • 240349cf1a Add option for generating a mod search index for fuse.js thallada 2022-01-24 23:20:51 -05:00
  • 4875d2d764 Use LEFT OUTER JOIN to not skip mods in the dump thallada 2022-01-24 22:46:23 -05:00
  • 0c3d85d697 More efficient batched_get_with_cells thallada 2022-01-24 22:33:50 -05:00
  • 17facae842 Make ancestor cols not nullable, add fk constraints thallada 2022-01-24 21:41:45 -05:00
  • 10c299dc45 Add indices for new ancestor id columns thallada 2022-01-24 21:21:12 -05:00
  • e5936683fa Add ancestor id columns to plugins and plugin_cells thallada 2022-01-24 21:13:07 -05:00
  • 4a8e3cad6c Add option for generating mod files thallada 2022-01-24 01:24:15 -05:00
  • e7fe7abfb7 Set columns to not null, remove backfill code thallada 2022-01-18 21:50:09 -05:00
  • 337b673e02 Tolerate null picture_url in response thallada 2022-01-18 21:03:26 -05:00
  • d48e2fdb5f Add option to temporarily backfill mod data thallada 2022-01-18 20:54:50 -05:00
  • f22587d4a0 Handle missing category_id in scraper thallada 2022-01-18 17:03:22 -05:00
  • e7b5c750cd Temporarily update all mods to backfill fields thallada 2022-01-17 23:55:22 -05:00
  • b97689b7fd Scrape additional fields to mod table thallada 2022-01-17 23:37:58 -05:00
  • f23cf526e5 Fix duplicate mods in cell data thallada 2022-01-17 20:37:06 -05:00
  • a78fa4772b Add cli option to save cell data json to directory thallada 2022-01-17 19:25:07 -05:00
  • e779e94eff Add -e option to output cell edits from database Tyler Hallada 2022-01-15 00:19:05 -05:00
  • dad58f6154 Add UESP map tile scraper as an example Tyler Hallada 2022-01-15 00:18:30 -05:00
  • 804fac4eea Start processing mod updates thallada 2021-09-05 16:02:16 -04:00
  • 0989477b40 Upgrade skyrim-cell-dump to 0.3.1 thallada 2021-08-27 00:48:03 -04:00
  • ba6ca0c928 Fix clippy lints, add 7z fallback for failed unrar Tyler Hallada 2021-08-14 11:43:09 -06:00
  • be9c78217d Skip files with unknown file type Tyler Hallada 2021-08-12 10:25:28 -06:00
  • 85f1d3d05a Recover failed 7z uncompress too Tyler Hallada 2021-08-11 10:10:02 -06:00
  • 1169ef4536 Print human readable file size to log Tyler Hallada 2021-08-09 22:38:17 -06:00
  • db2e73aa8e Skip unrar extract errors, update compress-tools Tyler Hallada 2021-08-09 11:10:57 -06:00
  • 6136ac18fa Make mod category nullable Tyler Hallada 2021-08-08 19:09:34 -06:00
  • b2d17f6217 Refactor main.rs a bit, some fixes to 7zip fallback thallada 2021-08-07 00:42:28 -04:00
  • 3f48f97080 Fix typo thallada 2021-07-29 23:45:18 -04:00
  • 3ec7467571 Add more status columns to fix continuation of unprocessed files thallada 2021-07-29 22:55:34 -04:00