-
a5135b30f4
Add timestep option to dump_cell_edit_counts_over_time
main
Tyler Hallada
2023-11-18 02:02:07 -0500
-
7579db364b
Recreate pg pool connection in all dump commands
Tyler Hallada
2023-11-15 18:35:48 -0500
-
8cb9bfa4ca
Recreate pg connection pool in command to prevent slowdown
Tyler Hallada
2023-11-15 18:07:26 -0500
-
c931eeca86
Add command for writing cell edits over time
Tyler Hallada
2023-11-15 16:59:28 -0500
-
9fcac0ce39
Fix reversed is_base_game_only logic in get_cell_data
Tyler Hallada
2023-11-09 00:44:32 -0500
-
c7ead28cfa
Fix cells unique index
Tyler Hallada
2023-11-08 16:06:26 -0500
-
e85edff30a
Fix bad interior cell data in db
Tyler Hallada
2023-11-08 01:05:19 -0500
-
56864c7f29
Fix mode page scraping
Tyler Hallada
2023-06-30 12:30:12 -0400
-
694ef6e89b
Move spammy command log messages to debug level
Tyler Hallada
2023-04-24 00:04:29 -0400
-
01444cd928
Update deps, rustfmt, clippy fixes
Tyler Hallada
2023-04-20 00:47:14 -0400
-
03cf20029e
Revert "Login before scraping mods to include adult mods"
Tyler Hallada
2022-10-02 02:37:15 -0400
-
bb02771b87
Login before scraping mods to include adult mods
Tyler Hallada
2022-10-02 00:34:38 -0400
-
675c1dda8a
Update skyrim-cell-dump to 0.4.1
Tyler Hallada
2022-10-01 17:57:02 -0400
-
2bb7b78cd5
Update skyrim-cell-dump to 0.4.0
Tyler Hallada
2022-09-30 16:47:43 -0400
-
183c60f52d
Update dependencies
Tyler Hallada
2022-09-30 13:26:30 -0400
-
3c16787756
Update skyrim-cell-dump to 0.3.4
Tyler Hallada
2022-09-30 13:03:59 -0400
-
fa2de316cb
Try to extract .exe before skipping it
Tyler Hallada
2022-09-29 20:16:11 -0400
-
7f0f5ca2ff
Merge branch 'main' of github.com:thallada/modmapper into main
Tyler Hallada
2022-09-29 20:10:58 -0400
-
-
49fcde836a
Skip .exe files
Tyler Hallada
2022-09-29 20:10:55 -0400
-
662bd7e355
Merge branch 'main' of github.com:thallada/modmapper into main
Tyler Hallada
2022-09-27 12:19:10 -0400
-
-
-
-
589b00923e
Replace trailing period in folder names when saving plugin file
Tyler Hallada
2022-09-27 12:18:25 -0400
-
cf4e83c054
Fix has_next_page scraping logic
Tyler Hallada
2022-09-26 00:15:25 -0400
-
-
203af0adc9
Scope bulk_get_last_updated_by_nexus_mod_ids by game_id
Tyler Hallada
2022-09-26 00:00:22 -0400
-
c3264b3b11
Enable updating skyrim mods
Tyler Hallada
2022-09-24 19:58:26 -0400
-
f2a4205b89
Handle missing author names
Tyler Hallada
2022-09-17 12:25:59 -0400
-
afefc8fef3
Don't try to parse dirs after extracting with 7z
Tyler Hallada
2022-09-12 21:02:12 -0400
-
fe908799d7
Try to fix saving plugins with "\\" in path
Tyler Hallada
2022-09-05 18:47:43 -0400
-
e531386095
Detect failed extract with 7zip
Tyler Hallada
2022-09-04 17:39:05 -0400
-
d2510c72aa
Remove unused import
Tyler Hallada
2022-09-03 15:43:36 -0400
-
e96d760a1c
Create mod subdirectories for each game
Tyler Hallada
2022-09-03 14:29:50 -0400
-
14be03cd3d
Make separate mod search indices per game instead
Tyler Hallada
2022-09-03 00:49:57 -0400
-
84a02971a0
Add game names to mod search index
Tyler Hallada
2022-09-03 00:35:26 -0400
-
782f7a473f
Add dump_games command
Tyler Hallada
2022-09-03 00:31:49 -0400
-
7d229ccd1a
Add support for scraping classic Skyrim mods
Tyler Hallada
2022-09-02 00:43:53 -0400
-
89428da6e0
Fix plugins data dump with updated_after parameter
Tyler Hallada
2022-08-21 00:16:51 -0400
-
b80edb49fa
Serialize plugin hashes to strings
Tyler Hallada
2022-08-08 23:37:27 -0400
-
33a29df2cb
Dump file plugins with full_path, not file_name
Tyler Hallada
2022-07-23 01:00:48 -0400
-
330fd8ad28
Remove destination folder from sync commands
Tyler Hallada
2022-06-30 01:35:03 -0400
-
1c1303e4f6
Separate buckets for each file type
Tyler Hallada
2022-06-30 01:29:54 -0400
-
4b7a52588c
Use rclone for sync, add more instructions
Tyler Hallada
2022-06-29 16:36:32 -0400
-
09c87fa93b
Split up batched mod data query to speed up dump
Tyler Hallada
2022-06-05 02:58:11 -0400
-
d72ed943ce
Append all command output to the log
Tyler Hallada
2022-06-04 18:53:06 -0400
-
bafa405223
Add tracing logging to all commands
Tyler Hallada
2022-06-04 18:51:20 -0400
-
8f420c5558
Pass -u option to plugins_data command, not cells
Tyler Hallada
2022-06-04 16:48:10 -0400
-
026d175da4
Add updated_after option to limit files generated on every run
Tyler Hallada
2022-06-04 00:50:11 -0400
-
bed49d0953
Add a new command to dump files to json files
Tyler Hallada
2022-06-01 00:53:53 -0400
-
f59a0155d8
Add files array & file/plugin count to mod data json
Tyler Hallada
2022-06-01 00:53:17 -0400
-
04c0501514
Revert change to get_cell_data query
Tyler Hallada
2022-03-23 17:24:41 -0400
-
4e5284a57f
Add mod_cell_counts dump to update.sh
Tyler Hallada
2022-03-18 00:30:27 -0400
-
65f841eef3
Go back to INNER JOIN on mod_cell_counts instead
Tyler Hallada
2022-03-18 00:28:23 -0400
-
02c03bd1d9
Use LEFT OUTER JOIN to include mods with 0 cell edits
Tyler Hallada
2022-03-18 00:16:33 -0400
-
7a87f0fd22
Add command to generate mod_cell_counts.json
Tyler Hallada
2022-03-17 23:51:32 -0400
-
a42c22cf4b
Add is_translation to mod with backfill
Tyler Hallada
2022-03-15 23:59:56 -0400
-
5d55e78283
Dump plugins by hash instead of id
Tyler Hallada
2022-03-12 13:05:21 -0500
-
c9dcd3b7c5
Include cells with plugin data
Tyler Hallada
2022-03-10 23:27:26 -0500
-
7552573d00
Dump plugins data with file and mod data
Tyler Hallada
2022-03-10 22:32:46 -0500
-
17f766da29
Fix rclone command in backup.sh
Tyler Hallada
2022-02-13 14:34:09 -0500
-
bb2059e697
Fix find command options in backup.sh
Tyler Hallada
2022-02-12 23:26:45 -0500
-
21fffd3c23
Remove dbg logging
Tyler Hallada
2022-02-12 01:25:30 -0500
-
eb92f7191d
Add scripts for updating and backing up data
Tyler Hallada
2022-02-12 00:44:32 -0500
-
4d9855552b
Add option for full update and default to false
Tyler Hallada
2022-02-11 22:38:44 -0500
-
283cad220b
Move tile_scraper from examples to commands
Tyler Hallada
2022-02-08 00:12:59 -0500
-
b8c5f63aeb
Refactor main.rs into separate files
Tyler Hallada
2022-02-08 00:02:26 -0500
-
51175933d6
Fix skyrim worldspace filter in mod cells query
Tyler Hallada
2022-02-06 23:30:46 -0500
-
82996f237f
Add missing migration for cell lookup index
Tyler Hallada
2022-02-06 23:15:36 -0500
-
891dbd791a
Limit cells in mod files to Skyrim worldspace cells
Tyler Hallada
2022-02-06 23:11:03 -0500
-
240349cf1a
Add option for generating a mod search index for fuse.js
Tyler Hallada
2022-01-24 23:20:51 -0500
-
4875d2d764
Use LEFT OUTER JOIN to not skip mods in the dump
Tyler Hallada
2022-01-24 22:46:23 -0500
-
0c3d85d697
More efficient batched_get_with_cells
Tyler Hallada
2022-01-24 22:33:50 -0500
-
17facae842
Make ancestor cols not nullable, add fk constraints
Tyler Hallada
2022-01-24 21:41:45 -0500
-
10c299dc45
Add indices for new ancestor id columns
Tyler Hallada
2022-01-24 21:21:12 -0500
-
e5936683fa
Add ancestor id columns to plugins and plugin_cells
Tyler Hallada
2022-01-24 21:13:07 -0500
-
4a8e3cad6c
Add option for generating mod files
Tyler Hallada
2022-01-24 01:24:15 -0500
-
e7fe7abfb7
Set columns to not null, remove backfill code
Tyler Hallada
2022-01-18 21:50:09 -0500
-
337b673e02
Tolerate null picture_url in response
Tyler Hallada
2022-01-18 21:03:26 -0500
-
d48e2fdb5f
Add option to temporarily backfill mod data
Tyler Hallada
2022-01-18 20:54:50 -0500
-
f22587d4a0
Handle missing category_id in scraper
Tyler Hallada
2022-01-18 17:03:22 -0500
-
e7b5c750cd
Temporarily update all mods to backfill fields
Tyler Hallada
2022-01-17 23:55:22 -0500
-
b97689b7fd
Scrape additional fields to mod table
Tyler Hallada
2022-01-17 23:37:58 -0500
-
f23cf526e5
Fix duplicate mods in cell data
Tyler Hallada
2022-01-17 20:37:06 -0500
-
a78fa4772b
Add cli option to save cell data json to directory
Tyler Hallada
2022-01-17 19:25:07 -0500
-
e779e94eff
Add -e option to output cell edits from database
Tyler Hallada
2022-01-15 00:19:05 -0500
-
dad58f6154
Add UESP map tile scraper as an example
Tyler Hallada
2022-01-15 00:18:30 -0500
-
804fac4eea
Start processing mod updates
Tyler Hallada
2021-09-05 16:02:16 -0400
-
0989477b40
Upgrade skyrim-cell-dump to 0.3.1
Tyler Hallada
2021-08-27 00:48:03 -0400
-
ba6ca0c928
Fix clippy lints, add 7z fallback for failed unrar
Tyler Hallada
2021-08-14 11:43:09 -0600
-
be9c78217d
Skip files with unknown file type
Tyler Hallada
2021-08-12 10:25:28 -0600
-
85f1d3d05a
Recover failed 7z uncompress too
Tyler Hallada
2021-08-11 10:10:02 -0600
-
1169ef4536
Print human readable file size to log
Tyler Hallada
2021-08-09 22:38:17 -0600
-
db2e73aa8e
Skip unrar extract errors, update compress-tools
Tyler Hallada
2021-08-09 11:10:57 -0600
-
6136ac18fa
Make mod category nullable
Tyler Hallada
2021-08-08 19:09:34 -0600
-
b2d17f6217
Refactor main.rs a bit, some fixes to 7zip fallback
Tyler Hallada
2021-08-07 00:42:28 -0400
-
3f48f97080
Fix typo
Tyler Hallada
2021-07-29 23:45:18 -0400
-
3ec7467571
Add more status columns to fix continuation of unprocessed files
Tyler Hallada
2021-07-29 22:55:34 -0400
-
e1e7dd2e5d
Rename drop_all.sql file
Tyler Hallada
2021-07-29 01:01:27 -0400
-
fc5a9d39c2
Add timestamp to mods for some resumability
Tyler Hallada
2021-07-29 00:50:42 -0400
-
a8424e830e
Adds download_at to files, skips files that are impossible to download
Tyler Hallada
2021-07-28 23:54:39 -0400
-
8a356ac7f5
Retry connect failures, write plugins to disk instead of zip archive
Tyler Hallada
2021-07-26 19:31:25 -0400
-
f62324d36c
Reset main.rs back w/ fix to listing RAR files
Tyler Hallada
2021-07-26 17:02:14 -0400
-
5d62fb7d61
Fix plugin listing for rar files, temporary backfil shim
Tyler Hallada
2021-07-26 01:16:43 -0400