Commit Graph

8 Commits

Author SHA1 Message Date
49fcde836a Skip .exe files 2022-09-29 20:10:55 -04:00
203af0adc9 Scope bulk_get_last_updated_by_nexus_mod_ids by game_id
Was accidentally skipping a ton of skyrim mods because of this.
2022-09-26 00:03:39 -04:00
e531386095 Detect failed extract with 7zip
And skip the file if the metadata on the server is also missing (high probability that the archive is just corrupt if this is the case).
2022-09-04 17:42:21 -04:00
7d229ccd1a Add support for scraping classic Skyrim mods
Not adding it to the update.sh script quite yet since I need to run the very long process of downloading every classic skyrim mod that currently exists on the nexus first.
2022-09-02 00:43:53 -04:00
a42c22cf4b Add is_translation to mod with backfill
Now, the update command will scrape all non-translation mods and translation mods separately so the is_translation value can be set correctly in the future.
2022-03-15 23:59:56 -04:00
21fffd3c23 Remove dbg logging 2022-02-12 01:25:30 -05:00
4d9855552b Add option for full update and default to false
When false, stop scraping pages after 50 pages of no new updates
2022-02-11 22:38:44 -05:00
b8c5f63aeb Refactor main.rs into separate files
Create new `commands` mod with file for each command line option.

Create a couple more extractor files for moving 7zip and unrar methods into.
2022-02-08 00:02:26 -05:00