Commit Graph

11 Commits

Author SHA1 Message Date
7d229ccd1a Add support for scraping classic Skyrim mods
Not adding it to the update.sh script quite yet since I need to run the very long process of downloading every classic skyrim mod that currently exists on the nexus first.
2022-09-02 00:43:53 -04:00
a42c22cf4b Add is_translation to mod with backfill
Now, the update command will scrape all non-translation mods and translation mods separately so the is_translation value can be set correctly in the future.
2022-03-15 23:59:56 -04:00
f22587d4a0 Handle missing category_id in scraper 2022-01-18 17:03:22 -05:00
b97689b7fd Scrape additional fields to mod table 2022-01-17 23:37:58 -05:00
804fac4eea Start processing mod updates 2021-09-05 16:02:16 -04:00
Tyler Hallada
ba6ca0c928 Fix clippy lints, add 7z fallback for failed unrar 2021-08-14 11:43:09 -06:00
Tyler Hallada
6136ac18fa Make mod category nullable 2021-08-08 19:14:23 -06:00
e69165fe5a Set page size to 20 since nexus mods doesn't always obey 80 2021-07-22 21:55:31 -04:00
77562a7a05 Add CLI args with page, skip unreadable archives 2021-07-22 21:50:28 -04:00
792e78391c Replace dbg macros with tracing events 2021-07-11 19:45:26 -04:00
22757bc475 Modularize scraping and api requests 2021-07-09 00:37:08 -04:00