thallada/crawlnicle
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
58 Commits 3 Branches 0 Tags 780 KiB
21cae62714
Commit Graph

3 Commits

Author SHA1 Message Date
Tyler Hallada
4837cbb903 Add crawl metadata to feed & improve model interface 2023-07-15 00:40:10 -04:00
Tyler Hallada
f13c7e5e70 Add an async actor FeedCrawler for fetching feed details 
Currently, this allows the browser to subscribe to the response of the
asynchronous crawl after they add a new feed.

Eventually I will also use this in the main scheduled crawls. Right now,
it only upserts feed metadata based on the parsed feed.
 2023-07-09 21:30:23 -04:00
Tyler Hallada
abd540d2ff Better database layout with uuid primary keys 
Serialize and deserialize the uuid ids as base62 strings in the URLs.
 2023-06-27 14:03:52 -04:00