Dylan Baker
|
d54a3e8beb
|
Add host and port to DB connection config
|
8 months ago |
Dylan Baker
|
4df2839f8e
|
Add searching specs
|
3 years ago |
Dylan Baker
|
2c5c251e7b
|
Rename scraper
|
3 years ago |
Dylan Baker
|
db0d10b969
|
Refactor scraper
|
3 years ago |
Dylan Baker
|
ef2fed5fc0
|
Allow passing DB into migration
|
3 years ago |
Dylan Baker
|
c978ff6241
|
Refactor parser and add specs
|
3 years ago |
Dylan Baker
|
9198478704
|
Refactor fetcher, add specs
|
3 years ago |
Dylan Baker
|
0a58dd5c89
|
Raise if auth is unsuccessful
|
4 years ago |
Dylan Baker
|
a4601594ea
|
Allow running old migratinos
|
4 years ago |
Dylan Baker
|
bfc8cd2511
|
Log in development
|
5 years ago |
Dylan Baker
|
d4cff431b9
|
Use DB constant and sequel models
|
5 years ago |
Dylan Baker
|
b113165dc6
|
Refactor scraping
|
5 years ago |
Dylan Baker
|
e46a9fa449
|
Parse stickiness in parse_threads
|
5 years ago |
Dylan Baker
|
e1bbe85032
|
Add option to log or not
|
5 years ago |
Dylan Baker
|
210c1c5667
|
Fix breaking/sticky logic
Only break on the first thread with no new posts if that thread is not
sticky. Also, ignore sticky threads unless this is the first page.
|
5 years ago |
Dylan Baker
|
ad763890e5
|
Break as soon as there's a thread with no new posts
|
5 years ago |
Dylan Baker
|
e0c560a446
|
Add sleep
|
5 years ago |
Dylan Baker
|
6571eab680
|
Speed up fulltext search via indexing
|
5 years ago |
Dylan Baker
|
dae4be5a8f
|
Explicit path to dotenv
|
5 years ago |
Dylan Baker
|
66120b429b
|
Refactor db connection
|
5 years ago |
Dylan Baker
|
bd9160957b
|
Initial commit
|
5 years ago |