|
|
af09883692
|
added scraped_by and scraped_at
|
2025-02-23 05:44:54 +01:00 |
|
|
|
990918db9e
|
removed annoying print statement
|
2025-02-23 05:29:04 +01:00 |
|
|
|
83239dd637
|
added varda to run_spiders script.
|
2025-02-23 05:27:46 +01:00 |
|
|
|
36312daf87
|
created a varda spider
|
2025-02-23 05:27:05 +01:00 |
|
|
|
cfcb7742e0
|
added Varda item
|
2025-02-23 05:26:11 +01:00 |
|
|
|
f63779b0b8
|
small changes for the better
|
2025-02-18 22:13:32 +01:00 |
|
|
|
9ec5347a7f
|
merged rubrik and text for each entry per day as a single string
|
2025-02-18 22:13:04 +01:00 |
|
|
|
30471c96c3
|
removed autocreate json file
|
2025-02-18 22:11:58 +01:00 |
|
|
|
e5df532825
|
Merge pull request 'set concurrent request per domain to 8' (#2) from change_settings into main
Reviewed-on: #2
|
2025-02-18 17:56:34 +00:00 |
|
|
|
b0a8633432
|
set concurrent request per domain to 8
|
2025-02-18 18:54:08 +01:00 |
|
|
|
75e4771ef3
|
Merge pull request 'add_max' (#1) from add_max into main
Reviewed-on: #1
|
2025-02-18 17:50:55 +00:00 |
|
|
|
cbb2936d26
|
Update .gitignore
|
2025-02-18 17:47:25 +00:00 |
|
|
|
d9e7d6dc01
|
dont include scraped files
|
2025-02-18 18:39:09 +01:00 |
|
|
|
4d4e03d933
|
run all spiders in diffrent threads
|
2025-02-18 18:36:49 +01:00 |
|
|
|
4c877e346f
|
added a max spider
|
2025-02-18 18:33:35 +01:00 |
|
|
|
a53de15fbb
|
added conda environment file
|
2025-02-17 23:17:53 +01:00 |
|
|
|
859f2842a1
|
added run_spiders file
|
2025-02-17 23:17:27 +01:00 |
|
|
|
472f12d216
|
added bash_alias file
|
2025-02-17 23:16:54 +01:00 |
|
|
|
cee2be72ef
|
force encoding utf8
|
2025-02-17 23:09:54 +01:00 |
|
|
|
25541bf06f
|
first version
|
2025-02-17 21:33:36 +01:00 |
|
