edipretoro

edipretoro created branch main in edipretoro/redpen

2026-01-05 17:38:27 +00:00

edipretoro pushed to main at edipretoro/redpen

2026-01-05 17:38:27 +00:00

c001f4cd60 Initial release (created with django-admin)

ad293c5a88 Using uv to manage this project

89fed2445a Adding a short description of this project

edipretoro created repository edipretoro/redpen

2026-01-05 17:36:53 +00:00

edipretoro pushed to develop at edipretoro/scrarls

2026-01-03 10:37:08 +00:00

a2dce2bba9 Refactoring: extracting SQLAlchemy-related code to its own modules

edipretoro pushed to develop at edipretoro/scrarls

2026-01-03 10:36:19 +00:00

edbb92ff9a Adding a rule to ignore compiled files from Python

edipretoro pushed to develop at edipretoro/scrarls

2026-01-03 09:32:46 +00:00

edipretoro pushed to develop at edipretoro/scrarls

2026-01-03 08:52:56 +00:00

3c30b42f75 Refactoring the main function to use multiprocessing.Process to run scrapy

ad60e83693 Renaming the main function as run_scrapy

Compare 2 commits »

edipretoro pushed to develop at edipretoro/scrarls

2026-01-02 14:11:45 +00:00

a7952bc32c Processing correctly links extracted from a post

1d0cb8ed5d Updating the SQLAlchemyPipeline to use properly TvShowDB and LinkDB

d8d8109cdc Updating the imports

05866cc862 Adding a links attribute to use the relationship to the LinkDB class

f0e6d73dde Removing the existing download_url attribute

Compare 6 commits »

edipretoro pushed to develop at edipretoro/scrarls

2026-01-01 20:25:09 +00:00

8adc0623bd Adding the SQLAlchemyPipeline to the spider pipelines

0db07013ce Creating the SQLAlchemyPipeline class

eaf854c3eb Adding a rule to ignore *.db files (SQLite databases)

359b3271e4 Updating the defition of our SQLAlchemy model

15e1f837c8 Updating the extraction of fields

Compare 5 commits »

edipretoro pushed to develop at edipretoro/scrarls

2026-01-01 20:16:13 +00:00

ada99be262 Renaming some fields for the TvShowItem

177652dce1 Adding a SQLAlchemy model to store scraped posts

Compare 2 commits »

edipretoro pushed to develop at edipretoro/scrarls

2025-12-31 17:07:02 +00:00

f8bb6678f1 Adding SQLAlchemy as requirement

edipretoro pushed to develop at edipretoro/scrarls

2025-12-29 20:40:54 +00:00

4e90275507 Complying to pyright

d099cd262d Extracting the date from the post

3f6d1bfb4f Adding type annotation to TvShow

15877e456a Removing useless import

3dff072840 Adding type annotation

Compare 5 commits »

edipretoro pushed to develop at edipretoro/scrarls

2025-12-28 09:52:48 +00:00

0d98fc5193 Fixing the recuperation of the title

edipretoro pushed to develop at edipretoro/scrarls

2025-12-28 09:31:16 +00:00

34ea401c00 Adding a first implementation of the parse function

6e7a1d3378 Updating the TvShowItem class

9cc98a9944 Adding and configuring pyrefly

Compare 3 commits »

edipretoro pushed to develop at edipretoro/scrarls

2025-12-25 20:40:47 +00:00

cf13f89089 Adding a first iteration about a TvShowItem

edipretoro pushed to develop at edipretoro/scrarls

2025-12-24 22:02:54 +00:00

887a641be5 Adding a first iteration to crawl over pages from the tv-shows category

edipretoro created branch develop in edipretoro/scrarls

2025-12-23 20:03:34 +00:00

edipretoro pushed to develop at edipretoro/scrarls

2025-12-23 20:03:34 +00:00

598db18f54 Adding a short description of this repo

edipretoro pushed to main at edipretoro/scrarls

2025-12-23 20:03:09 +00:00

2e1004dbc7 Initial release (created with uv)

edipretoro created branch main in edipretoro/scrarls

2025-12-23 20:03:09 +00:00