Skip to content
Test Source Collector App

mc_89_add_scraping_logic_for_non_pending_urls #210

Sign in to view logs

mc_89_add_scraping_logic_for_non_pending_urls

mc_89_add_scraping_logic_for_non_pending_urls #210

Triggered via pull request August 1, 2025 18:25
@maxachismaxachis
synchronize #355
mc_89_add_scraping_logic_for_non_pending_urls
Status Failure
Total duration 1m 7s
Artifacts –

test_app.yml

on: pull_request
container-job
1m 3s
container-job
Fit to window
Zoom out
Zoom in

Annotations

6 errors and 116 warnings
[flake8] src/core/tasks/url/operators/probe/core.py#L24 <303>: src/core/tasks/url/operators/probe/core.py#L24
too many blank lines (2)
[flake8] src/core/tasks/url/operators/probe/queries/insert.py#L14 <999>: src/core/tasks/url/operators/probe/queries/insert.py#L14
IndentationError: expected an indented block after function definition on line 9
[flake8] src/db/models/instantiations/url/core/pydantic/info.py#L11 <225>: src/db/models/instantiations/url/core/pydantic/info.py#L11
missing whitespace around operator
[flake8] src/db/models/instantiations/url/web_metadata/pydantic.py#L14 <303>: src/db/models/instantiations/url/web_metadata/pydantic.py#L14
too many blank lines (2)
[flake8] src/external/url_request/probe/core.py#L27 <303>: src/external/url_request/probe/core.py#L27
too many blank lines (2)
container-job
Process completed with exit code 2.
[flake8] alembic/versions/2025_07_31_1536-99eceed6e614_add_web_status_info_table.py#L92 <103>: alembic/versions/2025_07_31_1536-99eceed6e614_add_web_status_info_table.py#L92
Missing docstring in public function
[flake8] alembic/versions/2025_07_31_1536-99eceed6e614_add_web_status_info_table.py#L96 <103>: alembic/versions/2025_07_31_1536-99eceed6e614_add_web_status_info_table.py#L96
Missing docstring in public function
[flake8] src/core/tasks/url/operators/html/content_info_getter.py#L1 <100>: src/core/tasks/url/operators/html/content_info_getter.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/operators/html/core.py#L57 <102>: src/core/tasks/url/operators/html/core.py#L57
Missing docstring in public method
[flake8] src/core/tasks/url/operators/html/tdo.py#L1 <100>: src/core/tasks/url/operators/html/tdo.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/operators/html/tdo.py#L10 <101>: src/core/tasks/url/operators/html/tdo.py#L10
Missing docstring in public class
[flake8] src/core/tasks/url/operators/html/tdo.py#L14 <391>: src/core/tasks/url/operators/html/tdo.py#L14
blank line at end of file
[flake8] src/core/tasks/url/operators/probe/core.py#L1 <100>: src/core/tasks/url/operators/probe/core.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/operators/probe/core.py#L13 <101>: src/core/tasks/url/operators/probe/core.py#L13
Missing docstring in public class
[flake8] src/core/tasks/url/operators/probe/core.py#L15 <107>: src/core/tasks/url/operators/probe/core.py#L15
Missing docstring in __init__
[flake8] src/core/tasks/url/operators/probe/core.py#L26 <102>: src/core/tasks/url/operators/probe/core.py#L26
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/core.py#L30 <102>: src/core/tasks/url/operators/probe/core.py#L30
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/core.py#L33 <102>: src/core/tasks/url/operators/probe/core.py#L33
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/core.py#L38 <102>: src/core/tasks/url/operators/probe/core.py#L38
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/core.py#L63 <102>: src/core/tasks/url/operators/probe/core.py#L63
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/core.py#L77 <391>: src/core/tasks/url/operators/probe/core.py#L77
blank line at end of file
[flake8] src/core/tasks/url/operators/probe/queries/get_urls.py#L1 <100>: src/core/tasks/url/operators/probe/queries/get_urls.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/operators/probe/queries/get_urls.py#L13 <101>: src/core/tasks/url/operators/probe/queries/get_urls.py#L13
Missing docstring in public class
[flake8] src/core/tasks/url/operators/probe/queries/get_urls.py#L16 <102>: src/core/tasks/url/operators/probe/queries/get_urls.py#L16
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/queries/get_urls.py#L31 <292>: src/core/tasks/url/operators/probe/queries/get_urls.py#L31
no newline at end of file
[flake8] src/core/tasks/url/operators/probe/queries/has_urls.py#L1 <100>: src/core/tasks/url/operators/probe/queries/has_urls.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/operators/probe/queries/has_urls.py#L11 <101>: src/core/tasks/url/operators/probe/queries/has_urls.py#L11
Missing docstring in public class
[flake8] src/core/tasks/url/operators/probe/queries/has_urls.py#L14 <102>: src/core/tasks/url/operators/probe/queries/has_urls.py#L14
Missing docstring in public method
[flake8] src/core/tasks/url/operators/probe/tdo.py#L1 <100>: src/core/tasks/url/operators/probe/tdo.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/operators/probe/tdo.py#L7 <101>: src/core/tasks/url/operators/probe/tdo.py#L7
Missing docstring in public class
[flake8] src/core/tasks/url/subtasks/miscellaneous_metadata/auto_googler.py#L1 <100>: src/core/tasks/url/subtasks/miscellaneous_metadata/auto_googler.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/subtasks/miscellaneous_metadata/ckan.py#L1 <100>: src/core/tasks/url/subtasks/miscellaneous_metadata/ckan.py#L1
Missing docstring in public module
[flake8] src/core/tasks/url/subtasks/miscellaneous_metadata/muckrock.py#L1 <100>: src/core/tasks/url/subtasks/miscellaneous_metadata/muckrock.py#L1
Missing docstring in public module
[flake8] src/db/client/async_.py#L243 <102>: src/db/client/async_.py#L243
Missing docstring in public method
[flake8] src/db/client/async_.py#L494 <102>: src/db/client/async_.py#L494
Missing docstring in public method
[flake8] src/db/client/async_.py#L536 <102>: src/db/client/async_.py#L536
Missing docstring in public method
[flake8] src/db/client/async_.py#L916 <102>: src/db/client/async_.py#L916
Missing docstring in public method
[flake8] src/db/client/async_.py#L927 <102>: src/db/client/async_.py#L927
Missing docstring in public method
[flake8] src/db/client/async_.py#L938 <102>: src/db/client/async_.py#L938
Missing docstring in public method
[flake8] src/db/client/async_.py#L950 <102>: src/db/client/async_.py#L950
Missing docstring in public method
[flake8] src/db/client/async_.py#L987 <102>: src/db/client/async_.py#L987
Missing docstring in public method
[flake8] src/db/client/async_.py#L1605 <102>: src/db/client/async_.py#L1605
Missing docstring in public method
[flake8] src/db/client/async_.py#L1610 <102>: src/db/client/async_.py#L1610
Missing docstring in public method
[flake8] src/db/helpers/session/session_helper.py#L46 <103>: src/db/helpers/session/session_helper.py#L46
Missing docstring in public function
[flake8] src/db/models/instantiations/url/core/pydantic/info.py#L1 <100>: src/db/models/instantiations/url/core/pydantic/info.py#L1
Missing docstring in public module
[flake8] src/db/models/instantiations/url/core/pydantic/info.py#L2 <401>: src/db/models/instantiations/url/core/pydantic/info.py#L2
'typing.Optional' imported but unused
[flake8] src/db/models/instantiations/url/core/pydantic/info.py#L9 <101>: src/db/models/instantiations/url/core/pydantic/info.py#L9
Missing docstring in public class
[flake8] src/db/models/instantiations/url/core/pydantic/insert.py#L1 <100>: src/db/models/instantiations/url/core/pydantic/insert.py#L1
Missing docstring in public module
[flake8] src/db/models/instantiations/url/core/pydantic/insert.py#L8 <101>: src/db/models/instantiations/url/core/pydantic/insert.py#L8
Missing docstring in public class
[flake8] src/db/models/instantiations/url/core/pydantic/insert.py#L19 <292>: src/db/models/instantiations/url/core/pydantic/insert.py#L19
no newline at end of file
[flake8] src/db/models/instantiations/url/web_metadata/pydantic.py#L1 <100>: src/db/models/instantiations/url/web_metadata/pydantic.py#L1
Missing docstring in public module
[flake8] src/db/models/instantiations/url/web_metadata/pydantic.py#L6 <101>: src/db/models/instantiations/url/web_metadata/pydantic.py#L6
Missing docstring in public class
[flake8] src/db/models/instantiations/url/web_metadata/pydantic.py#L18 <292>: src/db/models/instantiations/url/web_metadata/pydantic.py#L18
no newline at end of file
[flake8] src/db/models/instantiations/url/web_metadata/sqlalchemy.py#L1 <100>: src/db/models/instantiations/url/web_metadata/sqlalchemy.py#L1
Missing docstring in public module
[flake8] src/db/models/instantiations/url/web_metadata/sqlalchemy.py#L33 <391>: src/db/models/instantiations/url/web_metadata/sqlalchemy.py#L33
blank line at end of file
[flake8] src/db/statement_composer.py#L28 <102>: src/db/statement_composer.py#L28
Missing docstring in public method
[flake8] src/external/url_request/core.py#L1 <100>: src/external/url_request/core.py#L1
Missing docstring in public module
[flake8] src/external/url_request/core.py#L9 <101>: src/external/url_request/core.py#L9
Missing docstring in public class
[flake8] src/external/url_request/core.py#L12 <102>: src/external/url_request/core.py#L12
Missing docstring in public method
[flake8] src/external/url_request/core.py#L18 <102>: src/external/url_request/core.py#L18
Missing docstring in public method
[flake8] src/external/url_request/probe/core.py#L1 <100>: src/external/url_request/probe/core.py#L1
Missing docstring in public module
[flake8] src/external/url_request/probe/core.py#L9 <101>: src/external/url_request/probe/core.py#L9
Missing docstring in public class
[flake8] src/external/url_request/probe/core.py#L11 <107>: src/external/url_request/probe/core.py#L11
Missing docstring in __init__
[flake8] src/external/url_request/probe/core.py#L17 <102>: src/external/url_request/probe/core.py#L17
Missing docstring in public method
[flake8] src/external/url_request/probe/core.py#L20 <102>: src/external/url_request/probe/core.py#L20
Missing docstring in public method
[flake8] src/external/url_request/probe/core.py#L27 <102>: src/external/url_request/probe/core.py#L27
Missing docstring in public method
[flake8] src/external/url_request/probe/core.py#L36 <102>: src/external/url_request/probe/core.py#L36
Missing docstring in public method
[flake8] src/external/url_request/probe/core.py#L43 <292>: src/external/url_request/probe/core.py#L43
no newline at end of file
[flake8] src/external/url_request/probe/format.py#L1 <100>: src/external/url_request/probe/format.py#L1
Missing docstring in public module
[flake8] src/external/url_request/probe/format.py#L6 <103>: src/external/url_request/probe/format.py#L6
Missing docstring in public function
[flake8] src/external/url_request/probe/format.py#L9 <103>: src/external/url_request/probe/format.py#L9
Missing docstring in public function
[flake8] src/external/url_request/probe/format.py#L18 <103>: src/external/url_request/probe/format.py#L18
Missing docstring in public function
[flake8] src/external/url_request/probe/format.py#L26 <103>: src/external/url_request/probe/format.py#L26
Missing docstring in public function
[flake8] src/external/url_request/probe/format.py#L32 <292>: src/external/url_request/probe/format.py#L32
no newline at end of file
[flake8] src/external/url_request/probe/model.py#L1 <100>: src/external/url_request/probe/model.py#L1
Missing docstring in public module
[flake8] src/external/url_request/probe/model.py#L4 <101>: src/external/url_request/probe/model.py#L4
Missing docstring in public class
[flake8] src/external/url_request/probe/model.py#L11 <102>: src/external/url_request/probe/model.py#L11
Missing docstring in public method
[flake8] src/external/url_request/request.py#L14 <103>: src/external/url_request/request.py#L14
Missing docstring in public function
[flake8] src/external/url_request/request.py#L32 <103>: src/external/url_request/request.py#L32
Missing docstring in public function
[flake8] src/external/url_request/request.py#L40 <103>: src/external/url_request/request.py#L40
Missing docstring in public function
[flake8] src/external/url_request/request.py#L47 <103>: src/external/url_request/request.py#L47
Missing docstring in public function
[flake8] src/external/url_request/request.py#L70 <103>: src/external/url_request/request.py#L70
Missing docstring in public function
[flake8] src/external/url_request/request.py#L84 <103>: src/external/url_request/request.py#L84
Missing docstring in public function
[flake8] tests/automated/integration/db/client/test_delete_url_updated_at.py#L1 <100>: tests/automated/integration/db/client/test_delete_url_updated_at.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/conftest.py#L1 <100>: tests/automated/integration/tasks/url/probe/conftest.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/conftest.py#L10 <103>: tests/automated/integration/tasks/url/probe/conftest.py#L10
Missing docstring in public function
[flake8] tests/automated/integration/tasks/url/probe/constants.py#L1 <100>: tests/automated/integration/tasks/url/probe/constants.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/constants.py#L3 <292>: tests/automated/integration/tasks/url/probe/constants.py#L3
no newline at end of file
[flake8] tests/automated/integration/tasks/url/probe/setup/core.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/core.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/core.py#L4 <401>: tests/automated/integration/tasks/url/probe/setup/core.py#L4
'src.db.models.instantiations.url.web_metadata.sqlalchemy.URLWebMetadata' imported but unused
[flake8] tests/automated/integration/tasks/url/probe/setup/core.py#L8 <103>: tests/automated/integration/tasks/url/probe/setup/core.py#L8
Missing docstring in public function
[flake8] tests/automated/integration/tasks/url/probe/setup/core.py#L22 <391>: tests/automated/integration/tasks/url/probe/setup/core.py#L22
blank line at end of file
[flake8] tests/automated/integration/tasks/url/probe/setup/data.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/data.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/data.py#L36 <292>: tests/automated/integration/tasks/url/probe/setup/data.py#L36
no newline at end of file
[flake8] tests/automated/integration/tasks/url/probe/setup/format.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/format.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/format.py#L6 <103>: tests/automated/integration/tasks/url/probe/setup/format.py#L6
Missing docstring in public function
[flake8] tests/automated/integration/tasks/url/probe/setup/format.py#L19 <103>: tests/automated/integration/tasks/url/probe/setup/format.py#L19
Missing docstring in public function
[flake8] tests/automated/integration/tasks/url/probe/setup/format.py#L24 <292>: tests/automated/integration/tasks/url/probe/setup/format.py#L24
no newline at end of file
[flake8] tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L7 <101>: tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L7
Missing docstring in public class
[flake8] tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L9 <107>: tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L9
Missing docstring in __init__
[flake8] tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L16 <102>: tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L16
Missing docstring in public method
[flake8] tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L20 <292>: tests/automated/integration/tasks/url/probe/setup/mocks/probe_manager.py#L20
no newline at end of file
[flake8] tests/automated/integration/tasks/url/probe/setup/models/entry.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/models/entry.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/models/entry.py#L1 <401>: tests/automated/integration/tasks/url/probe/setup/models/entry.py#L1
'pydantic.model_validator' imported but unused
[flake8] tests/automated/integration/tasks/url/probe/setup/models/entry.py#L4 <401>: tests/automated/integration/tasks/url/probe/setup/models/entry.py#L4
'src.external.url_request.probe.model.URLProbeResponse' imported but unused
[flake8] tests/automated/integration/tasks/url/probe/setup/models/entry.py#L8 <101>: tests/automated/integration/tasks/url/probe/setup/models/entry.py#L8
Missing docstring in public class
[flake8] tests/automated/integration/tasks/url/probe/setup/models/planned_response.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/models/planned_response.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/models/planned_response.py#L4 <101>: tests/automated/integration/tasks/url/probe/setup/models/planned_response.py#L4
Missing docstring in public class
[flake8] tests/automated/integration/tasks/url/probe/setup/models/planned_response.py#L7 <292>: tests/automated/integration/tasks/url/probe/setup/models/planned_response.py#L7
no newline at end of file
[flake8] tests/automated/integration/tasks/url/probe/setup/queries/check.py#L1 <100>: tests/automated/integration/tasks/url/probe/setup/queries/check.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/setup/queries/check.py#L13 <101>: tests/automated/integration/tasks/url/probe/setup/queries/check.py#L13
Missing docstring in public class
[flake8] tests/automated/integration/tasks/url/probe/setup/queries/check.py#L15 <107>: tests/automated/integration/tasks/url/probe/setup/queries/check.py#L15
Missing docstring in __init__
[flake8] tests/automated/integration/tasks/url/probe/setup/queries/check.py#L22 <102>: tests/automated/integration/tasks/url/probe/setup/queries/check.py#L22
Missing docstring in public method
[flake8] tests/automated/integration/tasks/url/probe/setup/queries/check.py#L43 <391>: tests/automated/integration/tasks/url/probe/setup/queries/check.py#L43
blank line at end of file
[flake8] tests/automated/integration/tasks/url/probe/test_core.py#L1 <100>: tests/automated/integration/tasks/url/probe/test_core.py#L1
Missing docstring in public module
[flake8] tests/automated/integration/tasks/url/probe/test_core.py#L10 <103>: tests/automated/integration/tasks/url/probe/test_core.py#L10
Missing docstring in public function
[flake8] tests/manual/external/url_request/test_url_probe.py#L1 <100>: tests/manual/external/url_request/test_url_probe.py#L1
Missing docstring in public module
[flake8] tests/manual/external/url_request/test_url_probe.py#L13 <103>: tests/manual/external/url_request/test_url_probe.py#L13
Missing docstring in public function
[flake8] tests/manual/external/url_request/test_url_probe.py#L19 <103>: tests/manual/external/url_request/test_url_probe.py#L19
Missing docstring in public function
[flake8] tests/manual/external/url_request/test_url_probe.py#L22 <292>: tests/manual/external/url_request/test_url_probe.py#L22
no newline at end of file