Links never checked

Created on 20 August 2024, 12 months ago

Problem/Motivation

Some links, while detected and in the list to check, are never checked. Some of them are invalid domains. Some of them are working links.

Steps to reproduce

Make a basic page with links to http://nonexistentdomainasdf.com and http://eia.gov
Re-scan to add links to list
Run cron
See that links are still listed as "Never" checked

Proposed resolution

Remaining tasks

User interface changes

API changes

Data model changes

๐Ÿ› Bug report
Status

Active

Version

2.0

Component

Code

Created by

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @ashbeeb
  • ๐Ÿ‡ฉ๐Ÿ‡ชGermany marc.bau

    What links are never checked?

    If non-existend you should get an error. e.g. host name lookup failed.

  • ๐Ÿ‡บ๐Ÿ‡ธUnited States eahonet

    Any updates to this one @ashbeeb ? I have a non-existent url (a .com) that continues to show "Last Checked" as "Never".

  • ๐Ÿ‡ฆ๐Ÿ‡ชUnited Arab Emirates schlaukopf Somerville, NJ, USA

    I was able to reproduce the same error and found that the issue occurs with domains that donโ€™t exist. Guzzle was unable to resolve the host, which resulted in a ConnectException being thrown instead of a RequestException. This patch addresses the issue by handling TransferException, which will cover both cases.

  • ๐Ÿ‡ฎ๐Ÿ‡ณIndia divya.sejekan

    The Patch is applied successfully. Links never checked issue looks resolved , now the links are verified and related error messages . Tried with bunch of different types of URLS.

    Steps to reproduce:
    1. Make a basic page with links to http://nonexistentdomainasdf.com and http://eia.gov
    2. Re-scan to add links to list
    3. Run cron
    4. See that links are still listed as "Never" checked

    RTBC++

  • ๐Ÿ‡ณ๐Ÿ‡ดNorway eiriksm Norway

    Great work, thanks everyone

    If someone could convert this into a merge request, that would be a great start.

    It also would be nice to add some tests here. I hope that should be fairly easy, adding to the existing coverage.

    Finally. A bit unsure if showing a 502 is more helpful than showing it was never checked. Don't we have other codes for such errors in the codebase already? ๐Ÿค“

  • First commit to issue fork.
  • Merge request !124Update 2 files โ†’ (Open) created by immaculatexavier
  • Pipeline finished with Failed
    12 days ago
    Total: 229s
    #566827
  • Pipeline finished with Failed
    12 days ago
    Total: 242s
    #566828
  • Pipeline finished with Failed
    12 days ago
    Total: 359s
    #566838
Production build 0.71.5 2024