harvests

Every harvest, failed or not, with each endpoint it tried and what came back (attempts, as JSON).

Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue

1 row where portal_id = "data.gov.uk" and status = "failed" sorted by id descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: started_at (date), finished_at (date)

status 1

  • failed · 1 ✖

portal_id 1

  • UK Open data portal · 1 ✖

endpoint_type 0

id ▲ portal_id started_at finished_at status endpoint_type endpoint_url endpoint_listed pages datasets complete error attempts
9 UK Open data portal data.gov.uk 2026-11-11T21:53:49+00:00 2026-11-11T21:53:51+00:00 failed       0 0 0 HTTP 404 [{"type": "dcat:ttl", "url": "https://data.gov.uk/catalog.ttl", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:xml", "url": "https://data.gov.uk/catalog.xml", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:jsonld", "url": "https://data.gov.uk/catalog.jsonld", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:n3", "url": "https://data.gov.uk/catalog.n3", "listed": true, "outcome": "HTTP 404"}]

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE harvests (
    id INTEGER PRIMARY KEY,
    portal_id TEXT NOT NULL REFERENCES portals(id),
    started_at TEXT NOT NULL,
    finished_at TEXT NOT NULL,
    status TEXT NOT NULL,
    endpoint_type TEXT,
    endpoint_url TEXT,
    endpoint_listed INTEGER,
    pages INTEGER NOT NULL,
    datasets INTEGER NOT NULL,
    complete INTEGER NOT NULL,
    error TEXT,
    attempts TEXT NOT NULL
);
CREATE INDEX harvests_portal ON harvests(portal_id, id);