harvests

Every harvest, failed or not, with each endpoint it tried and what came back (attempts, as JSON).

Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue

1 row where portal_id = "govdata.de" and status = "ok" sorted by id descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: started_at (date), finished_at (date)

status 1

portal_id 1

  • Das Datenportal für Deutschland Open Government · 1 ✖

endpoint_type 1

id ▲ portal_id started_at finished_at status endpoint_type endpoint_url endpoint_listed pages datasets complete error attempts
5 Das Datenportal für Deutschland Open Government govdata.de 2026-11-11T21:49:50+00:00 2026-11-11T21:51:45+00:00 ok dcatap21 https://www.govdata.de/ckan/catalog/catalog.rdf 1 100 9913 0 stopped after 100 pages [{"type": "dcatap21", "url": "https://www.govdata.de/ckan/catalog/catalog.rdf", "listed": true, "outcome": "ok"}]

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE harvests (
    id INTEGER PRIMARY KEY,
    portal_id TEXT NOT NULL REFERENCES portals(id),
    started_at TEXT NOT NULL,
    finished_at TEXT NOT NULL,
    status TEXT NOT NULL,
    endpoint_type TEXT,
    endpoint_url TEXT,
    endpoint_listed INTEGER,
    pages INTEGER NOT NULL,
    datasets INTEGER NOT NULL,
    complete INTEGER NOT NULL,
    error TEXT,
    attempts TEXT NOT NULL
);
CREATE INDEX harvests_portal ON harvests(portal_id, id);