home / catalogue

harvests

Every harvest, failed or not, with each endpoint it tried and what came back (attempts, as JSON).

Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue

1 row where portal_id = "data.gouv.fr" sorted by id descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: started_at (date), finished_at (date)

status 1

  • ok 1

portal_id 1

  • Open platform for French public data · 1 ✖

endpoint_type 1

  • dcat:ttl 1
id ▲ portal_id started_at finished_at status endpoint_type endpoint_url endpoint_listed pages datasets complete error attempts
1 Open platform for French public data data.gouv.fr 2026-11-11T21:45:28+00:00 2026-11-11T21:49:39+00:00 ok dcat:ttl https://data.gouv.fr/api/1/site/catalog.ttl 0 100 9999 0 stopped after 100 pages [{"type": "dcat:ttl", "url": "https://data.gouv.fr/api/1/site/catalog.ttl", "listed": false, "outcome": "ok"}]

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE harvests (
    id INTEGER PRIMARY KEY,
    portal_id TEXT NOT NULL REFERENCES portals(id),
    started_at TEXT NOT NULL,
    finished_at TEXT NOT NULL,
    status TEXT NOT NULL,
    endpoint_type TEXT,
    endpoint_url TEXT,
    endpoint_listed INTEGER,
    pages INTEGER NOT NULL,
    datasets INTEGER NOT NULL,
    complete INTEGER NOT NULL,
    error TEXT,
    attempts TEXT NOT NULL
);
CREATE INDEX harvests_portal ON harvests(portal_id, id);
Powered by Datasette · Queries took 663.64ms · Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue