home / catalogue

harvests

Every harvest, failed or not, with each endpoint it tried and what came back (attempts, as JSON).

Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue

8 rows where status = "failed" sorted by id descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: started_at, finished_at, error, attempts, started_at (date), finished_at (date)

portal_id 8

  • Northern Ireland Open Data - Open Data Portal 1
  • DGA Data Catalog 1
  • Bangkok Government Open Data 1
  • Open Government Data of Thailand 1
  • UK Open data portal 1
  • hoferLand.digital Datenkatalog 1
  • Leeds Observatory 1
  • Open Data Albi 1

status 1

  • failed · 8 ✖

endpoint_type 0

id ▲ portal_id started_at finished_at status endpoint_type endpoint_url endpoint_listed pages datasets complete error attempts
16 Bangkok Government Open Data data.bangkok.go.th 2026-11-11T21:54:18+00:00 2026-11-11T21:56:02+00:00 failed       0 0 0 network: ConnectError: [Errno 104] Connection reset by peer [{"type": "dcat:ttl", "url": "https://data.bangkok.go.th/catalog.ttl", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}, {"type": "dcat:xml", "url": "https://data.bangkok.go.th/catalog.xml", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}, {"type": "dcat:jsonld", "url": "https://data.bangkok.go.th/catalog.jsonld", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}, {"type": "dcat:n3", "url": "https://data.bangkok.go.th/catalog.n3", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}]
15 DGA Data Catalog catalog-dga.data.go.th 2026-11-11T21:54:17+00:00 2026-11-11T21:54:18+00:00 failed       0 0 0 refused (HTTP 403) [{"type": "dcat:ttl", "url": "https://catalog-dga.data.go.th/catalog.ttl", "listed": true, "outcome": "refused (HTTP 403)"}]
14 Open Government Data of Thailand data.go.th 2026-11-11T21:54:17+00:00 2026-11-11T21:54:17+00:00 failed       0 0 0 refused (HTTP 403) [{"type": "dcat:ttl", "url": "https://data.go.th/catalog.ttl", "listed": false, "outcome": "refused (HTTP 403)"}]
13 Leeds Observatory observatory.leeds.gov.uk 2026-11-11T21:54:17+00:00 2026-11-11T21:54:17+00:00 failed       0 0 0 no DCAT endpoint listed, nor a default path known for esridataobservatory []
10 Northern Ireland Open Data - Open Data Portal admin.opendatani.gov.uk 2026-11-11T21:53:51+00:00 2026-11-11T21:53:51+00:00 failed       0 0 0 refused (HTTP 403) [{"type": "dcat:ttl", "url": "https://admin.opendatani.gov.uk/catalog.ttl", "listed": true, "outcome": "refused (HTTP 403)"}]
9 UK Open data portal data.gov.uk 2026-11-11T21:53:49+00:00 2026-11-11T21:53:51+00:00 failed       0 0 0 HTTP 404 [{"type": "dcat:ttl", "url": "https://data.gov.uk/catalog.ttl", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:xml", "url": "https://data.gov.uk/catalog.xml", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:jsonld", "url": "https://data.gov.uk/catalog.jsonld", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:n3", "url": "https://data.gov.uk/catalog.n3", "listed": true, "outcome": "HTTP 404"}]
8 hoferLand.digital Datenkatalog hoferland-digital.de-app-catalog 2026-11-11T21:53:49+00:00 2026-11-11T21:53:49+00:00 failed       0 0 0 no DCAT endpoint listed, nor a default path known for piveau []
4 Open Data Albi opendata.mairie-albi.fr 2026-11-11T21:49:49+00:00 2026-11-11T21:49:50+00:00 failed       0 0 0 HTTP 404 [{"type": "dcat:ttl", "url": "https://opendata.mairie-albi.fr/catalog.ttl", "listed": false, "outcome": "HTTP 404"}]

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE harvests (
    id INTEGER PRIMARY KEY,
    portal_id TEXT NOT NULL REFERENCES portals(id),
    started_at TEXT NOT NULL,
    finished_at TEXT NOT NULL,
    status TEXT NOT NULL,
    endpoint_type TEXT,
    endpoint_url TEXT,
    endpoint_listed INTEGER,
    pages INTEGER NOT NULL,
    datasets INTEGER NOT NULL,
    complete INTEGER NOT NULL,
    error TEXT,
    attempts TEXT NOT NULL
);
CREATE INDEX harvests_portal ON harvests(portal_id, id);
Powered by Datasette · Queries took 1127.335ms · Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue