harvests

Every harvest, failed or not, with each endpoint it tried and what came back (attempts, as JSON).

Data license: CC BY 4.0 (portal directory, derived from Dateno); dataset metadata as each portal publishes it · Data source: Dateno, DataPortals.org, data.europa.eu, opendatArchives, and each portal's DCAT catalogue

17 rows sorted by id descending

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: started_at, finished_at, endpoint_listed, pages, datasets, complete, error, attempts, started_at (date), finished_at (date)

endpoint_type 4

status 2

id ▲ portal_id started_at finished_at status endpoint_type endpoint_url endpoint_listed pages datasets complete error attempts
17 Amnat Charoen Local Government Open Data Portal amnatcharoen-local.gdcatalog.go.th 2026-11-11T21:56:02+00:00 2026-11-11T21:56:03+00:00 ok dcat:ttl https://amnatcharoen-local.gdcatalog.go.th/catalog.ttl 1 1 0 1   [{"type": "dcat:ttl", "url": "https://amnatcharoen-local.gdcatalog.go.th/catalog.ttl", "listed": true, "outcome": "ok"}]
16 Bangkok Government Open Data data.bangkok.go.th 2026-11-11T21:54:18+00:00 2026-11-11T21:56:02+00:00 failed       0 0 0 network: ConnectError: [Errno 104] Connection reset by peer [{"type": "dcat:ttl", "url": "https://data.bangkok.go.th/catalog.ttl", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}, {"type": "dcat:xml", "url": "https://data.bangkok.go.th/catalog.xml", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}, {"type": "dcat:jsonld", "url": "https://data.bangkok.go.th/catalog.jsonld", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}, {"type": "dcat:n3", "url": "https://data.bangkok.go.th/catalog.n3", "listed": true, "outcome": "network: ConnectError: [Errno 104] Connection reset by peer"}]
15 DGA Data Catalog catalog-dga.data.go.th 2026-11-11T21:54:17+00:00 2026-11-11T21:54:18+00:00 failed       0 0 0 refused (HTTP 403) [{"type": "dcat:ttl", "url": "https://catalog-dga.data.go.th/catalog.ttl", "listed": true, "outcome": "refused (HTTP 403)"}]
14 Open Government Data of Thailand data.go.th 2026-11-11T21:54:17+00:00 2026-11-11T21:54:17+00:00 failed       0 0 0 refused (HTTP 403) [{"type": "dcat:ttl", "url": "https://data.go.th/catalog.ttl", "listed": false, "outcome": "refused (HTTP 403)"}]
13 Leeds Observatory observatory.leeds.gov.uk 2026-11-11T21:54:17+00:00 2026-11-11T21:54:17+00:00 failed       0 0 0 no DCAT endpoint listed, nor a default path known for esridataobservatory []
12 Birmingham City Observatory cityobservatory.birmingham.gov.uk 2026-11-11T21:53:54+00:00 2026-11-11T21:54:15+00:00 ok dcat:xml https://www.cityobservatory.birmingham.gov.uk/api/v2/catalog/exports/dcat 1 1 712 1   [{"type": "dcat:xml", "url": "https://www.cityobservatory.birmingham.gov.uk/api/v2/catalog/exports/dcat", "listed": true, "outcome": "ok"}]
11 London Datastore – Greater London Authority data.london.gov.uk 2026-11-11T21:53:51+00:00 2026-11-11T21:53:52+00:00 ok dcatus11 https://data.london.gov.uk/data.json 1 1 1310 1   [{"type": "dcatus11", "url": "https://data.london.gov.uk/data.json", "listed": true, "outcome": "ok"}]
10 Northern Ireland Open Data - Open Data Portal admin.opendatani.gov.uk 2026-11-11T21:53:51+00:00 2026-11-11T21:53:51+00:00 failed       0 0 0 refused (HTTP 403) [{"type": "dcat:ttl", "url": "https://admin.opendatani.gov.uk/catalog.ttl", "listed": true, "outcome": "refused (HTTP 403)"}]
9 UK Open data portal data.gov.uk 2026-11-11T21:53:49+00:00 2026-11-11T21:53:51+00:00 failed       0 0 0 HTTP 404 [{"type": "dcat:ttl", "url": "https://data.gov.uk/catalog.ttl", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:xml", "url": "https://data.gov.uk/catalog.xml", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:jsonld", "url": "https://data.gov.uk/catalog.jsonld", "listed": true, "outcome": "HTTP 404"}, {"type": "dcat:n3", "url": "https://data.gov.uk/catalog.n3", "listed": true, "outcome": "HTTP 404"}]
8 hoferLand.digital Datenkatalog hoferland-digital.de-app-catalog 2026-11-11T21:53:49+00:00 2026-11-11T21:53:49+00:00 failed       0 0 0 no DCAT endpoint listed, nor a default path known for piveau []
7 Bonn Open Data Portal opendata.bonn.de 2026-11-11T21:53:47+00:00 2026-11-11T21:53:47+00:00 ok dcatus11 https://opendata.bonn.de/data.json 1 1 286 1   [{"type": "dcatus11", "url": "https://opendata.bonn.de/data.json", "listed": true, "outcome": "ok"}]
6 Open-Data-Leitfaden Schleswig-Holstein opendata.schleswig-holstein.de 2026-11-11T21:51:47+00:00 2026-11-11T21:53:45+00:00 ok dcat:ttl https://opendata.schleswig-holstein.de/catalog.ttl 1 100 10000 0 stopped after 100 pages [{"type": "dcat:ttl", "url": "https://opendata.schleswig-holstein.de/catalog.ttl", "listed": true, "outcome": "ok"}]
5 Das Datenportal für Deutschland Open Government govdata.de 2026-11-11T21:49:50+00:00 2026-11-11T21:51:45+00:00 ok dcatap21 https://www.govdata.de/ckan/catalog/catalog.rdf 1 100 9913 0 stopped after 100 pages [{"type": "dcatap21", "url": "https://www.govdata.de/ckan/catalog/catalog.rdf", "listed": true, "outcome": "ok"}]
4 Open Data Albi opendata.mairie-albi.fr 2026-11-11T21:49:49+00:00 2026-11-11T21:49:50+00:00 failed       0 0 0 HTTP 404 [{"type": "dcat:ttl", "url": "https://opendata.mairie-albi.fr/catalog.ttl", "listed": false, "outcome": "HTTP 404"}]
3 Open Data Biarritz data.biarritz.fr 2026-11-11T21:49:47+00:00 2026-11-11T21:49:48+00:00 ok dcat:xml https://data.biarritz.fr/api/v2/catalog/exports/dcat 1 1 22 1   [{"type": "dcat:xml", "url": "https://data.biarritz.fr/api/v2/catalog/exports/dcat", "listed": true, "outcome": "ok"}]
2 Open Data Occitanie data.laregion.fr 2026-11-11T21:49:41+00:00 2026-11-11T21:49:46+00:00 ok dcat:xml https://data.laregion.fr/api/v2/catalog/exports/dcat 1 1 205 1   [{"type": "dcat:xml", "url": "https://data.laregion.fr/api/v2/catalog/exports/dcat", "listed": true, "outcome": "ok"}]
1 Open platform for French public data data.gouv.fr 2026-11-11T21:45:28+00:00 2026-11-11T21:49:39+00:00 ok dcat:ttl https://data.gouv.fr/api/1/site/catalog.ttl 0 100 9999 0 stopped after 100 pages [{"type": "dcat:ttl", "url": "https://data.gouv.fr/api/1/site/catalog.ttl", "listed": false, "outcome": "ok"}]

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE harvests (
    id INTEGER PRIMARY KEY,
    portal_id TEXT NOT NULL REFERENCES portals(id),
    started_at TEXT NOT NULL,
    finished_at TEXT NOT NULL,
    status TEXT NOT NULL,
    endpoint_type TEXT,
    endpoint_url TEXT,
    endpoint_listed INTEGER,
    pages INTEGER NOT NULL,
    datasets INTEGER NOT NULL,
    complete INTEGER NOT NULL,
    error TEXT,
    attempts TEXT NOT NULL
);
CREATE INDEX harvests_portal ON harvests(portal_id, id);