datagouv / api-tabular Goto Github PK

Return the error code in the payload

Internal column __id exists on every tables that api-tabular will query.

This column does not need to be displayed to users as it is only for internal purposes.

We propose to remove it by default for every API call.

Postgres does not assure consistency when we query a table with a filter statement. More Infos.

To avoid that, we need to apply an order by XXX on a query. Hydra does already support a primary key for every csv transformed into tables which is call __id. We will replicate that process for metrics tables.

We propose that we add to every query that we apply to api-tabular an order by __id.

Beware, when user ask to api-tabular a specific order by to process it well. For instance order by __id, COLUMN_EX

Following #8, we now paginate csv export.
However, we're missing a newline char between batches. At line 50000, we now have

23675330,aee42910-9668-4c0f-9224-ccce2d4e9d6c,58ef2d4aa3a7293d49c4e17e,2023-08,19
23859812,aee46bb9-b8d7-41df-b058-d468dae525cc,61df6c8c0aa25d9bcb36072d,2023-08,10__id,resource_id,dataset_id,metric_month,monthly_visit_resource
24122520,e26a0941-6ef3-4d9f-a2ec-e0d9d2839188,630024d4d1358bde549c016b,2023-08,3