Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mexico_administracion_publica_federal_bulk: connection refused some times (2024-04), some releases are missing the ocid prefix #1045

Open
yolile opened this issue Jan 5, 2024 · 10 comments
Labels
existing spider unavailable The data source is entirely unavailable

Comments

@yolile
Copy link
Member

yolile commented Jan 5, 2024

This causes duplications when compiling the releases, so we could set the prefix if it is missing so that we can add Mexico Federal to the Registry.

@jpmckinney
Copy link
Member

I'm getting connection refused for https://compranetinfo.hacienda.gob.mx/dabiertos/contrataciones_arr.json.zip

@yolile
Copy link
Member Author

yolile commented Apr 11, 2024

It works for me

@jpmckinney
Copy link
Member

jpmckinney commented Apr 11, 2024

curl https://compranetinfo.hacienda.gob.mx/dabiertos/contrataciones_arr.json.zip fails on server.

@jpmckinney jpmckinney changed the title mexico_administracion_publica_federal_bulk: some releases are missing the ocid prefix mexico_administracion_publica_federal_bulk: some releases are missing the ocid prefix, connection refused some times Apr 11, 2024
@jpmckinney
Copy link
Member

jpmckinney commented Apr 26, 2024

Will freeze this publication, as it fails for me on my local computer.

In Sentry, can filter title:"Gave up retrying <GET https://compranetinfo.hacienda.gob.mx/dabiertos/contrataciones_arr.json.zip..."

@jpmckinney jpmckinney added the unavailable The data source is entirely unavailable label Apr 26, 2024
@jpmckinney jpmckinney changed the title mexico_administracion_publica_federal_bulk: some releases are missing the ocid prefix, connection refused some times mexico_administracion_publica_federal_bulk: some releases are missing the ocid prefix, connection refused some times (2024-04) Apr 26, 2024
@jpmckinney jpmckinney removed the unavailable The data source is entirely unavailable label Apr 26, 2024
@jpmckinney
Copy link
Member

This publication has no active job (though it indicates it was last retrieved April 13, 2023). https://data.open-contracting.org/admin/data_registry/collection/81/change/ It's the only one with that issue - not sure if the job had been deleted for some reason.

@jpmckinney jpmckinney added the unavailable The data source is entirely unavailable label Oct 26, 2024
@jpmckinney jpmckinney changed the title mexico_administracion_publica_federal_bulk: some releases are missing the ocid prefix, connection refused some times (2024-04) mexico_administracion_publica_federal_bulk: connection refused some times (2024-04), some releases are missing the ocid prefix Oct 26, 2024
@jpmckinney
Copy link
Member

Maybe we switch to mexico_administracion_publica_federal_api ? If so, we remove skip_pluck from it.

@yolile
Copy link
Member Author

yolile commented Oct 28, 2024

Maybe we switch to mexico_administracion_publica_federal_api ?

We selected the bulk option as the API has no updated data. But I could download data from the API in Kingfisher to check if that is still true

@jpmckinney
Copy link
Member

Let's do that.

@yolile
Copy link
Member Author

yolile commented Oct 29, 2024

Confirmed, the API only returns data until 2018-12-03 (collection 474 in Kingfisher)

@jpmckinney
Copy link
Member

Ok, I added a caveat to that spider's docstring.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
existing spider unavailable The data source is entirely unavailable
Projects
None yet
Development

No branches or pull requests

2 participants