What happens?
When trying to run cibulidwheel to build the python package, duckdb python has the step before build yum install -y ccache however it doesn't check update the repo metadata, this can run into issues I think when the repos have changed. I only ran into this after a few successful builds, I'm not sure exactly what the trigger was that made it start breaking, I tried removing my local versions of the docker images but that didn't fix it.
My error:
Running before_build...
+ sh -c 'yum install -y ccache'
AlmaLinux 8 - BaseOS 356 kB/s | 299 kB 00:00
Errors during downloading metadata for repository 'baseos':
- Status code: 404 for http://mirror.dal.nexril.net/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 161.129.154.250)
- Status code: 404 for http://mirror.almalinux.dal01.readydedis.com/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 170.205.52.10)
- Status code: 404 for http://tx-mirror.tier.net/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 181.215.47.106)
- Status code: 404 for http://tx-mirror.tier.net/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 181.215.47.106)
- Status code: 404 for http://mirrors.onenet.net/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 156.110.194.238)
- Status code: 404 for http://mirrors.onenet.net/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 156.110.194.238)
- Status code: 404 for http://nocix.mm.fcix.net/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 69.30.208.233)
- Status code: 404 for http://dal.mirrors.clouvider.net/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 2.56.188.135)
- Status code: 404 for http://dal.mirrors.clouvider.net/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 2.56.188.135)
- Status code: 404 for http://almalinux-mirror.dal1.hivelocity.net/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 23.227.165.226)
- Status code: 404 for http://mirror.almalinux.dal01.readydedis.com/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 170.205.52.10)
- Status code: 404 for http://almalinux-mirror.dal1.hivelocity.net/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 23.227.165.226)
- Status code: 404 for http://mirrors.onenet.net/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 156.110.194.238)
- Status code: 404 for https://na.edge.kernel.org/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 142.0.200.124)
- Status code: 404 for https://na.edge.kernel.org/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 142.0.200.124)
- Status code: 404 for http://mirror.mci-1.serverforge.org/alma/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 23.147.72.19)
- Status code: 404 for http://almalinux-mirror.dal1.hivelocity.net/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 23.227.165.226)
- Status code: 404 for http://almalinux-mirror.yucca.net/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 172.97.0.9)
- Status code: 404 for http://mirror.mci-1.serverforge.org/alma/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 23.147.72.19)
- Status code: 404 for https://na.edge.kernel.org/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 142.0.200.124)
- Status code: 404 for http://mirror.dal.nexril.net/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 161.129.154.250)
- Status code: 404 for http://dal.mirrors.clouvider.net/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 2.56.188.135)
- Status code: 404 for http://mirror.mci-1.serverforge.org/alma/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 23.147.72.19)
- Status code: 404 for http://tx-mirror.tier.net/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 181.215.47.106)
- Status code: 404 for http://mirror.almalinux.dal01.readydedis.com/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 170.205.52.10)
- Status code: 404 for http://nocix.mm.fcix.net/almalinux/8.10/BaseOS/x86_64/os/repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz (IP: 69.30.208.233)
- Status code: 404 for http://mirror.dal.nexril.net/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 161.129.154.250)
- Status code: 404 for http://nocix.mm.fcix.net/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 69.30.208.233)
- Status code: 404 for http://almalinux-mirror.yucca.net/almalinux/8.10/BaseOS/x86_64/os/repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz (IP: 172.97.0.9)
- Status code: 404 for http://almalinux-mirror.yucca.net/almalinux/8.10/BaseOS/x86_64/os/repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz (IP: 172.97.0.9)
Error: Failed to download metadata for repo 'baseos': Yum repo downloading error: Downloading error(s): repodata/ff604d33bc3422272cd2fdd48794c937f503fd8ea479a257e0d7d116e2aa10fe-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/900d0f918166a0797046ecfe8d1ff65ded9e60105383ad9010dd29877befddb7-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/a5a31395c67c2a2c9bdde50b8bbd0a703e4373586eb22d077b21d8dc96f569b6-updateinfo.xml.gz - Cannot download, all mirrors were already tried without success
My gross fix from chatgpt that definitely doesn't work once it gets to the musl step, but works enough for my case
[tool.cibuildwheel.linux]
before-build = ["dnf clean all && rm -rf /var/cache/dnf && dnf makecache && dnf update -y almalinux-release && dnf update -y dnf && dnf update -y && yum install -y ccache"]
To Reproduce
Maybe do this a few times:
CIBW_BUILD='cp311-*' uvx cibuildwheel --platform linux .
Once it starts happening it doesn't stop
OS:
Linux x86_64
DuckDB Package Version:
v1.4.0
Python Version:
3.11
Full Name:
Julian Meyers
Affiliation:
Independent
What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.
I have tested with a nightly build
Did you include all relevant data sets for reproducing the issue?
Not applicable - the reproduction does not require a data set
Did you include all code required to reproduce the issue?
Did you include all relevant configuration to reproduce the issue?
What happens?
When trying to run cibulidwheel to build the python package, duckdb python has the step before build
yum install -y ccachehowever it doesn't check update the repo metadata, this can run into issues I think when the repos have changed. I only ran into this after a few successful builds, I'm not sure exactly what the trigger was that made it start breaking, I tried removing my local versions of the docker images but that didn't fix it.My error:
My gross fix from chatgpt that definitely doesn't work once it gets to the musl step, but works enough for my case
To Reproduce
Maybe do this a few times:
CIBW_BUILD='cp311-*' uvx cibuildwheel --platform linux .Once it starts happening it doesn't stop
OS:
Linux x86_64
DuckDB Package Version:
v1.4.0
Python Version:
3.11
Full Name:
Julian Meyers
Affiliation:
Independent
What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.
I have tested with a nightly build
Did you include all relevant data sets for reproducing the issue?
Not applicable - the reproduction does not require a data set
Did you include all code required to reproduce the issue?
Did you include all relevant configuration to reproduce the issue?