Docker fails to run containers

[ppom0]

Describe the bug

docker fails to run containers since go has been updated to go1.20.6.

Issue is known upstream: moby/moby#45935 (concise explanation in docker/cli#4437 (comment))

Steps To Reproduce

Steps to reproduce the behavior:

1. Update from the channel nixos-23.05-small
2. Try a docker run alpine sh. Fails with http: invalid Host header

Expected behavior

I can run containers on my server 😭

Quickfix

While I'm waiting for a released fix on nixpkgs, how can I circumvent this? Easiest way seems to downgrade go version used to compile various docker binaries, but docker's https://github.com/nixOS/nixpkgs/blob/master/pkgs/applications/virtualization/docker/default.nix can't accept overrides as various packages are built in a let...in.

Is there an easy way to revert commit e5a213c in nixpkgs?
Or is there any easy way to fix this?

Thanks y'all!

Notify maintainers

docker: @offlinehacker @tailhook @vdemeester @periklis @mikroskeem @maxeaubrey
go: @kalbasit @Mic92 @zowoq @qbit

Metadata

[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
- system: `"x86_64-linux"`
 - host os: `Linux 6.1.38, NixOS, 23.05 (Stoat), 23.05.2067.5f621193137`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.3`
 - channels(root): `"nixos-23.05-small, nixos-unstable"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

[ppom0]

I find it very strange that I'm the first one reporting this issue, as #242949 has been merged on the 12th.
Also I don't get why I already have it on my production system while nixpk.gs indicates it is not in production yet

[nixos-discourse]

This issue has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/how-to-downgrade-go-version-used-to-compile-docker-tools/30634/1

[marysaka]

Same issue here, all my containers died on last auto upgrade.

[skeuchel]

Quickfix

While I'm waiting for a released fix on nixpkgs, how can I circumvent this? Easiest way seems to downgrade go version used to compile various docker binaries, but docker's https://github.com/nixOS/nixpkgs/blob/master/pkgs/applications/virtualization/docker/default.nix can't accept overrides as various packages are built in a let...in.

Is there an easy way to revert commit e5a213c in nixpkgs? Or is there any easy way to fix this?

You can also pin nixpkgs to a working commit.

I find it very strange that I'm the first one reporting this issue, as #242949 has been merged on the 12th.
Also I don't get why I already have it on my production system while nixpk.gs indicates it is not in production yet

That is tracking the master -> nixos-unstable path. The commit was backported to 23.05. It went through the staging branches first, that's why it took some time to show up in the stable branches. That's why it took so long to show up in production after the initial commit.

[ppom0]

Quickfix

1. Add this to /etc/nixos/configuration.nix to pin nixpkgs to just before the offending commit:

  nix.nixPath = [
    "nixpkgs=https://github.com/NixOS/nixpkgs/archive/b6bbc53029a31f788ffed9ea2d459f0bb0f0fbfc.tar.gz"
    "nixos-config=/etc/nixos/configuration.nix"
    "/nix/var/nix/profiles/per-user/root/channels"
  ];

2. Run sudo nixos-rebuild switch once. It updates the NIX_PATH for future invocations.
3. Run sudo nixos-rebuild switch a second time. It rebuilds your system taking into account the new NIX_PATH.

Just hope that downgrading all the other software updated since then won't break anything else 🤞 (It didn't on my server)

[jgus]

+1 here. Thanks for the workaround!