DebianRebuildStatus: Difference between revisions
Jump to navigation
Jump to search
NCommander (talk | contribs) No edit summary |
NCommander (talk | contribs) No edit summary |
||
| Line 471: | Line 471: | ||
Bad lock file contents (/var/lock/sbuild) -- still trying | Bad lock file contents (/var/lock/sbuild) -- still trying | ||
Use of uninitialized value $line in pattern match (m//) at -e line 18. | Use of uninitialized value $line in pattern match (m//) at -e line 18. | ||
* Turns out a bunch of the buildds were broken, and I fixed it, but I need to fix the sbuild stuff - tomorrow task | |||
Revision as of 05:04, 30 December 2024
Currently, NCommander is rebuilding the full Debian archive. This page keeps track of notable events and a log of how long everything went
Hardware Specs
- Dell R810
- 40 physical cores (80 with hyperthreading) (4 CPUs x 10 cores with Hyperthreading = 80 cores)
- 512GB RAM
- 5.2 TB - RAID0 SSD 6x980GB drives)
- OS Rocky Linux 9.5
- Hypervisor: VirtualBox 7.0 (supporting Solaris Intel, NT 3.x/4.0 VMs, and other legacy x86 operating systems)
- Virtual Machines
- Debian 12.8
- 16 CPUs/ 32 GB RAM
- meridian: 2TB disk
- meridian2-5: 256GB disk
Build Events
- December 17, 2024
- Build Starters with 514 packages on amd64, and 573 packages for arch all
- Accidently broke the environment by somehow unmounting or overshadowing /dev/pts built in
- Build Starters with 514 packages on amd64, and 573 packages for arch all
- December 18, 2024
- 41 packages down (forgot to write exact number)
- Most of the day spent building acl2
- December 19, 2024:
- Uploaded: 59 (amd64) 109 (all)
- Packages Given-Back (was stuck in building state)
- misc/389-ds-base_2.3.1+dfsg1-1 by buildd_all_1 [optional::calprio{0}:days{1}]
- misc/1oom_1.0-2 by buildd_amd64_1 [optional:uncompiled:calprio{20}:days{1}]
- Spun up meridian2,3,4 as new buildds for both amd64 and all
- Imported source DVDs 2-20 into dak
- Discovered a problem with packages that had been binNMUed
- Currently looking at the cause
- December 20th, 2024:
- 1520 packages built, out of 37822
- AMD64: 604 of 16200
- Arch all: 916 of 21685
- December 21th, 2024
- Had to fix amd64_1 buildd due to chroot breaking due to statsoverride file problem - first time the buildd grenaded
WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m)
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 15082
Building : 6 (buildd_amd64_1: 1, buildd_amd64_2: 1,
buildd_amd64_3: 2, buildd_amd64_4: 2)
Built : 0
Build-Attempted : 1 (buildd_amd64_1: 1)
Uploaded : 604 (buildd_amd64_1: 277, buildd_amd64_2: 8,
buildd_amd64_3: 311, buildd_amd64_4: 8)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 54
Not-For-Us : 0
total : 16200
2.43% up-to-date, 6.15% if also counting uploaded pkgs
6.15% if also counting built pkgs
93.10% uncompiled
0.04% currently building (short-term delay)
0.01% currently failed building (short-term delay)
0.33% failed or waiting (long-term delay)
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 20989
Building : 6 (buildd_all_1: 1, buildd_all_2: 2, buildd_all_3: 2,
buildd_all_4: 1)
Built : 5 (buildd_all_1: 3, buildd_all_2: 2)
Build-Attempted : 10 (buildd_all_2: 5, buildd_all_4: 5)
Uploaded : 996 (buildd_all_1: 318, buildd_all_2: 296, buildd_all_3: 2,
buildd_all_4: 380)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 99
Not-For-Us : 0
total : 34458
1.59% up-to-date, 4.48% if also counting uploaded pkgs
4.50% if also counting built pkgs
60.91% uncompiled
0.02% currently building (short-term delay)
0.03% currently failed building (short-term delay)
0.29% failed or waiting (long-term delay)
- December 22nd, 2024 - approximately 9-10% done
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 19844
Building : 5 (buildd_all_2: 2, buildd_all_3: 2, buildd_all_4: 1)
Built : 6 (buildd_all_1: 1, buildd_all_2: 1, buildd_all_3: 1,
buildd_all_4: 3)
Build-Attempted : 19 (buildd_all_1: 4, buildd_all_2: 6, buildd_all_3: 2,
buildd_all_4: 7)
Uploaded : 2007 (buildd_all_1: 568, buildd_all_2: 603,
buildd_all_3: 200, buildd_all_4: 636)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 224
Not-For-Us : 0
total : 34458
1.59% up-to-date, 7.42% if also counting uploaded pkgs
7.44% if also counting built pkgs
57.59% uncompiled
0.01% currently building (short-term delay)
0.06% currently failed building (short-term delay)
0.65% failed or waiting (long-term delay)
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 14314
Building : 8 (buildd_amd64_1: 2, buildd_amd64_2: 1,
buildd_amd64_3: 2, buildd_amd64_4: 3)
Built : 2 (buildd_amd64_1: 2)
Build-Attempted : 13 (buildd_amd64_1: 6, buildd_amd64_3: 3,
buildd_amd64_4: 4)
Uploaded : 1355 (buildd_amd64_1: 609, buildd_amd64_2: 8,
buildd_amd64_3: 494, buildd_amd64_4: 244)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 55
Not-For-Us : 0
total : 16200
2.43% up-to-date, 10.79% if also counting uploaded pkgs
10.80% if also counting built pkgs
88.36% uncompiled
0.05% currently building (short-term delay)
0.08% currently failed building (short-term delay)
0.34% failed or waiting (long-term delay)
- December 23th, 2024 ~13 percent done
- December 24th, 2024, Christmas Eve, %14.5%
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 13370
Building : 7 (buildd_amd64_1: 2, buildd_amd64_2: 1,
buildd_amd64_3: 1, buildd_amd64_4: 3)
Built : 1 (buildd_amd64_3: 1)
Build-Attempted : 20 (buildd_amd64_1: 8, buildd_amd64_3: 6,
buildd_amd64_4: 6)
Uploaded : 2293 (buildd_amd64_1: 782, buildd_amd64_2: 8,
buildd_amd64_3: 914, buildd_amd64_4: 589)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 56
Not-For-Us : 0
total : 16200
2.43% up-to-date, 16.58% if also counting uploaded pkgs 16.59% if also counting built pkgs 82.53% uncompiled 0.04% currently building (short-term delay) 0.12% currently failed building (short-term delay) 0.35% failed or waiting (long-term delay)
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 18045
Building : 6 (buildd_all_2: 2, buildd_all_3: 3, buildd_all_4: 1)
Built : 5 (buildd_all_2: 2, buildd_all_3: 2, buildd_all_4: 1)
Build-Attempted : 33 (buildd_all_1: 8, buildd_all_2: 9, buildd_all_3: 5,
buildd_all_4: 11)
Uploaded : 3713 (buildd_all_1: 724, buildd_all_2: 1088,
buildd_all_3: 759, buildd_all_4: 1142)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 303
Not-For-Us : 0
total : 34458
1.59% up-to-date, 12.37% if also counting uploaded pkgs 12.38% if also counting built pkgs 52.37% uncompiled 0.02% currently building (short-term delay) 0.10% currently failed building (short-term delay) 0.88% failed or waiting (long-term delay)
- December 25th - Merry Christmas
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 12652
Building : 8 (buildd_amd64_1: 2, buildd_amd64_2: 1,
buildd_amd64_3: 2, buildd_amd64_4: 3)
Built : 0
Build-Attempted : 29 (buildd_amd64_1: 15, buildd_amd64_3: 7,
buildd_amd64_4: 7)
Uploaded : 3002 (buildd_amd64_1: 1026, buildd_amd64_2: 8,
buildd_amd64_3: 1187, buildd_amd64_4: 781)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 56
Not-For-Us : 0
total : 16200
2.43% up-to-date, 20.96% if also counting uploaded pkgs 20.96% if also counting built pkgs 78.10% uncompiled 0.05% currently building (short-term delay) 0.18% currently failed building (short-term delay) 0.35% failed or waiting (long-term delay)
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 16864
Building : 7 (buildd_all_1: 1, buildd_all_2: 2, buildd_all_3: 3,
buildd_all_4: 1)
Built : 2 (buildd_all_1: 1, buildd_all_3: 1)
Build-Attempted : 59 (buildd_all_1: 17, buildd_all_2: 15, buildd_all_3: 9,
buildd_all_4: 18)
Uploaded : 4850 (buildd_all_1: 1010, buildd_all_2: 1363,
buildd_all_3: 1064, buildd_all_4: 1413)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 323
Not-For-Us : 0
total : 34458
1.59% up-to-date, 15.67% if also counting uploaded pkgs 15.67% if also counting built pkgs 48.94% uncompiled 0.02% currently building (short-term delay) 0.17% currently failed building (short-term delay) 0.94% failed or waiting (long-term delay)
- December 26th, 2024
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 11799
Building : 8 (buildd_amd64_1: 2, buildd_amd64_2: 1,
buildd_amd64_3: 2, buildd_amd64_4: 3)
Built : 4 (buildd_amd64_1: 1, buildd_amd64_3: 2,
buildd_amd64_4: 1)
Build-Attempted : 34 (buildd_amd64_1: 19, buildd_amd64_3: 8,
buildd_amd64_4: 7)
Uploaded : 3844 (buildd_amd64_1: 1310, buildd_amd64_2: 8,
buildd_amd64_3: 1429, buildd_amd64_4: 1097)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 58
Not-For-Us : 0
total : 16200
2.43% up-to-date, 26.15% if also counting uploaded pkgs 26.18% if also counting built pkgs 72.83% uncompiled 0.05% currently building (short-term delay) 0.21% currently failed building (short-term delay) 0.36% failed or waiting (long-term delay)
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 15803
Building : 7 (buildd_all_1: 1, buildd_all_2: 2, buildd_all_3: 3,
buildd_all_4: 1)
Built : 7 (buildd_all_2: 2, buildd_all_3: 3, buildd_all_4: 2)
Build-Attempted : 61 (buildd_all_1: 19, buildd_all_2: 15, buildd_all_3: 9,
buildd_all_4: 18)
Uploaded : 5893 (buildd_all_1: 1271, buildd_all_2: 1644,
buildd_all_3: 1330, buildd_all_4: 1648)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 334
Not-For-Us : 0
total : 34458
1.59% up-to-date, 18.70% if also counting uploaded pkgs
18.72% if also counting built pkgs
45.86% uncompiled
0.02% currently building (short-term delay)
0.18% currently failed building (short-term delay)
0.97% failed or waiting (long-term delay)
- Build farm had a power failure, knocking all the buildds offline for four hours
- December 27th, 2024
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 11150
Building : 10 (buildd_amd64_1: 2, buildd_amd64_2: 2,
buildd_amd64_3: 2, buildd_amd64_4: 4)
Built : 8 (buildd_amd64_2: 3, buildd_amd64_3: 5)
Build-Attempted : 35 (buildd_amd64_1: 19, buildd_amd64_2: 1,
buildd_amd64_3: 8, buildd_amd64_4: 7)
Uploaded : 4407 (buildd_amd64_1: 1327, buildd_amd64_2: 229,
buildd_amd64_3: 1736, buildd_amd64_4: 1115)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 137
Not-For-Us : 0
total : 16200
2.43% up-to-date, 29.63% if also counting uploaded pkgs
29.68% if also counting built pkgs
68.83% uncompiled
0.06% currently building (short-term delay)
0.22% currently failed building (short-term delay)
0.85% failed or waiting (long-term delay)
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 15269
Building : 7 (buildd_all_1: 1, buildd_all_2: 2, buildd_all_3: 2,
buildd_all_4: 2)
Built : 2 (buildd_all_1: 2)
Build-Attempted : 67 (buildd_all_1: 23, buildd_all_2: 15, buildd_all_3: 11,
buildd_all_4: 18)
Uploaded : 6264 (buildd_all_1: 1471, buildd_all_2: 1656,
buildd_all_3: 1479, buildd_all_4: 1658)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 496
Not-For-Us : 0
total : 34458
1.59% up-to-date, 19.77% if also counting uploaded pkgs 19.78% if also counting built pkgs 44.31% uncompiled 0.02% currently building (short-term delay) 0.19% currently failed building (short-term delay) 1.44% failed or waiting (long-term delay)
- December 28th, 2024 - 25% DONE
== WANNA-BUILD ARCH ALL PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 549 (buildd_all_1: 278, buildd_all_2: 66,
buildd_all_3: 100, buildd_all_4: 105)
Needs-Build : 14859
Building : 7 (buildd_all_1: 2, buildd_all_2: 2, buildd_all_3: 2,
buildd_all_4: 1)
Built : 1 (buildd_all_1: 1)
Build-Attempted : 70 (buildd_all_1: 26, buildd_all_2: 15, buildd_all_3: 11,
buildd_all_4: 18)
Uploaded : 6481 (buildd_all_1: 1688, buildd_all_2: 1656,
buildd_all_3: 1479, buildd_all_4: 1658)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 687
Not-For-Us : 0
total : 34458
1.59% up-to-date, 20.40% if also counting uploaded pkgs
20.40% if also counting built pkgs
43.12% uncompiled
0.02% currently building (short-term delay)
0.20% currently failed building (short-term delay)
1.99% failed or waiting (long-term delay)
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) ==
Distribution debian-rebuild:
----------------------------
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 10557
Building : 9 (buildd_amd64_1: 3, buildd_amd64_2: 2,
buildd_amd64_3: 1, buildd_amd64_4: 3)
Built : 1 (buildd_amd64_2: 1)
Build-Attempted : 37 (buildd_amd64_1: 19, buildd_amd64_2: 2,
buildd_amd64_3: 9, buildd_amd64_4: 7)
Uploaded : 4891 (buildd_amd64_1: 1327, buildd_amd64_2: 514,
buildd_amd64_3: 1935, buildd_amd64_4: 1115)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 252
Not-For-Us : 0
total : 16200
2.43% up-to-date, 32.62% if also counting uploaded pkgs
32.62% if also counting built pkgs
65.17% uncompiled
0.06% currently building (short-term delay)
0.23% currently failed building (short-term delay)
1.56% failed or waiting (long-term delay)
- December 30th, 2024
== WANNA-BUILD AMD64 PACKAGES TO BE BUILT (updates 10m) == Distribution debian-rebuild:
Installed : 393 (buildd_amd64_1: 162, buildd_amd64_2: 128,
buildd_amd64_3: 1, buildd_amd64_4: 102)
Needs-Build : 9588
Building : 8 (buildd_amd64_1: 2, buildd_amd64_2: 2,
buildd_amd64_3: 1, buildd_amd64_4: 3)
Built : 0
Build-Attempted : 40 (buildd_amd64_1: 19, buildd_amd64_2: 5,
buildd_amd64_3: 9, buildd_amd64_4: 7)
Uploaded : 5619 (buildd_amd64_1: 1327, buildd_amd64_2: 1242,
buildd_amd64_3: 1935, buildd_amd64_4: 1115)
Failed : 0
Dep-Wait : 0
Failed-Removed : 0
Dep-Wait-Removed: 0
BD-Uninstallable: 492
Not-For-Us : 0
total : 16200
2.43% up-to-date, 37.11% if also counting uploaded pkgs 37.11% if also counting built pkgs 59.19% uncompiled 0.05% currently building (short-term delay) 0.25% currently failed building (short-term delay) 3.04% failed or waiting (long-term delay)
* sbuild chroot on amd64/merdidian1 grenaded itself with sbuild lock errors Bad lock file contents (/var/lock/sbuild) -- still trying Use of uninitialized value $line in pattern match (m//) at -e line 18. * Turns out a bunch of the buildds were broken, and I fixed it, but I need to fix the sbuild stuff - tomorrow task